Current jobs related to Petabyte-Scale Data Engineer - Cheltenham, Gloucestershire - Atreides
-
Cheltenham, Gloucestershire, United Kingdom Ripjar Full timeJob Description:Ripjar is seeking a highly skilled Machine Learning Engineer to support the design, development, and ongoing maintenance of our analytics and data products. As a key member of our team, you will design and implement machine learning solutions, develop and optimize their models, and ensure their integration into our software products and data...
-
Data Engineer
4 weeks ago
Cheltenham, Gloucestershire, United Kingdom Hexegic Full timeJob Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Hexegic. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our data pipelines and applications.Key Responsibilities:Design and develop end-to-end data projects using proprietary commercial software.Collaborate with data...
-
Data Engineer
4 weeks ago
Cheltenham, Gloucestershire, United Kingdom Hexegic Full timeJob Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Hexegic. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our data pipelines and applications.Key Responsibilities:Design and develop end-to-end data projects using proprietary commercial software.Collaborate with data...
-
Data Engineer
1 month ago
Cheltenham, Gloucestershire, United Kingdom Hexegic Full timeUnlock Your Potential as a Data Engineer at HexegicWe are seeking a talented Data Engineer to join our team at Hexegic, where you will have the opportunity to work on cutting-edge data projects and collaborate with a team of innovative professionals.Your Key Responsibilities:Design and develop end-to-end data projects, leveraging proprietary commercial...
-
Data Engineer
1 month ago
Cheltenham, Gloucestershire, United Kingdom Hexegic Full timeUnlock Your Potential as a Data Engineer at HexegicWe are seeking a talented Data Engineer to join our team at Hexegic, where you will have the opportunity to work on cutting-edge data projects and collaborate with a team of innovative professionals.Your Key Responsibilities:Design and develop end-to-end data projects, leveraging proprietary commercial...
-
Senior Data Engineer
1 month ago
Cheltenham, Gloucestershire, United Kingdom Hexegic Full time £5,000Join Our Team of Data Engineers at HexegicWe are seeking a talented Data Engineer to join our team at Hexegic. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our data pipelines and applications.Key Responsibilities:Design and develop bespoke full end-to-end data projectsWork closely with data scientists, analysts,...
-
Senior Data Engineer
1 month ago
Cheltenham, Gloucestershire, United Kingdom Hexegic Full time £5,000Join Our Team of Data Engineers at HexegicWe are seeking a talented Data Engineer to join our team at Hexegic. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our data pipelines and applications.Key Responsibilities:Design and develop bespoke full end-to-end data projectsWork closely with data scientists, analysts,...
-
Data Scientist
1 month ago
Cheltenham, Gloucestershire, United Kingdom Ripjar Ltd Full timeAbout Ripjar LtdRipjar Ltd is a leading provider of data analytics and machine learning solutions. Our team of experts helps governments and organizations automate the detection, investigation, and monitoring of threats from criminal activity.Job DescriptionWe are seeking an experienced Data Scientist to join our team. As a Data Scientist at Ripjar Ltd, you...
-
Data Scientist
1 month ago
Cheltenham, Gloucestershire, United Kingdom Ripjar Ltd Full timeAbout Ripjar LtdRipjar Ltd is a leading provider of data analytics and machine learning solutions. Our team of experts helps governments and organizations automate the detection, investigation, and monitoring of threats from criminal activity.Job DescriptionWe are seeking an experienced Data Scientist to join our team. As a Data Scientist at Ripjar Ltd, you...
-
Data Scientist
2 weeks ago
Cheltenham, Gloucestershire, United Kingdom Ripjar Ltd Full timeAbout the RoleRipjar Ltd is seeking a highly skilled Data Scientist to join our team. As a Data Scientist, you will play a key role in developing and maintaining our analytics and data products.Key Responsibilities:Carry out data analysis tasks to develop Ripjar's understanding of relevant data.Make use of Ripjar's large-scale data processing and analysis...
-
Data Scientist
1 month ago
Cheltenham, Gloucestershire, United Kingdom Ripjar Ltd Full timeAbout Ripjar LtdRipjar Ltd is a leading provider of data analytics and machine learning solutions. Our team of experts helps governments and organizations automate the detection, investigation, and monitoring of threats from criminal activity.Job DescriptionWe are seeking an experienced Data Scientist to join our team. As a Data Scientist at Ripjar Ltd, you...
-
Data Scientist
1 month ago
Cheltenham, Gloucestershire, United Kingdom Ripjar Ltd Full timeAbout Ripjar LtdRipjar Ltd is a leading provider of data analytics and machine learning solutions. Our team of experts helps governments and organizations automate the detection, investigation, and monitoring of threats from criminal activity.Job DescriptionWe are seeking an experienced Data Scientist to join our team. As a Data Scientist at Ripjar Ltd, you...
-
Data Analysis Scientist
2 months ago
Cheltenham, Gloucestershire, United Kingdom Ripjar Ltd Full timeAbout Ripjar LtdRipjar Ltd is a leading provider of advanced analytics and data science solutions, helping governments and organizations automate the detection, investigation, and monitoring of threats from criminal activity.Our team of experts is dedicated to delivering high-quality data science products and software to various environments through...
-
Data Analysis Scientist
2 months ago
Cheltenham, Gloucestershire, United Kingdom Ripjar Ltd Full timeAbout Ripjar LtdRipjar Ltd is a leading provider of advanced analytics and data science solutions, helping governments and organizations automate the detection, investigation, and monitoring of threats from criminal activity.Our team of experts is dedicated to delivering high-quality data science products and software to various environments through...
-
Data Scientist
2 weeks ago
Cheltenham, Gloucestershire, United Kingdom Ripjar Ltd Full timeAbout Ripjar LtdRipjar Ltd is a leading provider of data analytics and machine learning solutions. Our team of experts helps governments and organizations automate the detection, investigation, and monitoring of threats from criminal activity.Job DescriptionWe are seeking an experienced Data Scientist to join our team. The successful candidate will be...
-
Data and AI Strategist
4 weeks ago
Cheltenham, Gloucestershire, United Kingdom Spirax-Sarco Engineering Full timeRole Overview:As a key member of our Zenith programme, the Data and AI Lead will be responsible for designing and delivering our global data strategy. Scaling our Data, Development, and AI services are crucial, and we are seeking a dynamic leader to take ownership of this exciting journey.If you are driven by excellence and thrive on shaping high-impact data...
-
Data and AI Strategist
4 weeks ago
Cheltenham, Gloucestershire, United Kingdom Spirax-Sarco Engineering Full timeRole Overview:As a key member of our Zenith programme, the Data and AI Lead will be responsible for designing and delivering our global data strategy. Scaling our Data, Development, and AI services are crucial, and we are seeking a dynamic leader to take ownership of this exciting journey.If you are driven by excellence and thrive on shaping high-impact data...
-
Cheltenham, Gloucestershire, United Kingdom Searchability Full timeJob DescriptionWe are seeking a highly skilled Data Scientist to join our team. The ideal candidate will have expertise in data engineering, including Hadoop and big data technologies.Develop and implement predictive models and machine learning algorithms.Utilize Java or Python for data analysis, model development, and automation.Leverage Hadoop and other...
-
Data Engineer SQL Specialist
2 days ago
Cheltenham, Gloucestershire, United Kingdom Anson McCade Full timeData EngineerAnson McCade is partnering with a world-renowned consultancy to appoint a Data Engineer to their organisation. This opportunity is ideal for experienced professionals driven by curiosity and innovation, committed to building AI-powered, cloud-native software solutions for clients' customers.The Data Engineer will work across product and...
-
Data and AI Strategist
4 weeks ago
Cheltenham, Gloucestershire, United Kingdom Chromalox Full timeJob Title: Data & AI LeadLocation: Cheltenham, UK (Hybrid working)Job Summary:We are seeking a highly skilled Data & AI Lead to join our team at Chromalox. As a key member of our Zenith programme, you will be responsible for designing and delivering our global data strategy. Your expertise in scaling data, development, and AI services will be instrumental in...
Petabyte-Scale Data Engineer
2 months ago
Atreides is a cutting-edge technology company that specializes in transforming complex data into actionable insights. Our mission is to empower defense intelligence professionals with high-fidelity data solutions to drive informed decision-making.
Job OverviewWe are seeking a highly skilled Azure Infrastructure/Site Reliability Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, implementing, and maintaining scalable, secure cloud infrastructure on Azure. Your expertise will be crucial in ensuring the reliability and availability of our infrastructure for petabyte-scale data processing.
Key Responsibilities- Design and implement scalable, secure Azure infrastructure using Infrastructure-as-Code (IaC) principles.
- Continuously monitor and optimize infrastructure for availability, performance, and cost-effectiveness.
- Collaborate with software engineers to ensure infrastructure effectively supports application requirements.
- Maintain high-level system security and implement necessary security measures.
- Utilize expertise in big data to ensure infrastructure is optimized for data processing on a petabyte scale.
- Lead troubleshooting and resolution efforts for infrastructure issues, providing swift and reliable solutions.
- Collaborate with third-party entities to provide expertise on cloud and technical DevOps.
- Develop and maintain detailed documentation of infrastructure design and specifications.
- Work with multiple third-party vendors on cutting-edge defense-facing programs, including sensor and cloud integration platforms.
- Provide advisory and collaborative work on niche technical asks, requiring outside-the-box problem-solving to provide obscure solutions.
- 3+ years of experience in Azure Infrastructure and/or SRE roles, with Azure certificates in Network, Admin, Security, and Hybrid Admin a plus.
- Strong background in Infrastructure as Code (IaC) using tools such as Pulumi or Terraform or CloudFormation, along with experience in deploying and managing Kubernetes clusters.
- Proficiency in implementing and integrating VPN solutions and overlay services, such as those from Cloudflare, into complex cloud-hosted network infrastructures.
- Knowledge of big data tools and environments, having previously worked with at least 100TB of data at production scale.
- Experience with SQL and noSQL environments.
- Familiarity with geospatial data formats such as Parquet/GeoParquet, GeoJSON, and Shapefiles is a plus.
- Experience in using DevOps tools such as Git, Docker, Jenkins, etc.
- Knowledge of networking concepts such as IP Protocol, DNS, and load balancing, spanning both hardware and software, with experience from cloud infrastructures to physical systems, ideally with exposure to CCNA certification.
- Experience with orchestration like Dagster, Prefect, Airflow, or Temporal.
- Excellent problem-solving skills and the ability to think quickly in a high-performance environment.
- The ability to effectively communicate technical concepts to both technical and non-technical stakeholders.
- Competitive salary.
- Comprehensive health, dental, and vision insurance plans.
- Flexible hybrid work environment.
- Additional benefits like flexible hours, work travel opportunities, competitive vacation time, and parental leave.