Data Engineer

3 weeks ago

Cheltenham Gloucestershire, United Kingdom Atreides Full time

Job Title: AWS Infrastructure/Data Engineer (Hybrid, UK) Hybrid: Remote + 2 days a week in Cheltenham, Hereford, or Poole (employee choice)
Atreides helps organizations transform large and complex multi-modal datasets into information-rich, geo-spatial data subscriptions used across various use cases. We focus on providing defense intelligence professionals with high-fidelity data solutions to derive insights quickly. As a fast-growing, high-performance early-stage company, we value diversity and inclusion, trust, and autonomy. A mission-driven mindset and entrepreneurial spirit are essential as we work to unlock the power of massive-scale data for a safer, stronger, and more prosperous world.
We are a passionate team of technologists, data scientists, and analysts with backgrounds in operational intelligence, law enforcement, large multinationals, and cybersecurity operations. We are looking for a skilled AWS Infrastructure/Data Engineer with a focus on Infrastructure as Code (IaC) and data engineering. Your role will involve designing, implementing, and maintaining scalable, secure AWS cloud infrastructure, as well as creating data pipelines and storage solutions. You will ensure the reliability and availability of infrastructure for data processing on a petabyte scale and collaborate closely with our infrastructure engineers and data engineers to automate and streamline data processes.
Design, implement, and maintain scalable, secure AWS infrastructure with a focus on Infrastructure as Code (IaC).
Design, develop, and maintain scalable data pipelines using Spark, Python, Java and. Implement and manage Iceberg tables, ensuring efficient data storage and retrieval.
Optimize data storage solutions, including hot, cold, and glacier storage tiers.
Develop and enforce data retention policies and ensure compliance with data governance standards.
Collaborate with software engineers to ensure the infrastructure effectively supports application requirements.
Ensure data security and implement necessary measures to protect sensitive information.
Monitor and troubleshoot data pipelines and infrastructure to ensure high availability and performance.
Document infrastructure design, data engineering processes, and maintain comprehensive documentation.
3+ years of experience in AWS Infrastructure and/or SRE roles, with applicable Associate or Professional AWS certificates being a plus.
~ Experience with data orchestration tools such as Airflow, Prefect, Dagster, or Temporal.
~ Proficiency in Spark, Java, and Python. Experience with Postgres, GraphQL, and other data manipulation tools.
~ Knowledge of big data tools and environments, including Apache Iceberg and other datalake concepts.
~ Familiarity with geospatial data formats such as Parquet/GeoParquet, GeoJSON, and Shapefiles.
~ Experience with DevOps tools such as Git, Docker, Jenkins, etc.
~ Knowledge of networking concepts such as IP Protocol, DNS, and load balancing.
~ Excellent problem-solving skills and the ability to think quickly in a high-performance environment.
~ Compensation and Benefits:
● Competitive salary
● Comprehensive health, dental, and vision insurance plans
● Flexible hybrid work environment
● Additional benefits like flexible hours, work travel opportunities, competitive vacation time and parental leave

  • Data Engineer

    3 months ago

    Gloucestershire, United Kingdom Hexegic Full time

    Are you passionate about advancing your career in data and software engineering? Here at Hexegic we are looking for driven and innovative data engineers to grow professionally, whilst collaborating with some of the industry’s brightest minds.Your role will be essential in helping customers build and maintain data pipelines and applications, using...

  • Data Engineer

    3 months ago

    Gloucestershire, United Kingdom Hexegic Full time €5,000

    Are you passionate about advancing your career in data and software engineering? Here at Hexegic we are looking for driven and innovative data engineers to grow professionally, whilst collaborating with some of the industry’s brightest minds. Your role will be essential in helping customers build and maintain data pipelines and applications, using...

  • Data Engineer

    3 months ago

    Gloucestershire, United Kingdom Hexegic Full time €5,000

    Are you passionate about advancing your career in data and software engineering? Here at Hexegic we are looking for driven and innovative data engineers to grow professionally, whilst collaborating with some of the industry’s brightest minds. Your role will be essential in helping customers build and maintain data pipelines and applications, using...

  • Data Engineer

    3 months ago

    Gloucestershire, United Kingdom Hexegic Full time

    Are you passionate about advancing your career in data and software engineering? Here at Hexegic we are looking for driven and innovative data engineers to grow professionally, whilst collaborating with some of the industry’s brightest minds.Your role will be essential in helping customers build and maintain data pipelines and applications, using...

  • Data Engineer

    3 months ago

    Gloucestershire, United Kingdom Hexegic Full time

    Are you passionate about advancing your career in data and software engineering? Here at Hexegic we are looking for driven and innovative data engineers to grow professionally, whilst collaborating with some of the industry’s brightest minds.Your role will be essential in helping customers build and maintain data pipelines and applications, using...

  • Data Engineer

    3 months ago

    Gloucestershire, United Kingdom Hexegic Full time

    Are you passionate about advancing your career in data and software engineering? Here at Hexegic we are looking for driven and innovative data engineers to grow professionally, whilst collaborating with some of the industry’s brightest minds. Your role will be essential in helping customers build and maintain data pipelines and applications, using...

  • DV Cleared AWS

    2 weeks ago

    Cheltenham, Gloucestershire, United Kingdom Atreides Full time

    Job Title: AWS Infrastructure/Data Engineer (Hybrid, UK) Hybrid: Remote + 2 days a week in Cheltenham, Hereford, or Poole (employee choice) Clearance: DV JobID: 02 Company Overview: Atreides helps organizations transform large and complex multi-modal datasets into information-rich, geo-spatial data subscriptions used across various use cases. We...

  • DV Cleared AWS

    3 weeks ago

    Cheltenham, Gloucestershire, United Kingdom Atreides Full time

    Job Title: AWS Infrastructure/Data Engineer (Hybrid, UK) Hybrid: Remote + 2 days a week in Cheltenham, Hereford, or Poole (employee choice) Clearance: DV JobID: 02 Company Overview: Atreides helps organizations transform large and complex multi-modal datasets into information-rich, geo-spatial data subscriptions used across various use cases. We...

  • DV Cleared AWS

    2 weeks ago

    Cheltenham, Gloucestershire, United Kingdom Atreides Full time

    MUST HAVE CLEARANCE: DV PLEASE DO NOT APPY IF YOU DONT MEET THIS REQUIREMENT Job Title: AWS Infrastructure/Data Engineer (Hybrid, UK) Hybrid: Remote + 1 days a week in West Midland area JobID: 02 Company Overview: Atreides helps organizations transform large and complex multi-modal datasets into information-rich, geo-spatial data subscriptions used...

  • DV Cleared AWS

    2 weeks ago

    Cheltenham, Gloucestershire, United Kingdom Atreides Full time

    MUST HAVE CLEARANCE: DV PLEASE DO NOT APPY IF YOU DONT MEET THIS REQUIREMENT Job Title: AWS Infrastructure/Data Engineer (Hybrid, UK) Hybrid: Remote + 1 days a week in West Midland area JobID: 02 Company Overview: Atreides helps organizations transform large and complex multi-modal datasets into information-rich, geo-spatial data subscriptions used...

  • Data Engineer

    2 days ago

    Gloucestershire, United Kingdom Hexegic Full time

    Are you passionate about advancing your career in data and software engineering? Here at Hexegic we are looking for driven and innovative data engineers to grow professionally, whilst collaborating with some of the industry’s brightest minds.Find out if this opportunity is a good fit by reading all of the information that follows below.Your role will be...

  • Data Engineer

    1 month ago

    Gloucestershire, United Kingdom ea Change Group Ltd Full time

    Location: Gloucestershire (hybrid working) PLEASE DO NOT APPLY UNLESS YOU ARE ABLE TO BE IN GLOUCESTERSHIRE 2 TIMES PER WEEK Rate: £550 - £600/day (via umbrella)Duration: 6 months Data Engineer with experience in SQL and Snowflake required for a 6 month contract working with a leading Financial Services client.Overview- Plan and drives the development of...

  • Senior Engineer, Data Engineering

    3 months ago

    Gloucestershire, United Kingdom Hexegic Full time €5,000

    Are you passionate about advancing your career in data and software engineering? Here at Hexegic we are looking for driven and innovative data engineers to grow professionally, whilst collaborating with some of the industry’s brightest minds. Your role will be essential in helping customers build and maintain data pipelines and applications, using...

  • Senior Engineer, Data Engineering

    3 months ago

    Gloucestershire, United Kingdom Hexegic Full time €5,000

    Are you passionate about advancing your career in data and software engineering? Here at Hexegic we are looking for driven and innovative data engineers to grow professionally, whilst collaborating with some of the industry’s brightest minds. Your role will be essential in helping customers build and maintain data pipelines and applications, using...

  • Marketing Data Scientist

    1 week ago

    Cheltenham, Gloucestershire, United Kingdom Searchability NS&D Full time €85,000

    New Permanent Opportunity for a DV Cleared Data Scientist in Cheltenham for a leading National Security and Defence Consultancy client. ~ Up to £85k DoE plus bonuses and benefits ~3 days on site per week in Cheltenham ~ Skills required in Machine Learning, AWS/Azure, Python, NLP, AI We are recruiting a Data Scientist with DV Clearance for a...

  • Marketing Data Scientist

    3 weeks ago

    Cheltenham, Gloucestershire, United Kingdom Searchability NS&D Full time €85,000

    New Permanent Opportunity for a DV Cleared Data Scientist in Cheltenham for a leading National Security and Defence Consultancy client. ~ Up to £85k DoE plus bonuses and benefits ~3 days on site per week in Cheltenham ~ Skills required in Machine Learning, AWS/Azure, Python, NLP, AI We are recruiting a Data Scientist with DV Clearance for a...

  • Data Engineer

    3 months ago

    Gloucestershire, UK, South West England, United Kingdom Hexegic Full time

    Are you passionate about advancing your career in data and software engineering? Here at Hexegic we are looking for driven and innovative data engineers to grow professionally, whilst collaborating with some of the industry’s brightest minds.Your role will be essential in helping customers build and maintain data pipelines and applications, using...

  • Senior Data Engineering Lead

    2 days ago

    Cheltenham, Gloucestershire, United Kingdom Hexegic Full time £5,000

    About the RoleWe are seeking a highly skilled and experienced Data Engineer to join our team at Hexegic. As a Data Engineer, you will play a critical role in designing, developing, and maintaining our data pipelines and applications.Key ResponsibilitiesDesign and develop bespoke full end-to-end data projectsCollaborate with data scientists, analysts, product...

  • Senior Data Engineering Lead

    2 days ago

    Cheltenham, Gloucestershire, United Kingdom Hexegic Full time £5,000

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Hexegic. As a key member of our engineering team, you will play a critical role in designing, developing, and maintaining our data pipelines and applications.Key ResponsibilitiesDesign and develop bespoke full end-to-end data projects to meet customer needs.Collaborate with data...

  • Petabyte-Scale Data Engineer

    2 days ago

    Cheltenham, Gloucestershire, United Kingdom Atreides Full time

    About AtreidesAtreides is a cutting-edge technology company that specializes in transforming complex data into actionable insights. Our mission is to empower defense intelligence professionals with high-fidelity data solutions to drive informed decision-making.Job OverviewWe are seeking a highly skilled Azure Infrastructure/Site Reliability Engineer to join...