Data Engineer

1 month ago

Wyton, East Yorkshire, United Kingdom Atreides Full time
Job Title: Data Engineer

At Atreides, we're revolutionizing defense intelligence with cutting-edge geo-spatial data solutions. We're seeking a talented Data Engineer to design, implement, and optimize data pipelines for vast datasets.

Key Responsibilities:
  • Design and maintain scalable data pipelines using Spark, Scala, Java, and Python.
  • Manage Iceberg tables for efficient data storage and retrieval.
  • Enforce data governance and retention policies.
  • Collaborate with engineers on AWS infrastructure and automation.
  • Ensure data security and troubleshoot pipelines for high performance.
  • Document engineering processes and best practices.
Requirements:
  • Active SC Government Issued Clearance.
  • 3+ years of experience in data engineering or similar roles.
  • Proficiency in Spark, Scala, Java, and Python.
  • Experience with Postgres, GraphQL, and data manipulation tools.
  • Understanding of data optimization, storage solutions, and governance.
  • Familiarity with AWS or Azure, big data tools, and geospatial data formats.
  • Strong problem-solving skills and effective communication abilities.
Why Atreides?
  • Competitive Salary + Comprehensive Health Benefits.
  • Flexible Hybrid Work Environment + Flexible Hours.
  • Work Travel Opportunities + Generous Vacation & Parental Leave.

  • Data Engineering Specialist

    2 months ago

    Wyton, East Yorkshire, United Kingdom Atreides Full time

    Job OverviewAt Atreides, we're seeking a skilled Data Engineer to join our team and contribute to the development of cutting-edge geo-spatial data solutions. As a key member of our infrastructure team, you'll be responsible for designing, implementing, and optimizing data pipelines for vast datasets.Key ResponsibilitiesData Pipeline Development: Design and...

  • Data Engineering Specialist

    4 weeks ago

    Wyton, East Yorkshire, United Kingdom Atreides Full time

    Job OverviewAt Atreides, we're seeking a skilled Data Engineer to join our team and contribute to the development of cutting-edge geo-spatial data solutions. As a key member of our infrastructure team, you'll be responsible for designing, implementing, and optimizing data pipelines for vast datasets.Key ResponsibilitiesData Pipeline Development: Design and...

  • Data Engineer

    1 month ago

    Wyton, East Yorkshire, United Kingdom Atreides Full time

    Job Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at Atreides. As a key member of our data engineering team, you will be responsible for designing, implementing, and optimizing data pipelines for vast datasets. Your expertise in Spark, Scala, Java, and Python will enable you to manage data integrity,...

  • Data Engineer

    1 month ago

    Wyton, East Yorkshire, United Kingdom Atreides Full time

    Job Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at Atreides. As a key member of our data engineering team, you will be responsible for designing, implementing, and optimizing data pipelines for vast datasets. Your expertise in Spark, Scala, Java, and Python will enable you to manage data integrity,...

  • Data Engineer

    1 month ago

    Wyton, East Yorkshire, United Kingdom Atreides Full time

    Job Title: Data EngineerCompany Overview:Atreides is a pioneering startup in the defense intelligence sector, leveraging cutting-edge geo-spatial data solutions to revolutionize the industry.Job Summary:We are seeking a highly skilled Data Engineer to design, implement, and optimize data pipelines for vast datasets, ensuring data integrity, security, and...

  • Data Engineer

    1 month ago

    Wyton, East Yorkshire, United Kingdom Atreides Full time

    Job Title: Data EngineerCompany Overview:Atreides is a pioneering startup in the defense intelligence sector, leveraging cutting-edge geo-spatial data solutions to revolutionize the industry.Job Summary:We are seeking a highly skilled Data Engineer to design, implement, and optimize data pipelines for vast datasets, ensuring data integrity, security, and...

  • Data Engineer

    4 weeks ago

    Wyton, East Yorkshire, United Kingdom Atreides Full time

    Job Title: Data EngineerAt Atreides, we're revolutionizing defense intelligence with cutting-edge geo-spatial data solutions. We're seeking a talented Data Engineer to design, implement, and optimize data pipelines for vast datasets.Key Responsibilities:Build and maintain scalable data pipelines using Spark, Scala, Java, and Python.Manage Iceberg tables for...

  • Data Engineer

    4 weeks ago

    Wyton, East Yorkshire, United Kingdom Atreides Full time

    Job Title: Data EngineerAt Atreides, we're revolutionizing defense intelligence with cutting-edge geo-spatial data solutions. We're seeking a talented Data Engineer to design, implement, and optimize data pipelines for vast datasets.Key Responsibilities:Build and maintain scalable data pipelines using Spark, Scala, Java, and Python.Manage Iceberg tables for...

  • Data Architect

    2 months ago

    Wyton, East Yorkshire, United Kingdom Atreides Full time

    Job OverviewAtreides - Transforming Defense IntelligenceClearance: active DVCompany Profile:Atreides is a pioneering startup revolutionizing defense intelligence with cutting-edge geo-spatial data solutions. We're a dynamic, fast-growing organization that thrives on innovation and collaboration.What We're Looking For:We're seeking a highly skilled Data...

  • Data Architect

    2 months ago

    Wyton, East Yorkshire, United Kingdom Atreides Full time

    Job OverviewAtreides - Transforming Defense IntelligenceClearance: active DVCompany Profile:Atreides is a pioneering startup revolutionizing defense intelligence with cutting-edge geo-spatial data solutions. We're a dynamic, fast-growing organization that thrives on innovation and collaboration.What We're Looking For:We're seeking a highly skilled Data...

  • Big Data Solutions Architect

    4 weeks ago

    Wyton, East Yorkshire, United Kingdom Atreides Full time

    Job OverviewAt Atreides, we're seeking a skilled Data Engineer to join our team and contribute to the development of cutting-edge geo-spatial data solutions. As a key member of our infrastructure team, you'll be responsible for designing, implementing, and optimizing data pipelines for vast datasets.Key ResponsibilitiesData Pipeline Development: Design and...

  • Big Data Solutions Architect

    2 months ago

    Wyton, East Yorkshire, United Kingdom Atreides Full time

    Job OverviewAt Atreides, we're seeking a skilled Data Engineer to join our team and contribute to the development of cutting-edge geo-spatial data solutions. As a key member of our infrastructure team, you'll be responsible for designing, implementing, and optimizing data pipelines for vast datasets.Key ResponsibilitiesData Pipeline Development: Design and...

  • Data Pipeline Optimization Expert

    2 months ago

    Wyton, East Yorkshire, United Kingdom Atreides Full time

    Job OverviewAt Atreides, we're seeking a skilled Data Engineer to join our team and contribute to the development of cutting-edge geo-spatial data solutions. As a key member of our infrastructure team, you'll be responsible for designing, implementing, and optimizing data pipelines for vast datasets.Key ResponsibilitiesData Pipeline Development: Design and...

  • Data Pipeline Optimization Expert

    4 weeks ago

    Wyton, East Yorkshire, United Kingdom Atreides Full time

    Job OverviewAt Atreides, we're seeking a skilled Data Engineer to join our team and contribute to the development of cutting-edge geo-spatial data solutions. As a key member of our infrastructure team, you'll be responsible for designing, implementing, and optimizing data pipelines for vast datasets.Key ResponsibilitiesData Pipeline Development: Design and...

  • National Centre for Geospatial Intelligence

    5 months ago

    Wyton, United Kingdom Ministry of Defence Full time

    **Details**: **Reference number**: - 346981**Salary**: - £28,300- A Civil Service Pension with an average employer contribution of 27%**Job grade**: - Executive Officer- D**Contract type**: - Permanent**Business area**: - MOD - Strategic Command**Type of role**: - Information Technology**Working pattern**: - Flexible working, Full-time, Job share,...