Current jobs related to Data Engineer - Wyton, East Yorkshire - Atreides

  • National Centre for Geospatial Intelligence

    5 months ago

    Wyton, United Kingdom Ministry of Defence Full time

    **Details**: **Reference number**: - 346981**Salary**: - £28,300- A Civil Service Pension with an average employer contribution of 27%**Job grade**: - Executive Officer- D**Contract type**: - Permanent**Business area**: - MOD - Strategic Command**Type of role**: - Information Technology**Working pattern**: - Flexible working, Full-time, Job share,...

Data Engineer

2 months ago

Wyton, East Yorkshire, United Kingdom Atreides Full time
About Atreides

Atreides is a pioneering startup in the defense intelligence sector, leveraging cutting-edge geo-spatial data solutions to revolutionize the industry. Our mission is to create a safer and more resilient world, and we're driven by a passion for innovation and excellence.

Job Summary

We're seeking a highly skilled Data Engineer to join our team and contribute to the design, implementation, and optimization of data pipelines for vast datasets. As a key member of our infrastructure team, you'll work closely with engineers to automate and streamline processes, ensuring data integrity, security, and accessibility.

Key Responsibilities
  • Design and implement scalable data pipelines using Spark, Scala, Java, and Python, with a bonus for Golang expertise
  • Manage Iceberg tables for efficient data storage and retrieval, enforcing data governance and retention policies
  • Collaborate with engineers on AWS infrastructure and automation, ensuring data security and troubleshooting pipelines for high performance
  • Document engineering processes and best practices, driving knowledge sharing and continuous improvement
Requirements
  • 3+ years of experience in data engineering or similar roles, with a strong background in data optimization, storage solutions, and governance
  • Proficiency in Spark, Scala, Java, and Python, with Golang a plus
  • Experience with Postgres, GraphQL, and data manipulation tools, as well as familiarity with AWS or Azure, big data tools, and geospatial data formats
  • Strong problem-solving skills and effective communication abilities, with a proven track record of delivering high-quality results
  • Active SC Government Issued Clearance required
What We Offer
  • Competitive salary and comprehensive health benefits
  • Flexible hybrid work environment and flexible hours
  • Work travel opportunities and generous vacation and parental leave

At Atreides, we're passionate about creating a workplace that's inclusive, diverse, and rewarding. If you're a talented Data Engineer looking to make a meaningful impact, we'd love to hear from you.