Data Engineer

3 weeks ago

London, United Kingdom Hydrogen Group Full time

I am seeking a Data Engineer focused on infrastructure tasks, with a contract running until the end of March and a POC completion deadline by the end of January. This role is INSIDE IR35 and would be hybrid 1-2 times a week on-site in London OR Birmingham.

The role involves working within an AWS environment, using the BBT framework, configuring and integrating with GitHub, and setting up a CI/CD pipeline. Responsibilities include performing basic plumbing and DevOps tasks, ensuring the environment is prepared for development, and collaborating on the same project as the analytics/modelling team. Required skills include strong expertise in AWS, experience with the BBT framework, proficiency in GitHub configuration, knowledge of CI/CD pipeline setup, and basic DevOps and infrastructure skills. Both roles require contractors who can start immediately and work until the end of March, with no room for learning on the job. The project involves setting up pipelines, performing data quality checks, and ensuring the environment is ready for development.

Responsibilities

* Collaborate on designing and implementing scalable data solutions using a range of new and emerging technologies from the AWS platform.

* Demonstrate AWS Data expertise when communicating with stakeholders and translating requirements into technical data solutions.

* Manage both real-time and batch data pipelines. Our technology stack includes a wide variety of technologies such as Spark, Kafka, AWS Kinesis, Redshift, and DBT.

* Work independently with minimal supervision in remote team configurations.

* Automate existing manual processes.

Requirements

* Expertise in the main components of continuous data delivery: set up, design, and delivery of data pipelines (testing, deploying, monitoring, and maintaining).

* Expertise in data architecture across Software-as-a-Service, Platforms-a-Service, Infrastructure-as-a-Service, and cloud productivity suites.

* Strong engineering background with experience in Python, SQL, and DBT, or similar frameworks used to ship data processing pipelines at scale.

* Demonstrated experience with and solid knowledge of AWS: AWS Glue, AWS EMR, Amazon S3, Redshift.

* Familiarity with Infrastructure-as-code (IaC) using Terraform or AWS Cloud Formation.

* Demonstrated experience in data migration projects.

* Ability to work with, communicate effectively, and influence stakeholders on internal/external engineering teams, product development teams, sales operations teams, and external partners and consumers.

...

  • Senior Engineer, Data Engineering

    3 months ago

    London, United Kingdom Data Idols Full time €75,000 - €95,000

    Senior Data Engineer Joining one of the best-known retail brands in the UK as a Senior Data Engineer, you will support the delivery of data transformation during an exciting time within the company. They are looking for someone with experience in building and maintaining data pipelines and to collaborate with the wider data teams. For this role as...

  • Senior Engineer, Data Engineering

    2 months ago

    London, United Kingdom Data Idols Full time

    Senior Data Engineer Joining one of the best-known retail brands in the UK as a Senior Data Engineer, you will support the delivery of data transformation during an exciting time within the company. They are looking for someone with experience in building and maintaining data pipelines and to collaborate with the wider data teams. For this role as...

  • Senior Engineer, Data Engineering

    3 months ago

    London, United Kingdom Data Idols Full time €75,000 - €95,000

    Senior Data Engineer Joining one of the best-known retail brands in the UK as a Senior Data Engineer, you will support the delivery of data transformation during an exciting time within the company. They are looking for someone with experience in building and maintaining data pipelines and to collaborate with the wider data teams. For this role as...

  • Lead Engineer/Data Engineer

    3 weeks ago

    London, United Kingdom Data Idols Full time €90,000 - €110,000

    Lead Data Engineer Location: London - Hybrid We are currently looking for a Lead Data Engineer to join our dynamic and forward-thinking team at a prominent British Insurance Company. This role is integral to our operations as it involves both maintenance of existing systems and the development of new projects. As a Lead Data Engineer, you will report...

  • Lead Engineer/Data Engineer

    3 weeks ago

    London, United Kingdom Data Idols Full time €90,000 - €110,000

    Lead Data Engineer Location: London - Hybrid We are currently looking for a Lead Data Engineer to join our dynamic and forward-thinking team at a prominent British Insurance Company. This role is integral to our operations as it involves both maintenance of existing systems and the development of new projects. As a Lead Data Engineer, you will report...

  • Lead Engineer/Data Engineer

    3 weeks ago

    London, United Kingdom Data Idols Full time

    Lead Data Engineer Location: London - Hybrid We are currently looking for a Lead Data Engineer to join our dynamic and forward-thinking team at a prominent British Insurance Company. This role is integral to our operations as it involves both maintenance of existing systems and the development of new projects. As a Lead Data Engineer, you will report...

  • Data Engineering Manager

    1 month ago

    London, Greater London, United Kingdom Data Idols Full time £90,000 - £95,000

    The OpportunityData Idols is seeking a Data Engineering Manager to support the delivery of data transformation during an exciting time within the company. This individual will work with the teams to implement data strategy and deliver value throughout the company.The ideal candidate will have extensive experience in managing teams, stakeholder management,...

  • Data Engineer Leader

    15 hours ago

    London, Greater London, United Kingdom Data Idols Full time £75,000 - £95,000

    **About Data Idols**Data Idols is a renowned retail brand in the UK, seeking an exceptional Senior Data Engineer to drive data transformation. As a Senior Data Engineer at Data Idols, you will play a pivotal role in delivering high-quality data solutions.The ideal candidate will have extensive experience with data pipelines, data warehousing, and cloud-based...

  • Data Engineer

    3 weeks ago

    London, Greater London, United Kingdom Data Privacy Full time

    About UsHouseful is a leading property technology company known for its innovative approach to the property market. With brands like Zoopla, Alto, Hometrack, Calcasa, Mojo, and Prime location, we leverage software, data, and insights to drive progress in the industry.Company OverviewWe're committed to helping everyone make informed decisions about their...

  • Data Engineering Manager

    3 weeks ago

    London, Greater London, United Kingdom Data Idols Full time

    Job OverviewData Idols is seeking an experienced Data Engineering Manager to support the delivery of data transformation during an exciting time within the company.You will work with the teams to implement data strategy and deliver value throughout the company, leveraging your technical expertise and stakeholder management skills.

  • Cloud Data Engineering Manager

    2 weeks ago

    London, Greater London, United Kingdom Data Idols Full time £80,000 - £90,000

    Data Engineering OpportunityData Idols is seeking a skilled Senior Data Platform Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, implementing, and maintaining a robust data platform using Azure Services.This is an exciting opportunity to work with cutting-edge cloud-based technologies and collaborate...

  • Chief Data Engineering Lead

    4 weeks ago

    London, Greater London, United Kingdom Data Idols Full time

    Data Idols is looking for a Chief Data Engineering Lead to support the delivery of data transformation.As a key member of the team, you will collaborate with the wider data teams and drive high standards across the data function. The role involves building pipelines to deliver insights enabling the company to be more data driven in their decision making.Key...

  • Senior Data Engineer Lead

    3 weeks ago

    London, Greater London, United Kingdom Data Idols Full time

    The OpportunityWe are looking for a skilled Data Engineering Manager who has extensive experience in managing teams, implementing data strategy, and working with Azure. As a hands-off role, you will have the autonomy to lead the team and drive results.Your key responsibilities include:Implementing data strategy to drive business valueManaging and mentoring...

  • Data Engineer for Digital Transformation

    3 weeks ago

    London, Greater London, United Kingdom Data Idols Full time

    Senior Data Platform EngineerWe are seeking a highly skilled Data Engineer to join our team at Data Idols. As a key member of our data platforms group, you will play a vital role in shaping the data landscape and contribute to data-driven decision-making.The OpportunityIn this exciting role, you will be responsible for designing, implementing, and...

  • DV Cleared Azure Data Engineer

    4 weeks ago

    London, United Kingdom Data Careers Full time

    Data EngineerInside IR35 ContractUp to £750 per dayDV Clearance ESSENTIALLondon We are seeking a highly skilled Data Engineer to join a prestigious defence organisation in London.This is an exciting opportunity to lead and mentor a junior Data Engineer while contributing to the development of critical data pipelines and products. Key...

  • Data Engineer Leader

    2 weeks ago

    London, Greater London, United Kingdom Data Idols Full time £80,000 - £90,000

    Job OverviewData Idols is a pioneering retailer transforming into a data-driven organisation. As a Senior Data Platform Engineer, you will shape the data landscape by designing, implementing, and maintaining a robust data platform using Azure Services.We offer a competitive salary of £80,000 - £90,000 + bonus, along with 20% discount across all products,...

  • Data Engineering Manager

    3 weeks ago

    London, Greater London, United Kingdom Data Science Festival Full time

    Data Engineering Manager Role OverviewAt the forefront of our company's innovative landscape, we seek a seasoned Data Engineering Manager to spearhead data transformation initiatives. With an exciting tenure at one of the UK's most renowned retail brands, this pivotal role requires expertise in implementing data strategy and delivering value across the...

  • Senior Data Scientist, Data Engineering Expert

    1 month ago

    London, Greater London, United Kingdom Data Science Festival Full time

    Senior Data EngineerAs a Senior Data Engineer at Data Science Festival, you will play a key role in shaping the company's data transformation strategy. Your expertise in building and maintaining data pipelines will be invaluable in driving high standards across the data function. You will build reliable and high-quality data solutions, supporting the team in...

  • DV cleared Azure Data Engineer

    4 weeks ago

    London, United Kingdom Data Careers Full time

    Data EngineerPermanent RoleUp to £95,000 per annumDV Clearance ESSENTIALLondonOur client, a leading professional services firm, is seeking a highly skilled Data Engineer to join their Defence and Security practice. This is a fantastic opportunity to work on cutting-edge projects, collaborate with top-tier talent, and make a significant impact on national...

  • Senior Data Engineer

    7 days ago

    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Job Title: Senior Data Engineer Location: London - Hybrid - 1 day a week in the officeContract Type: 6 Month contract with possible extension The Company:This company is an incredible commercial broadcaster with a diverse range of content. At the heart of their operations is a commitment to using cutting-edge technology to transform how they engage with...