Data Engineer Lead

2 weeks ago


Milton Keynes, United Kingdom Tech Mahindra Full time
Job Description

We are seeking a highly skilled Data Engineer Lead to join our team at Tech Mahindra. In this role, you will play a crucial part in designing, developing, and maintaining our data infrastructure.

As a Data Engineer Lead, your key responsibilities will include:

  • Data Integration: Develop and maintain data pipelines to extract, transform, and load (ETL) data from various sources into AWS data stores for both batch and streaming data ingestion.
  • AWS Expertise: Utilize your expertise in AWS services such as Amazon EMR, S3, AWS Glue, Amazon Redshift, AWS Lambda, and more to build and optimize data solutions.
  • Data Modeling: Design and implement data models to support analytical and reporting needs, ensuring data accuracy and performance.
  • Data Quality: Implement data quality and data governance best practices to maintain data integrity.
  • Performance Optimization: Identify and resolve performance bottlenecks in data pipelines and storage solutions to ensure optimal performance.
  • Documentation: Create and maintain comprehensive documentation for data pipelines, architecture, and best practices.
  • Collaboration: Collaborate with cross-functional teams, including data scientists and analysts, to understand data requirements and deliver high-quality data solutions.
  • Automation: Implement automation processes and best practices to streamline data workflows and reduce manual interventions.

The ideal candidate should have:

  • A Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.
  • 5 to 8 years of experience in data engineering, including working with AWS services.
  • Proficiency in AWS services like S3, Glue, Redshift, Lambda, and EMR.
  • Knowledge on Cloudera-based Hadoop is a plus.
  • Strong ETL development skills and experience with data integration tools.
  • Knowledge of data modeling, data warehousing, and data transformation techniques.
  • Familiarity with data quality and data governance principles.
  • Strong problem-solving and troubleshooting skills.
  • Excellent communication and teamwork skills, with the ability to collaborate with technical and non-technical stakeholders.
  • Knowledge of best practices in data engineering, scalability, and performance optimization.
  • Experience with version control systems and DevOps practices is a plus.

Estimated salary: $120,000 - $180,000 per year.


  • Data Engineering Lead

    2 weeks ago


    Milton Keynes, Milton Keynes, United Kingdom BJSS Full time

    Job OverviewWe are a leading tech consultancy, renowned for our innovative approach to solving complex technology problems. Our team of expert problem solvers delivers cutting-edge solutions used by millions worldwide.Our commitment to world-class delivery and collaborative culture has earned us several prestigious awards, including a Queen's Award for...


  • Milton Keynes, Milton Keynes, United Kingdom ZipRecruiter Full time

    Job Description:Senior Azure Data Engineer - Remote - £60,000 (Salary: £60,000)Data Pipelines and Development: Design, develop, and maintain data pipelines for ingestion and transformation of data between different sources.Data Models: Create and develop data models for insightful and accurate data visuals/reports/dashboards.Collaboration: Work closely...

  • Data Engineer

    5 days ago


    Milton Keynes, United Kingdom Colossus Associates Full time

    Data Engineer - East Midlands Looking for an experienced Data Engineer to join a complex manufacturing company in the East Midlands. This is a home-based role that will require very occasional trips to the office for a meeting. Reporting directly to the Head of Business Intelligence you will participate in Participate in the implementation a comprehensive,...

  • Data Engineer

    7 months ago


    Milton Keynes, United Kingdom BJSS Full time

    About UsWe’re an award-winning innovative tech consultancy - a team of creative problem solvers. Since 1993 we’ve been finding better, more sustainable ways to solve complex technology problems for some of the world’s leading organisations and delivered solutions that millions of people use every day.In the last 30 years we won several awards,...

  • Data Engineer

    7 months ago


    Milton Keynes, United Kingdom BJSS Full time

    About UsWe’re an award-winning innovative tech consultancy - a team of creative problem solvers. Since 1993 we’ve been finding better, more sustainable ways to solve complex technology problems for some of the world’s leading organisations and delivered solutions that millions of people use every day.In the last 30 years we won several awards,...

  • Data Engineer

    7 months ago


    Milton Keynes, United Kingdom BJSS Full time

    About Us We’re an award-winning innovative tech consultancy - a team of creative problem solvers. Since 1993 we’ve been finding better, more sustainable ways to solve complex technology problems for some of the world’s leading organisations and delivered solutions that millions of people use every day. In the last 30 years we won several awards,...

  • Data Engineer

    7 months ago


    Milton Keynes, United Kingdom BJSS Full time

    About UsWe’re an award-winning innovative tech consultancy - a team of creative problem solvers. Since 1993 we’ve been finding better, more sustainable ways to solve complex technology problems for some of the world’s leading organisations and delivered solutions that millions of people use every day.In the last 30 years we won several awards,...

  • Data Engineer

    2 months ago


    Milton Keynes, United Kingdom BJSS Full time

    About Us We’re an award-winning innovative tech consultancy - a team of creative problem solvers. Since 1993 we’ve been finding better, more sustainable ways to solve complex technology problems for some of the world’s leading organisations and delivered solutions that millions of people use every day. In the last 30 years we won several awards,...

  • Lead Data Scientist

    4 weeks ago


    Milton Keynes, United Kingdom La Fosse Associates Full time

    Lead Data ScientistLocation: Milton KeynesSalary: Up to £80,000 paWork Type: Full Time - Hybrid (3 days in office)La Fosse is proud to partner with a rapidly growing international company operating in the retail and service sectors. The organisation is undergoing a digital transformation and is seeking a Lead Data Scientist to drive innovation and unlock...

  • Data Analytics Lead

    2 days ago


    Milton Keynes, Milton Keynes, United Kingdom Volkswagen Financial Services Full time

    Job DescriptionWe are seeking an experienced professional to lead the development and implementation of data analytics solutions within our organization. As a Data Analytics Lead, you will be responsible for driving business growth through data-driven insights and strategic decision-making.About the RoleEstimated Salary: £63,750 - £80,000 per...

  • Data Engineer

    2 weeks ago


    Milton Keynes, United Kingdom Construkt RS Remote Work Freelance Full time

    Data Engineer / Cabling Engineer - Monday 6th January - 2 weeks - Night work - £33PH based on 8 hour working night - Milton Keynes ****Location: - Milton Keynes (MK9)Duration: - 2 weeks - NIGHT WORKStart Date: Monday 6th January 2025Night Rate: £33PH - based on 8 hour working night - there could be longer nights involved so flexibility is requiredCerts -...

  • Data Engineer

    3 weeks ago


    Milton Keynes, United Kingdom CV-Library Full time

    Data Engineer / Cabling Engineer - Monday 6th January - 2 weeks - Night work - £33PH based on 8 hour working night - Milton Keynes **** Location: - Milton Keynes (MK9) Duration: - 2 weeks - NIGHT WORK Start Date: Monday 6th January 2025 Night Rate: £33PH - based on 8 hour working night - there could be longer nights involved so flexibility is...

  • Data Engineer

    3 days ago


    Milton Keynes, United Kingdom BJSS Full time

    **About Us** We’re an award-winning innovative tech consultancy - a team of creative problem solvers. Since 1993 we’ve been finding better, more sustainable ways to solve complex technology problems for some of the world’s leading organisations and delivered solutionsthat millions of people use every day. In the last 30 years we won several awards,...

  • Lead Data Scientist

    1 month ago


    Milton Keynes, United Kingdom La Fosse Full time

    Job Description Lead Data Scientist Location: Milton Keynes Salary: Up to £80,000 pa Work Type: Full Time - Hybrid (3 days in office) La Fosse is proud to partner with a rapidly growing international company operating in the retail and service sectors. The organisation is undergoing a digital transformation and is seeking a Lead Data Scientist to...

  • Lead Data Scientist

    1 month ago


    Milton Keynes, United Kingdom La Fosse Full time

    Lead Data ScientistLocation: Milton Keynes Salary: Up to £80,000 paWork Type: Full Time - Hybrid (3 days in office)La Fosse is proud to partner with a rapidly growing international company operating in the retail and service sectors. The organisation is undergoing a digital transformation and is seeking a Lead Data Scientist to drive innovation and unlock...


  • Milton Keynes, Milton Keynes, United Kingdom BJSS Full time

    **Job Title:** Senior Engineer, Data EngineeringWe're an award-winning tech consultancy that solves complex technology problems for leading organisations and delivers solutions used by millions every day.Our innovative approach has earned us a prestigious Queen's Award for Enterprise in Innovation. We operate from multiple locations worldwide, bringing...

  • Cloud Data Engineer

    1 week ago


    Milton Keynes, Milton Keynes, United Kingdom BJSS Full time

    Data Engineering RoleWe're an award-winning tech consultancy with a passion for innovative solutions. As a Data Engineer, you'll be part of a team that delivers scalable data applications and systems to leading organisations worldwide.This role combines software engineering best practices with expertise in building data solutions. You'll work in a...

  • Senior Technical Lead

    1 month ago


    Milton Keynes, Milton Keynes, United Kingdom TRIA Full time

    About TRIAWe are a rapidly growing financial services organisation undergoing a transformative data journey. Our commitment to becoming a data-centric organisation drives significant investments in our data infrastructure and capabilities. As a result, we are seeking an experienced Data Engineer to join our collaborative team.


  • Milton Keynes, United Kingdom CV-Library Full time

    Senior Data Engineering Manager Snowflake | AWS/Azure | Data transformation Up to £110,000 + 20% Bonus + 10% Pension Milton Keynes - Two/Three days a month on site. This Senior Data Engineering opportunity is to join a rapidly growing financial services organisation, who are going through a large Data Transformation. Your role will report into the...


  • Milton Keynes, Milton Keynes, United Kingdom La Fosse Full time £70,000 - £80,000

    **Lead Data Scientist Wanted for Retail Company**La Fosse is delighted to partner with a leading retail company to hire a Senior Data Analyst Lead. The company aims to drive business growth through advanced data analytics and model-based solutions. As a key member of the team, you will collaborate with stakeholders, create data-driven solutions, and work...