Current jobs related to Data Engineer - Milton Keynes - Qualient Technology Solutions UK Limited

  • Data Engineer

    1 month ago

    Milton Keynes, United Kingdom TRIA Full time

    Data Engineer Snowflake / Python / DBT £65,000 + 10% Bonus + 10% pension Milton Keynes – 1 day per month This exciting Data Engineering opportunity offers the chance to join a rapidly growing financial services organisation that is undergoing a transformative data journey. As a not-for-profit entity, the focus extends beyond the bottom line,...

  • Data Engineer

    1 month ago

    Milton Keynes, United Kingdom TRIA Full time

    Data EngineerSnowflake / Python / DBT £65,000 + 10% Bonus + 10% pensionMilton Keynes – 1 day per monthThis exciting Data Engineering opportunity offers the chance to join a rapidly growing financial services organisation that is undergoing a transformative data journey. As a not-for-profit entity, the focus extends beyond the bottom line, emphasizing...

  • Data Engineer

    2 months ago

    Milton Keynes, United Kingdom TRIA Full time

    Data EngineerSnowflake / Python / DBT £65,000 + 10% Bonus + 10% pensionMilton Keynes – 1 day per monthThis exciting Data Engineering opportunity offers the chance to join a rapidly growing financial services organisation that is undergoing a transformative data journey. As a not-for-profit entity, the focus extends beyond the bottom line, emphasizing...

  • Data Engineer

    2 months ago

    Milton Keynes, United Kingdom TRIA Full time

    Data EngineerSnowflake / Python / DBT £65,000 + 10% Bonus + 10% pensionMilton Keynes – 1 day per monthThis exciting Data Engineering opportunity offers the chance to join a rapidly growing financial services organisation that is undergoing a transformative data journey. As a not-for-profit entity, the focus extends beyond the bottom line, emphasizing...

  • Data Engineer

    1 month ago

    Milton Keynes, United Kingdom TRIA Full time

    Data Engineer Snowflake / Python / DBT £65,000 + 10% Bonus + 10% pension Milton Keynes – 1 day per month This exciting Data Engineering opportunity offers the chance to join a rapidly growing financial services organisation that is undergoing a transformative data journey. As a not-for-profit entity, the focus extends beyond the bottom line,...

  • Data Engineer

    7 days ago

    Milton Keynes, United Kingdom Colossus Associates Full time

    Data Engineer - East Midlands Looking for an experienced Data Engineer to join a complex manufacturing company in the East Midlands. This is a home-based role that will require very occasional trips to the office for a meeting. Reporting directly to the Head of Business Intelligence you will participate in Participate in the implementation a comprehensive,...

  • Data Engineer

    2 months ago

    Milton Keynes, United Kingdom BJSS Full time

    About Us We’re an award-winning innovative tech consultancy - a team of creative problem solvers. Since 1993 we’ve been finding better, more sustainable ways to solve complex technology problems for some of the world’s leading organisations and delivered solutions that millions of people use every day. In the last 30 years we won several awards,...

  • Data Engineer

    7 months ago

    Milton Keynes, United Kingdom BJSS Full time

    About UsWe’re an award-winning innovative tech consultancy - a team of creative problem solvers. Since 1993 we’ve been finding better, more sustainable ways to solve complex technology problems for some of the world’s leading organisations and delivered solutions that millions of people use every day.In the last 30 years we won several awards,...

  • Data Engineer

    7 months ago

    Milton Keynes, United Kingdom BJSS Full time

    About UsWe’re an award-winning innovative tech consultancy - a team of creative problem solvers. Since 1993 we’ve been finding better, more sustainable ways to solve complex technology problems for some of the world’s leading organisations and delivered solutions that millions of people use every day.In the last 30 years we won several awards,...

  • Data Engineer

    7 months ago

    Milton Keynes, United Kingdom BJSS Full time

    About Us We’re an award-winning innovative tech consultancy - a team of creative problem solvers. Since 1993 we’ve been finding better, more sustainable ways to solve complex technology problems for some of the world’s leading organisations and delivered solutions that millions of people use every day. In the last 30 years we won several awards,...

  • Data Engineer

    7 months ago

    Milton Keynes, United Kingdom BJSS Full time

    About UsWe’re an award-winning innovative tech consultancy - a team of creative problem solvers. Since 1993 we’ve been finding better, more sustainable ways to solve complex technology problems for some of the world’s leading organisations and delivered solutions that millions of people use every day.In the last 30 years we won several awards,...

  • Senior Engineer, Data Engineering

    1 month ago

    Milton Keynes, United Kingdom TRIA Full time

    Data Engineer Snowflake / Python / DBT £65,000 + 10% Bonus + 10% pension This exciting Data Engineering opportunity offers the chance to join a rapidly growing financial services organisation that is undergoing a transformative data journey. With a commitment to becoming a data-centric organization, they are making significant investments in their data...

  • Data Engineer

    3 weeks ago

    Milton Keynes, United Kingdom Construkt RS Remote Work Freelance Full time

    Data Engineer / Cabling Engineer - Monday 6th January - 2 weeks - Night work - £33PH based on 8 hour working night - Milton Keynes ****Location: - Milton Keynes (MK9)Duration: - 2 weeks - NIGHT WORKStart Date: Monday 6th January 2025Night Rate: £33PH - based on 8 hour working night - there could be longer nights involved so flexibility is requiredCerts -...

  • Data Engineer

    3 weeks ago

    Milton Keynes, United Kingdom CV-Library Full time

    Data Engineer / Cabling Engineer - Monday 6th January - 2 weeks - Night work - £33PH based on 8 hour working night - Milton Keynes **** Location: - Milton Keynes (MK9) Duration: - 2 weeks - NIGHT WORK Start Date: Monday 6th January 2025 Night Rate: £33PH - based on 8 hour working night - there could be longer nights involved so flexibility is...

  • Data Engineer

    5 days ago

    Milton Keynes, United Kingdom BJSS Full time

    **About Us** We’re an award-winning innovative tech consultancy - a team of creative problem solvers. Since 1993 we’ve been finding better, more sustainable ways to solve complex technology problems for some of the world’s leading organisations and delivered solutionsthat millions of people use every day. In the last 30 years we won several awards,...

  • Data Engineering Expert

    2 weeks ago

    Milton Keynes, Milton Keynes, United Kingdom BJSS Full time

    Company OverviewBjss is an award-winning tech consultancy that has been finding better ways to solve complex technology problems for over 30 years. Our team of creative problem solvers operates from 26 locations across the world and brings together experts with diverse backgrounds and experiences. We are advocates for data operations and use software...

  • Data Engineer Lead

    2 weeks ago

    Milton Keynes, United Kingdom Tech Mahindra Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer Lead to join our team at Tech Mahindra. In this role, you will play a crucial part in designing, developing, and maintaining our data infrastructure.As a Data Engineer Lead, your key responsibilities will include:Data Integration: Develop and maintain data pipelines to extract, transform, and load...

  • Cloud Data Engineer

    2 weeks ago

    Milton Keynes, Milton Keynes, United Kingdom BJSS Full time

    Data Engineering RoleWe're an award-winning tech consultancy with a passion for innovative solutions. As a Data Engineer, you'll be part of a team that delivers scalable data applications and systems to leading organisations worldwide.This role combines software engineering best practices with expertise in building data solutions. You'll work in a...

  • Data Engineer

    1 day ago

    Milton Keynes, United Kingdom Lorien Full time

    **Data Engineer - CONTRACT** **Role purpose** - Supports the purpose and objectives set out within the framework and operating model of assuring digitally - using Tools (technology) and Data. Acting within common purpose as a core component of the Banks independent first line of defence, mitigating riskand improving customer outcomes and experience as well...

  • Data Engineering Specialist

    3 weeks ago

    Milton Keynes, Milton Keynes, United Kingdom TRIA Full time

    TRIA - A Leader in Data-Driven InnovationJoin our data team and be part of a pioneering financial services organisation that is pushing the boundaries of data-driven innovation. With a strong focus on becoming a data-centric organisation, we are making significant investments in our data infrastructure and capabilities.As a Data Engineering Specialist,...

Data Engineer

1 month ago

Milton Keynes, United Kingdom Qualient Technology Solutions UK Limited Full time

Job Title: Data Engineer (Iceberg Experience) – 8+ Years of overall Experience.


Job Description:

As a Data Engineer with Iceberg experience, you will play a crucial role in the design, development, and maintenance of our data infrastructure. Your work will empower data-driven decision-making and contribute to the success of our data-driven initiatives.


Key Responsibilities:

  • Data Integration: Develop and maintain data pipelines to extract, transform, and load (ETL) data from various sources into AWS data stores for both batch and streaming data ingestion.
  • AWS Expertise: Utilize your expertise in AWS services such as Amazon EMR , S3, AWS Glue, Amazon Redshift, AWS Lambda, and more to build and optimize data solutions.
  • Data Modeling: Design and implement data models to support analytical and reporting needs, ensuring data accuracy and performance.
  • Data Quality: Implement data quality and data governance best practices to maintain data integrity.
  • Performance Optimization: Identify and resolve performance bottlenecks in data pipelines and storage solutions to ensure optimal performance.
  • Documentation: Create and maintain comprehensive documentation for data pipelines, architecture, and best practices.
  • Collaboration: Collaborate with cross-functional teams, including data scientists and analysts, to understand data requirements and deliver high-quality data solutions.
  • Automation: Implement automation processes and best practices to streamline data workflows and reduce manual interventions.
  • Experience working with bigdata ACID file formats to build delta lake, particularly with Iceberg file formats and loading methods of Iceberg.
  • Good knowledge on Iceberg functionalities to use the delta features to identify the changed records, optimization and housekeeping on Iceberg tables in the data lake.


Must have: AWS, ETL, EMR, GLUE, Spark/Scala, Java, Python,


Good to have: Cloudera – Spark, Hive, Impala, HDFS , Informatica PowerCenter, Informatica DQ/DG, Snowflake Erwin


Qualifications:

  • Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.
  • 5 to 8 years of experience in data engineering, including working with AWS services.
  • Proficiency in AWS services like S3, Glue, Redshift, Lambda, and EMR.
  • Knowledge on Cloudera based hadoop is a plus.
  • Strong ETL development skills and experience with data integration tools.
  • Knowledge of data modeling, data warehousing, and data transformation techniques.
  • Familiarity with data quality and data governance principles.
  • Strong problem-solving and troubleshooting skills.
  • Excellent communication and teamwork skills, with the ability to collaborate with technical and non-technical stakeholders.
  • Knowledge of best practices in data engineering, scalability, and performance optimization.

Experience with version control systems and DevOps practices is a plus.