Senior Engineer, Data Engineering

4 weeks ago

Milton Keynes Buckinghamshire, United Kingdom Qualient Technology Solutions UK Limited Full time

Job Title: Data Engineer (Iceberg Experience) – 8+ Years of overall Experience.
As a Data Engineer with Iceberg experience, you will play a crucial role in the design, development, and maintenance of our data infrastructure. Your work will empower data-driven decision-making and contribute to the success of our data-driven initiatives.

Data Integration: Develop and maintain data pipelines to extract, transform, and load (ETL) data from various sources into AWS data stores for both batch and streaming data ingestion.
AWS Expertise: Utilize your expertise in AWS services such as Amazon EMR , S3, AWS Glue, Amazon Redshift, AWS Lambda, and more to build and optimize data solutions.
Data Modeling: Design and implement data models to support analytical and reporting needs, ensuring data accuracy and performance.
Data Quality: Implement data quality and data governance best practices to maintain data integrity.
Performance Optimization: Identify and resolve performance bottlenecks in data pipelines and storage solutions to ensure optimal performance.
Create and maintain comprehensive documentation for data pipelines, architecture, and best practices.
Collaboration: Collaborate with cross-functional teams, including data scientists and analysts, to understand data requirements and deliver high-quality data solutions.
Implement automation processes and best practices to streamline data workflows and reduce manual interventions.
Experience working with bigdata ACID file formats to build delta lake, particularly with Iceberg file formats and loading methods of Iceberg.
Good knowledge on Iceberg functionalities to use the delta features to identify the changed records, optimization and housekeeping on Iceberg tables in the data lake.

AWS, ETL, EMR, GLUE, Spark/Scala, Java, Python,

Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.
~5 to 8 years of experience in data engineering, including working with AWS services.
~ Proficiency in AWS services like S3, Glue, Redshift, Lambda, and EMR.
~ Strong ETL development skills and experience with data integration tools.
~ Knowledge of data modeling, data warehousing, and data transformation techniques.
~ Familiarity with data quality and data governance principles.
~ Knowledge of best practices in data engineering, scalability, and performance optimization.

Experience with version control systems and DevOps practices is a plus.

  • Senior Engineer, Data Engineering

    1 month ago

    Milton Keynes, Buckinghamshire, United Kingdom TRIA Full time

    Data Engineer Snowflake / Python / DBT £65,000 + 10% Bonus + 10% pension This exciting Data Engineering opportunity offers the chance to join a rapidly growing financial services organisation that is undergoing a transformative data journey. With a commitment to becoming a data-centric organization, they are making significant investments in their data...

  • Senior Engineer, Data Engineering

    4 weeks ago

    Milton Keynes, Buckinghamshire, United Kingdom TRIA Full time

    Data Engineer Snowflake / Python / DBT £65,000 + 10% Bonus + 10% pension This exciting Data Engineering opportunity offers the chance to join a rapidly growing financial services organisation that is undergoing a transformative data journey. With a commitment to becoming a data-centric organization, they are making significant investments in their data...

  • Data Engineer

    1 month ago

    Milton Keynes, Buckinghamshire, United Kingdom TRIA Full time

    Data Engineer Snowflake / Python / DBT £65,000 + 10% Bonus + 10% pension Milton Keynes – 1 day per month This exciting Data Engineering opportunity offers the chance to join a rapidly growing financial services organisation that is undergoing a transformative data journey. As a not-for-profit entity, the focus extends beyond the bottom line,...

  • Data Engineer

    4 weeks ago

    Milton Keynes, Buckinghamshire, United Kingdom TRIA Full time

    Data Engineer Snowflake / Python / DBT £65,000 + 10% Bonus + 10% pension Milton Keynes – 1 day per month This exciting Data Engineering opportunity offers the chance to join a rapidly growing financial services organisation that is undergoing a transformative data journey. As a not-for-profit entity, the focus extends beyond the bottom line,...

  • Senior Engineer, Data Engineering

    7 months ago

    Milton Keynes, Buckinghamshire, United Kingdom BJSS Full time

    We’re an award-winning innovative tech consultancy - a team of creative problem solvers. Since 1993 we’ve been finding better, more sustainable ways to solve complex technology problems for some of the world’s leading organisations and delivered solutions that millions of people use every day. In the last 30 years we won several awards, including a...

  • Senior Engineer, Data Engineering

    4 weeks ago

    Milton Keynes, United Kingdom TRIA Full time

    Data Engineer Snowflake / Python / DBT £65,000 + 10% Bonus + 10% pension This exciting Data Engineering opportunity offers the chance to join a rapidly growing financial services organisation that is undergoing a transformative data journey. With a commitment to becoming a data-centric organization, they are making significant investments in their data...

  • Senior Engineer, Data Engineering

    2 months ago

    Milton Keynes, United Kingdom TRIA Full time

    Lead Data Engineer SQL / SSIS / Data Flows Up to £70,000 + 10% Bonus + 10% Pension Milton Keynes – One/Two days per month onsite This Senior Data Engineering opportunity is to join a rapidly growing financial services organisation, who are going through a data transformation journey. This organisation is investing heavily in Data and taking it very...

  • Senior Data Engineering Manager

    1 month ago

    Milton Keynes, United Kingdom CV-Library Full time

    Senior Data Engineering Manager Snowflake | AWS/Azure | Data transformation Up to £110,000 + 20% Bonus + 10% Pension Milton Keynes - Two/Three days a month on site. This Senior Data Engineering opportunity is to join a rapidly growing financial services organisation, who are going through a large Data Transformation. Your role will report into the...

  • Data Engineer

    4 weeks ago

    Milton Keynes, Buckinghamshire, United Kingdom Qualient Technology Solutions UK Limited Full time

    Job Title: Data Engineer (Iceberg Experience) – 8+ Years of overall Experience. Job Description: As a Data Engineer with Iceberg experience, you will play a crucial role in the design, development, and maintenance of our data infrastructure. Your work will empower data-driven decision-making and contribute to the success of our data-driven initiatives. ...

  • Data Engineer

    4 weeks ago

    Milton Keynes, Buckinghamshire, United Kingdom Qualient Technology Solutions UK Limited Full time

    Job Title: Data Engineer (Iceberg Experience) – 8+ Years of overall Experience. Job Description: As a Data Engineer with Iceberg experience, you will play a crucial role in the design, development, and maintenance of our data infrastructure. Your work will empower data-driven decision-making and contribute to the success of our data-driven initiatives. ...

  • Data Engineer

    7 months ago

    Milton Keynes, Buckinghamshire, United Kingdom BJSS Full time

    About Us We’re an award-winning innovative tech consultancy - a team of creative problem solvers. Since 1993 we’ve been finding better, more sustainable ways to solve complex technology problems for some of the world’s leading organisations and delivered solutions that millions of people use every day. In the last 30 years we won several awards,...

  • Data Engineer

    7 months ago

    Milton Keynes, Buckinghamshire, United Kingdom BJSS Full time

    About Us We’re an award-winning innovative tech consultancy - a team of creative problem solvers. Since 1993 we’ve been finding better, more sustainable ways to solve complex technology problems for some of the world’s leading organisations and delivered solutions that millions of people use every day. In the last 30 years we won several awards,...

  • Senior Engineer, Data Engineering

    4 weeks ago

    Milton Keynes, United Kingdom Qualient Technology Solutions UK Limited Full time

    Job Title: Data Engineer (Iceberg Experience) – 8+ Years of overall Experience. As a Data Engineer with Iceberg experience, you will play a crucial role in the design, development, and maintenance of our data infrastructure. Your work will empower data-driven decision-making and contribute to the success of our data-driven initiatives. Data Integration:...

  • Data Engineer

    4 weeks ago

    Milton Keynes, United Kingdom TRIA Full time

    Data EngineerSnowflake / Python / DBT £65,000 + 10% Bonus + 10% pensionMilton Keynes – 1 day per monthThis exciting Data Engineering opportunity offers the chance to join a rapidly growing financial services organisation that is undergoing a transformative data journey. As a not-for-profit entity, the focus extends beyond the bottom line, emphasizing...

  • Data Engineer

    1 month ago

    Milton Keynes, United Kingdom TRIA Full time

    Data EngineerSnowflake / Python / DBT £65,000 + 10% Bonus + 10% pensionMilton Keynes – 1 day per monthThis exciting Data Engineering opportunity offers the chance to join a rapidly growing financial services organisation that is undergoing a transformative data journey. As a not-for-profit entity, the focus extends beyond the bottom line, emphasizing...

  • Data Engineer

    1 month ago

    Milton Keynes, United Kingdom TRIA Full time

    Data Engineer Snowflake / Python / DBT £65,000 + 10% Bonus + 10% pension Milton Keynes – 1 day per month This exciting Data Engineering opportunity offers the chance to join a rapidly growing financial services organisation that is undergoing a transformative data journey. As a not-for-profit entity, the focus extends beyond the bottom line,...

  • Data Engineer

    1 month ago

    Milton Keynes, United Kingdom TRIA Full time

    Data EngineerSnowflake / Python / DBT £65,000 + 10% Bonus + 10% pensionMilton Keynes – 1 day per monthThis exciting Data Engineering opportunity offers the chance to join a rapidly growing financial services organisation that is undergoing a transformative data journey. As a not-for-profit entity, the focus extends beyond the bottom line, emphasizing...

  • Data Engineer

    4 weeks ago

    Milton Keynes, United Kingdom TRIA Full time

    Data Engineer Snowflake / Python / DBT £65,000 + 10% Bonus + 10% pension Milton Keynes – 1 day per month This exciting Data Engineering opportunity offers the chance to join a rapidly growing financial services organisation that is undergoing a transformative data journey. As a not-for-profit entity, the focus extends beyond the bottom line,...

  • Senior Data Engineering Professional

    4 weeks ago

    Milton Keynes, Milton Keynes, United Kingdom BJSS Full time

    About the RoleThis senior data engineering position requires expertise in software engineering best practices, data solution expertise, and cloud services like Databricks and Synapse. As a key member of our team, you'll design and implement data storage and processing systems, deploying components in a workflow and writing complex queries against relational...

  • Data Engineer

    2 months ago

    Milton Keynes, United Kingdom TRIA Full time

    Lead Data Engineer SQL / SSIS / Data Flows Up to £70,000 + 10% Bonus + 10% Pension Milton Keynes – One/Two days per month onsite This Senior Data Engineering opportunity is to join a rapidly growing financial services organisation, who are going through a data transformation journey. This organisation is investing heavily in Data and taking it...