Principal Data Engineer

1 month ago

London, Greater London, United Kingdom Epam Full time

About the Role

We are seeking a highly skilled Principal Data Engineer to join our multi-disciplinary team of engineers, architects, designers, and strategists in London. As a Principal Data Engineer, you will be responsible for leading and mentoring a team of Azure data engineers, driving technical execution, and collaborating with cross-functional teams to ensure a quality single version of truth.

Responsibilities

  • Lead, mentor, and manage a team of Azure data engineers
  • Drive the team's technical execution
  • Collaborate with data scientists, analysts, and business stakeholders to ensure a quality single version of truth
  • Design, develop, and implement scalable and secure data lake solutions on Azure
  • Ensure best practices in data engineering, data integration, and ETL processes
  • Monitor performance and scalability of the SVOT platform and update the framework and code to ensure high availability and accessibility

Requirements

  • Minimum of 8 years of experience in data engineering
  • At least 5 years of hands-on experience with Azure data services, including Apache Spark, Azure Data Factory, Synapse Analytics, and RDBMS experience (prefer SQL Server)
  • Proven experience in leading and managing a team of data engineers
  • Proficiency in programming languages, including PySpark, Python, Continuous Integration, and version control (e.g., Git)
  • Strong understanding of data modeling, ETL processes, and data warehousing concepts
  • Knowledge of CI/CD pipelines and version control
  • Excellent problem-solving and analytical skills
  • Strong communication and collaboration abilities
  • Ability to manage multiple projects and meet deadlines
  • Certifications in Azure (e.g., Microsoft Certified: Azure Data Engineer Associate, Azure Solutions Architect)

Nice to Have

  • Hands-on experience with Scala for Apache Spark
  • Knowledge or experience working with other Clouds, such as AWS or GCP

About EPAM

EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, employees, and communities. We embrace a dynamic and inclusive culture, where you will collaborate with multi-national teams, contribute to innovative projects, and have opportunities to learn and grow.

  • Principal Data Scientist at Marshmallow

    2 weeks ago

    London, Greater London, United Kingdom Data Privacy Full time

    About the RoleWe are seeking a highly skilled Principal Data Scientist to join our Data Science Team at Marshmallow. As a key member of our team, you will be responsible for leading and delivering on a data science roadmap in claims, aligned with product and engineering.You will identify, scope, and push currently-unmapped modelling solutions in claims,...

  • Data Engineering Principal

    1 month ago

    London, Greater London, United Kingdom Metyis AG Full time

    Data Engineering PrincipalWe are seeking a highly experienced Data Engineering Principal to join our Data Engineering Team at Metyis AG in London. As a key member of our team, you will lead the design and execution of data engineering projects, driving the development of operational data platforms and ensuring data quality and governance.Key...

  • Data Engineering Principal

    1 month ago

    London, Greater London, United Kingdom Metyis AG Full time

    Data Engineering PrincipalWe are seeking a highly experienced Data Engineering Principal to join our Data Engineering Team at Metyis AG in London. As a key member of our team, you will lead the design and execution of data engineering projects, driving the development of operational data platforms and ensuring data quality and governance.Key...

  • Data Engineering Principal

    3 weeks ago

    London, Greater London, United Kingdom Metyis Full time

    About the RoleMetyis is seeking a highly skilled Data Engineering Principal to join our team. As a key member of our organization, you will be responsible for leading the design and execution of data engineering projects, supporting clients in executing their data strategies, and engineering complete technical solutions to solve concrete business...

  • Data Engineering Principal

    3 weeks ago

    London, Greater London, United Kingdom Metyis Full time

    About the RoleMetyis is seeking a highly skilled Data Engineering Principal to join our team. As a key member of our organization, you will be responsible for leading the design and execution of data engineering projects, supporting clients in executing their data strategies, and engineering complete technical solutions to solve concrete business...

  • Data Engineering Principal

    1 week ago

    London, Greater London, United Kingdom Metyis Full time

    About the RoleWe are seeking a highly skilled Data Engineering Principal to join our team at Metyis. As a key member of our data engineering team, you will be responsible for designing and executing data engineering projects, supporting clients in executing their data strategies, and engineering complete technical solutions to solve concrete business...

  • Data Engineering Principal

    5 days ago

    London, Greater London, United Kingdom Metyis Full time

    About the RoleMetyis is seeking a highly skilled Data Engineering Principal to lead our data engineering projects and support our clients in executing their data strategies.Key ResponsibilitiesIndependently lead and manage the design and execution of data engineering projects.Support our clients in designing and building operational data platforms, including...

  • Data Engineering Principal

    1 month ago

    London, Greater London, United Kingdom Metyis Full time

    About the RoleMetyis is seeking a highly skilled Data Engineering Principal to join our team. As a key member of our organization, you will be responsible for leading the design and execution of data engineering projects, supporting clients in executing their data strategies, and engineering complete technical solutions to solve concrete business...

  • Data Engineering Principal

    1 month ago

    London, Greater London, United Kingdom Metyis Full time

    About the RoleMetyis is seeking a highly skilled Data Engineering Principal to join our team. As a key member of our organization, you will be responsible for leading the design and execution of data engineering projects, supporting clients in executing their data strategies, and engineering complete technical solutions to solve concrete business...

  • Data Engineering Principal

    1 month ago

    London, Greater London, United Kingdom Metyis Full time

    About the RoleMetyis is seeking a highly skilled Data Engineering Principal to join our team. As a key member of our organization, you will be responsible for leading the design and execution of data engineering projects, supporting clients in executing their data strategies, and engineering complete technical solutions to solve concrete business...

  • Data Engineering Principal

    4 weeks ago

    London, Greater London, United Kingdom Metyis Full time

    About the RoleMetyis is seeking a highly skilled Data Engineering Principal to join our team. As a key member of our organization, you will be responsible for leading the design and execution of data engineering projects, supporting clients in executing their data strategies, and engineering complete technical solutions to solve concrete business...

  • Data Engineering Principal

    4 weeks ago

    London, Greater London, United Kingdom Metyis Full time

    About the RoleMetyis is seeking a highly skilled Data Engineering Principal to join our team. As a key member of our organization, you will be responsible for leading the design and execution of data engineering projects, supporting clients in executing their data strategies, and engineering complete technical solutions to solve concrete business...

  • Data Engineering Principal

    1 month ago

    London, Greater London, United Kingdom Metyis Full time

    About the RoleMetyis is seeking a highly skilled Data Engineering Principal to join our team. As a key member of our organization, you will be responsible for leading the design and execution of data engineering projects, supporting clients in executing their data strategies, and engineering complete technical solutions to solve concrete business...

  • Data Engineering Principal

    1 month ago

    London, Greater London, United Kingdom Metyis Full time

    About the RoleMetyis is seeking a highly skilled Data Engineering Principal to join our team. As a key member of our organization, you will be responsible for leading the design and execution of data engineering projects, supporting clients in executing their data strategies, and engineering complete technical solutions to solve concrete business...

  • Data Engineering Principal

    1 month ago

    London, Greater London, United Kingdom Metyis Full time

    About the RoleMetyis is seeking a highly skilled Data Engineering Principal to join our team. As a key member of our organization, you will be responsible for leading the design and execution of data engineering projects, supporting clients in executing their data strategies, and engineering complete technical solutions to solve concrete business...

  • Data Engineering Principal

    1 month ago

    London, Greater London, United Kingdom Metyis Full time

    About the RoleWe are seeking a highly skilled Data Engineering Principal to join our team at Metyis. As a key member of our organization, you will play a crucial role in driving business growth and transformation through data-driven solutions.Key ResponsibilitiesLead the design and execution of data engineering projects, collaborating closely with clients...

  • Data Engineering Principal

    1 month ago

    London, Greater London, United Kingdom Metyis Full time

    About the RoleWe are seeking a highly skilled Data Engineering Principal to join our team at Metyis. As a key member of our organization, you will play a crucial role in driving business growth and transformation through data-driven solutions.Key ResponsibilitiesLead the design and execution of data engineering projects, collaborating closely with clients...

  • Data Engineering Principal

    2 weeks ago

    London, Greater London, United Kingdom Metyis Full time

    About the RoleWe are seeking a highly skilled Data Engineering Principal to join our team at Metyis. As a key member of our organization, you will play a crucial role in driving business growth and transformation through data-driven solutions.Key ResponsibilitiesLead the design and execution of data engineering projects, ensuring timely delivery and...

  • Data Engineering Principal

    2 weeks ago

    London, Greater London, United Kingdom Metyis Full time

    About the RoleWe are seeking a highly skilled Data Engineering Principal to join our team at Metyis. As a key member of our organization, you will play a crucial role in driving business growth and transformation through data-driven solutions.Key ResponsibilitiesLead the design and execution of data engineering projects, ensuring timely delivery and...

  • Data Engineering Principal

    4 weeks ago

    London, Greater London, United Kingdom Metyis Full time

    About the RoleMetyis is seeking a highly skilled Data Engineering Principal to join our team. As a key member of our organization, you will be responsible for leading the design and execution of data engineering projects, supporting clients in executing their data strategies, and engineering complete technical solutions to solve concrete business...