Principal Data Engineer

4 months ago

London, United Kingdom Epam Full time

Description

About the role



Are you a Principal Data Engineer with a passion for big data? Do you keep up to date with cutting-edge technologies within D&A?

If so, then you have a fantastic opportunity to join a multi-disciplinary team of engineers, architects, designers, and strategists as we continue to grow our Data & Analytics practice across Europe.
Were looking for a Principal Data Engineer with Azure, Databricks and PySpark to join our team in London. The ideal candidate will have a strong background in data engineering, extensive experience with Azure cloud services, and experience leading a technical team on the implementation.

Responsibilities

Lead, mentor and manage a team of Azure data engineers Drive the team's technical execution Collaborate with cross-functional teams including data scientists, analysts and business stakeholders ensuring a quality single version of truth Passionate engineer, very keen on building end to end pipelines to support enterprise-wide analytics Design, develop and implement scalable and secure data lake solutions on Azure Ensure best practices in data engineering, data integration and ETL processes Prepared to code complicated aspects of our pipeline Ensure the ongoing maturity of our SVOT framework Monitor performance and scalability of the SVOT platform updating the framework and code to ensure the business has highly available accessible product

Requirements

Minimum of 8 years of experience in data engineering At least 5 years of hands-on experience with Azure data services (Apache Spark, Azure Data Factory, Synapse Analytics, RDBMS experience (prefer SQL Server) Proven experience in leading and managing a team of data engineers Proficiency in programming languages specifically PySpark, Python (with Pandas if no PySpark), Continuous Integration (DevOps, PRs, Branching), T-SQL & SparkSQL Strong understanding of data modeling, ETL processes and data warehousing concepts Knowledge of CI/CD pipelines and version control (e.g., Git) Excellent problem-solving and analytical skills Strong communication and collaboration abilities Ability to manage multiple projects and meet deadlines Certifications in Azure (e.g., Microsoft Certified: Azure Data Engineer Associate, Azure Solutions Architect)

Nice to Have

Hands-on experience with Scala for Apache Spark Knowledge or experience working with other Clouds such as AWS or GCP

Our Benefits Include

A competitive group pension plan and protection benefits including life assurance, income protection and critical illness cover Private medical insurance and dental care Cyclescheme, Techscheme and season ticket loans Employee assistance program Great learning and development opportunities, including in-house professional training, career advisory and coaching, sponsored professional certifications, well-being programs, LinkedIn Learning Solutions and much more EPAM Employee Stock Purchase Plan (ESPP) Various perks such as gym discounts, free Wednesday lunch in-office, on-site massages and regular social events Certain benefits and perks may be subject to eligibility requirements and may be available only after you have passed your probationary period

About EPAM

EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential

  • Principal Data Scientist at Marshmallow

    4 weeks ago

    London, Greater London, United Kingdom Data Privacy Full time

    About the RoleWe are seeking a highly skilled Principal Data Scientist to join our Data Science Team at Marshmallow. As a key member of our team, you will be responsible for leading and delivering on a data science roadmap in claims, aligned with product and engineering.You will identify, scope, and push currently-unmapped modelling solutions in claims,...

  • Principal Data Engineer

    2 months ago

    London, United Kingdom Oliver Bernard Full time

    Principal Java Data Engineer - Java, Kafka, Flink, ETL PipelinesA long term client of OB's in the consulting space have a brand new project and need a number of Senior-Principal Java Engineers to work on a brand new project for a Tier 1 Investment Bank.The ideal candidate will come from an Investment Banking background (this is not essential) with solid Java...

  • Principal Data Engineer

    1 month ago

    London, United Kingdom Oliver Bernard Full time €120,000 - €135,000

    Principal Java Data Engineer - Java, Kafka, Flink, ETL Pipelines A long term client of OB's in the consulting space have a brand new project and need a number of Senior-Principal Java Engineers to work on a brand new project for a Tier 1 Investment Bank. The ideal candidate will come from an Investment Banking background (this is not essential) with...

  • Principal Data Engineer

    2 months ago

    London Area, United Kingdom Oliver Bernard Full time

    Principal Java Data Engineer - Java, Kafka, Flink, ETL PipelinesA long term client of OB's in the consulting space have a brand new project and need a number of Senior-Principal Java Engineers to work on a brand new project for a Tier 1 Investment Bank.The ideal candidate will come from an Investment Banking background (this is not essential) with solid Java...

  • Principal Data Engineer

    2 months ago

    London Area, United Kingdom Oliver Bernard Full time

    Principal Java Data Engineer - Java, Kafka, Flink, ETL PipelinesA long term client of OB's in the consulting space have a brand new project and need a number of Senior-Principal Java Engineers to work on a brand new project for a Tier 1 Investment Bank.The ideal candidate will come from an Investment Banking background (this is not essential) with solid Java...

  • Principal Data Engineer

    1 month ago

    London, United Kingdom Oliver Bernard Full time €120,000 - €135,000

    Principal Java Data Engineer - Java, Kafka, Flink, ETL Pipelines A long term client of OB's in the consulting space have a brand new project and need a number of Senior-Principal Java Engineers to work on a brand new project for a Tier 1 Investment Bank. The ideal candidate will come from an Investment Banking background (this is not essential) with...

  • Principal Data Engineer

    7 months ago

    London, United Kingdom Harnham Full time

    PRINCIPAL DATA ENGINEER This retailer are searching for a new Principal Data Engineer to take responsibility for the development of the company's cloud platform in Azure. You will also build new Data Pipelines using Python and SQL. This fast-growing international company is seeking a Principal Data Engineer to join their growing Data and Analytics...

  • Principal Data Engineer

    1 month ago

    London, United Kingdom Harnham Full time

    PRINCIPAL DATA ENGINEER This retailer are searching for a new Principal Data Engineer to take responsibility for the development of the company's cloud platform in Azure. You will also build new Data Pipelines using Python and SQL. This fast-growing international company is seeking a Principal Data Engineer to join their growing Data and Analytics...

  • Principal Data Engineer

    2 weeks ago

    London, United Kingdom Harnham Full time €90,000 - €100,000

    PRINCIPAL DATA ENGINEER LONDON BASED £This retailer are searching for a new Principal Data Engineer to take responsibility for the development of the company's cloud platform in Azure. You will also build new Data Pipelines using Python and SQL. This fast-growing international company is seeking a Principal Data Engineer to join their growing Data and...

  • Principal Data Engineer

    3 weeks ago

    London, United Kingdom Harnham Full time €90,000 - €100,000

    PRINCIPAL DATA ENGINEER LONDON BASED £This retailer are searching for a new Principal Data Engineer to take responsibility for the development of the company's cloud platform in Azure. You will also build new Data Pipelines using Python and SQL. This fast-growing international company is seeking a Principal Data Engineer to join their growing Data and...

  • Senior-Principal Java Data Engineer

    1 month ago

    London, United Kingdom Oliver Bernard Full time

    Senior-Principal Java Data Engineer - Java, Kafka, Flink, ETL Pipelines A long term client of OB's in the consulting space have a brand new project and need a number of Senior-Principal Java Engineers to work on a brand new project for a Tier 1 Investment Bank. The ideal candidate will come from an Investment Banking background (this is not essential)...

  • Principal Electrical Engineer

    2 months ago

    London, United Kingdom CV-Library Full time

    Our client is a world renowned multidisciplinary consultancy with an extremely impressive client base particularly within the Data Centre sector. With a specialised Critical Systems team that drive efficiency and sustainability in mission-critical buildings. They manage to stay ahead by hiring the best engineers and using pioneering technologies. An...

  • Data Engineering Principal

    4 weeks ago

    London, Greater London, United Kingdom Metyis Full time

    About the RoleWe are seeking a highly skilled Data Engineering Principal to join our team at Metyis. As a key member of our data engineering team, you will be responsible for designing and executing data engineering projects, supporting clients in executing their data strategies, and engineering complete technical solutions to solve concrete business...

  • Data Engineering Principal

    4 weeks ago

    London, Greater London, United Kingdom Metyis Full time

    About the RoleMetyis is seeking a highly skilled Data Engineering Principal to lead our data engineering projects and support our clients in executing their data strategies.Key ResponsibilitiesIndependently lead and manage the design and execution of data engineering projects.Support our clients in designing and building operational data platforms, including...

  • Senior Principal Clinical Data Scientist

    4 weeks ago

    London, Greater London, United Kingdom Data Privacy Full time

    Job SummaryWe are seeking a highly skilled Senior Principal Clinical Data Scientist to join our team at Novartis, London, United Kingdom. As a key member of our Global Clinical Operations team, you will be responsible for managing all Data Management deliverables at a consistently high standard, ensuring cost, quality, and timelines are met for all assigned...

  • Principal Electrical Engineer

    2 months ago

    London, United Kingdom Eden Brown Full time

    Our client is a world renowned multidisciplinary consultancy with an extremely impressive client base particularly within the Data Centre sector. With a specialised Critical Systems team that drive efficiency and sustainability in mission-critical buildings. They manage to stay ahead by hiring the best engineers and using pioneering technologies. An...

  • Principal Data Engineer

    4 months ago

    London, United Kingdom CAPCO Full time

    Principal Data Engineer at Capco UK - London Principal Data Engineer Why Join Capco? Capco is a global technology and business consultancy, focused on the financial services sector. We are passionate about helping our clients succeed in an ever-changing industry. You will work on engaging projects with some of the largest banks in the world, on...

  • Principal Data Engineer

    1 month ago

    London, United Kingdom Aubay UK Full time

    Required experience: 10-15y experience in Python backend engineering Experienced in development of elastic containerised web services in Azure Designing and implementing automatic deployment pipelines Experience with low-latency data aggregation solutions Experience with SRE Observability The Principal Data Engineer is the one who conceptualises and...

  • Principal Data Engineer

    1 month ago

    London, United Kingdom Aubay UK Full time

    Required experience: 10-15y experience in Python backend engineering Experienced in development of elastic containerised web services in Azure Designing and implementing automatic deployment pipelines Experience with low-latency data aggregation solutions Experience with SRE Observability The Principal Data Engineer is the one who conceptualises and...

  • Principal Electrical Engineer

    2 months ago

    London, United Kingdom Eden Brown Full time

    Our client is a world renowned multidisciplinary consultancy with an extremely impressive client base particularly within the Data Centre sector. With a specialised Critical Systems team that drive efficiency and sustainability in mission-critical buildings. They manage to stay ahead by hiring the best engineers and using pioneering technologies. An...