Principal Data Engineer

2 weeks ago

London, United Kingdom McGregor Boyall Full time

**Principal Data Engineer.**

**London/1 day in office every 2 weeks.**

**£120,000-£140,000 + Benefits.**

**No sponsorship available.**

The company run a pure AWS-based cloud environment and deliver features using a continuous delivery approach. Their Data platform comprises a mix of services and open-source products fully running in Kubernetes and utilising AWS native Data solutions.

Their Data solution is a mix of batching and streaming processes leveraging Airflow, Apache Kafka and AWS Data tools. Our key characteristic is enabling a self-service experience for all Data stakeholders.

Their products are served by a polyglot mix of microservices designed following Domain-Driven Design principles and composing an Event-Driven Architecture powered by Apache Kafka.

As a Principal Data Engineer, you will be a trusted technical authority within the organisation. As part of the Architecture team, your primary responsibility will be defining and enabling a data strategy that can support Nutmeg's growth. You will closelycollaborate with technical and non-technical stakeholders at delivering Data as a product.

They are looking for someone with previous job experience as an engineering lead/principal engineer and a strong passion for data challenges.

**Requirements**:

- Following Data engineering industry best practice.
- Designing, implementing, and maintaining complex Data models.
- Writing automated test around Data models and Data pipelines.
- A good understanding of CI/CD principles.
- Experience with cloud platforms for Data (ideally AWS).
- Experience in defining infrastructure as code.
- Experience in driving cross-function Data initiatives.
- Explaining technical issues in a clear way to business and other stakeholders.
- Previous experience with two or more of the following: Airflow, dbt, Kafka Connect, Looker, and Python.

**You might also have**:

- DataOps best practice.
- Experience in building and running a Data Mesh.
- Previous experience with one or more of the following: Cloud Native Data products/ Apache Kafka and its ecosystem of tools/ Serverless Data pipelines/ Event Driven Architecture/ Domain driven design.
- Use of agile/lean methodologies for continuous delivery and improvement.
- Knowledge of monitoring, metrics or Site Reliability Engineering.
- Understanding of Data governance and security standards.

McGregor Boyall is an equal opportunity employer and do not discriminate on any grounds.

  • Principal Data Scientist

    2 weeks ago

    London, United Kingdom Data Idols Full time

    **Principal Data Scientist - Experimentation** We're looking to recruit a Principal Data Scientist to lead experimentation on a greenfield project for one of the worlds best known online companies. If you have a very strong background in statistics and A/B testing we are keen to talk with you. Offeringa very competitive salary with flexible working across...

  • Principal Data Engineer

    4 weeks ago

    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **MID-LEVEL DATA ENGINEER** **£60,000 - £70,000 + BENEFITS** **LONDON (FLEXI-WORKING)** Are you a Data Engineer looking for an exciting challenge? Want to become a pivotal part of a globally recognised insurance company? If becoming a Principal Data Engineer is the role you have been looking for, read on to discover more. **THE COMPANY**: Harnham is...

  • Principal Product Data Scientist

    4 weeks ago

    City of London, United Kingdom Data Idols Full time

    **Principal Product Data Scientist** We're looking to recruit a Principal Data Scientist to lead experimentation on a greenfield project for one of the worlds best known online companies. If you have a very strong background in statistics and A/B testing we are keen to talk with you. Offeringa very competitive salary with flexible working across Europe this...

  • Principal Data Engineer

    4 weeks ago

    London, United Kingdom Harnham Full time

    PRINCIPAL DATA ENGINEER This retailer are searching for a new Principal Data Engineer to take responsibility for the development of the company's cloud platform in Azure. You will also build new Data Pipelines using Python and SQL. This fast-growing international company is seeking a Principal Data Engineer to join their growing Data and Analytics...

  • Principal Data Engineer

    3 days ago

    London, United Kingdom Atyeti Inc Full time

    Job DescriptionClient: A global financial services companyAbout the Role: We are seeking a talented Principal Data Engineer to join our team in London. As a Principal Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure, ensuring scalability, reliability, and efficiency. Key Responsibilities:Design, develop, and...

  • Principal Data Engineer

    4 days ago

    London, United Kingdom Atyeti Inc Full time

    Client: A global financial services companyAbout the Role: We are seeking a talented Principal Data Engineer to join our team in London. As a Principal Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure, ensuring scalability, reliability, and efficiency. Key Responsibilities:Design, develop, and maintain...

  • Principal Data Engineer

    4 days ago

    London, United Kingdom Atyeti Inc Full time

    Client: A global financial services company About the Role: We are seeking a talented Principal Data Engineer to join our team in London. As a Principal Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure, ensuring scalability, reliability, and efficiency. Key Responsibilities: Design, develop, and maintain...

  • Principal Data Engineer

    3 hours ago

    London, United Kingdom Atyeti Inc Full time

    Job Description Client: A global financial services company About the Role: We are seeking a talented Principal Data Engineer to join our team in London. As a Principal Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure, ensuring scalability, reliability, and efficiency. Key Responsibilities: Design,...

  • Principal Data Engineer

    4 days ago

    London Area, United Kingdom Atyeti Inc Full time

    Client: A global financial services companyAbout the Role: We are seeking a talented Principal Data Engineer to join our team in London. As a Principal Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure, ensuring scalability, reliability, and efficiency. Key Responsibilities:Design, develop, and maintain...

  • Principal Data Engineer

    4 days ago

    London Area, United Kingdom Atyeti Inc Full time

    Client: A global financial services companyAbout the Role: We are seeking a talented Principal Data Engineer to join our team in London. As a Principal Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure, ensuring scalability, reliability, and efficiency. Key Responsibilities:Design, develop, and maintain...

  • Principal Data Engineer

    4 days ago

    London Area, United Kingdom Atyeti Inc Full time

    Client: A global financial services company About the Role: We are seeking a talented Principal Data Engineer to join our team in London. As a Principal Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure, ensuring scalability, reliability, and efficiency. Key Responsibilities: Design, develop, and maintain...

  • Principal Data Engineer

    4 days ago

    London, United Kingdom Atyeti Inc Full time

    Client: A global financial services company About the Role: We are seeking a talented Principal Data Engineer to join our team in London. As a Principal Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure, ensuring scalability, reliability, and efficiency. Key Responsibilities: Design, develop, and...

  • Principal Data Engineer

    3 hours ago

    London, United Kingdom Atyeti Inc Full time

    Job Description Client: A global financial services company About the Role: We are seeking a talented Principal Data Engineer to join our team in London. As a Principal Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure, ensuring scalability, reliability, and efficiency. Key Responsibilities: Design, develop,...

  • Principal Data Engineer

    4 weeks ago

    London, United Kingdom BP Full time

    **Job Profile Summary** The Principal Data Engineer for Digital & Analytics Digital Technology leads data engineering across our Trading & Shipping business entity. The Principal Data Engineer will drive our big data & analytics technical data strategy and combine their technicalexpertise with strong business acumen and data domain knowledge to create value...

  • Principal Data Engineer

    1 hour ago

    London, United Kingdom Provide Full time

    About the company: My client is a global asset manager with a long successful history of helping clients worldwide achieve their financial goals. With offices across six continents and thousands of employees, they are always looking to adapt to technological changes to stay at the forefront of the industryAbout the Role: As a Principal Data Engineer,...

  • Data Engineer

    2 weeks ago

    London, United Kingdom Data Idols Full time

    **Data Engineer** Data Idols are excited to be working with one of the top 100 companies in the world to recruit a Data Engineer! A company which owns multiple brands and who are investing heavily into 'all things data' to revolutionise their extraordinary team. **Skills and Experience**: - Experience with Azure - Experience with SQL - Experience with...

  • Principal Engineer

    3 weeks ago

    London Area, United Kingdom Oliver Bernard Full time

    Principal Engineer / Principal Architect We are looking for a Principal Architect / Principal Engineer to join a company building the next generation or data driven organisations. This is a Senior position within the business, focusing on all areas of data, platform & software engineering. Be the "go to" person for all things tech, take complete ownership...

  • Principal Data Engineer Python Java Trading

    1 week ago

    London, United Kingdom eFinancialCareers Full time

    Principal Data Engineer (Architect Data Architecture Engineering Principal Lead Manager Java Python GCP AWS Cloud Trading Front Office Finance Financial Services Spark Kafka Agile Remote Data Lake Datalake Investment Banking Asset Management Manager) requiredby our fixed income trading software client in London. You MUST have the following: - Good...

  • Principal Data Engineer Python Java Trading

    3 weeks ago

    London, United Kingdom eFinancialCareers Full time

    Principal Data Engineer (Architect Data Architecture Engineering Principal Lead Manager Java Python GCP AWS Cloud Trading Front Office Finance Financial Services Spark Kafka Agile) required by our fixed income trading software client in London. You MUST have the following: - Good experience as a Principal Data Engineer/Lead Data Engineer/Senior Data...

  • Remote Principal Data Engineer Python Trading

    4 weeks ago

    London, United Kingdom eFinancialCareers Full time

    REMOTE Principal Data Engineer (Architect Data Architecture Engineering Principal Lead Manager Java Python GCP AWS Cloud Trading Front Office Finance Financial Services Spark Kafka Agile Remote) required by our fixed income trading software client in London. You MUST have the following: - Good experience as a Principal Data Engineer/Lead Data...