Senior Data Engineer, Data Platform

3 days ago

London, Greater London, United Kingdom Trainline Full time

Job Description

Senior Data Engineer, Data Platform

Trainline is seeking a highly skilled Senior Data Engineer to join our Data Platform team. As a Senior Data Engineer, you will play a key role in designing, building, and maintaining our modern cloud-native data lakehouse.

About the Role

We are looking for a talented Senior Data Engineer to join our team and contribute to the development of our data platform. The successful candidate will have a strong background in data engineering, experience with cloud-native technologies, and a passion for delivering high-quality data products.

Key Responsibilities

  • Design and implement data pipelines using cutting-edge technologies such as streaming technologies, machine learning, and automated data pipelines.
  • Work closely with cross-functional teams, including data scientists, machine learning engineers, and product managers, to deliver world-class data products.
  • Drive continuous improvement to the software engineering and agile working practices of the team.
  • Contribute to the technical architecture direction of the team.

Requirements

  • Excellent knowledge of Scala and the JVM ecosystem.
  • Strong understanding of functional programming paradigms and a willingness to adopt other languages, not only JVM languages.
  • Consistent background in software development in high-volume environments.
  • Pragmatic and open-minded approach to achieving outcomes in the simplest way possible.
  • Experience with stream processing technologies, such as Kafka, Storm, and AWS Kinesis.
  • Experience with AWS services, especially EMR, ECS, and EKS.
  • Obsession with software quality, DevOps, and automation.
  • Good communication and presentation skills, comfortable presenting ideas and outputs to technical and non-technical stakeholders.

Our Technology Stack

We use a range of technologies, including Python, Scala, and the JVM, Kafka, Kafka Streams, and KSQL, AWS S3, Parquet, Iceberg, Glue, and EMR for our data lake, Terraform and Docker, Elasticsearch and DynamoDB, Spark, Airflow, Trino, Starburst, and Presto, Athena, ML Flow, and popular Python machine learning and analysis libraries.

The Interview Process

The interview process will consist of a recruiter call, a meeting with the manager, a technical discussion with two engineers, and a meeting with a cross-functional team member.

  • Senior Data Engineering Manager

    2 days ago

    London, Greater London, United Kingdom ON Data Staffing Full time

    About the RoleWe are seeking a highly skilled and experienced Senior Consulting Manager - Data Engineering to lead and grow our data engineering practice in the UK.Key ResponsibilitiesLead and manage the Data Engineering practice, delivering projects across cloud data platforms such as Snowflake and Databricks.Provide strategic direction on data...

  • Senior Data Engineering Manager

    2 days ago

    London, Greater London, United Kingdom ON Data Staffing Full time

    About the RoleWe are seeking a highly skilled and experienced Senior Consulting Manager - Data Engineering to lead and grow our data engineering practice in the UK.Key ResponsibilitiesLead and manage the Data Engineering practice, delivering projects across cloud data platforms such as Snowflake and Databricks.Provide strategic direction on data...

  • Data Platforms Leader

    4 days ago

    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Job Title: Head of Data PlatformsJob Type: Full-timeCompany: Harnham - Data & Analytics RecruitmentLocation: Central LondonJob Description:We are partnering with a leading global insurance company to find a seasoned professional to lead their Data Platforms team. The ideal candidate will have a proven track record of leading teams of 20+ at a global scale...

  • Data Platforms Leader

    4 days ago

    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Job Title: Head of Data PlatformsJob Type: Full-timeCompany: Harnham - Data & Analytics RecruitmentLocation: Central LondonJob Description:We are partnering with a leading global insurance company to find a seasoned professional to lead their Data Platforms team. The ideal candidate will have a proven track record of leading teams of 20+ at a global scale...

  • Director of Data Platforms

    6 days ago

    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Job Title: Director of Data EngineerCompany: Harnham - Data & Analytics RecruitmentJob Type: Full-timeLocation: RemoteJob Description:Overview:We are seeking a highly skilled and experienced Director of Data Engineer to lead our data engineering team. As a key member of our organization, you will be responsible for building and maintaining our data...

  • Director of Data Platforms

    1 week ago

    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Job Title: Director of Data EngineerCompany: Harnham - Data & Analytics RecruitmentJob Type: Full-timeLocation: RemoteJob Description:Overview:We are seeking a highly skilled and experienced Director of Data Engineer to lead our data engineering team. As a key member of our organization, you will be responsible for building and maintaining our data...

  • Data Engineering Leader

    6 days ago

    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time £120,000

    About the RoleWe are partnering with a leading InsurTech company to find a seasoned Data Engineering Leader to join their team. This is an exciting opportunity to grow the data platform and build a high-performing team.Key ResponsibilitiesDevelop and implement a strategy to grow the data team and introduce new technologies to ensure the platform is built...

  • Data Engineering Leader

    6 days ago

    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time £120,000

    About the RoleWe are partnering with a leading InsurTech company to find a seasoned Data Engineering Leader to join their team. This is an exciting opportunity to grow the data platform and build a high-performing team.Key ResponsibilitiesDevelop and implement a strategy to grow the data team and introduce new technologies to ensure the platform is built...

  • Senior Data Engineer

    6 hours ago

    London, Greater London, United Kingdom Tribal Tech - The Digital, Data & AI Specialists Full time £70,000 - £90,000

    Senior Data Engineer OpportunityTribal Tech - The Digital, Data & AI Specialists is seeking an experienced Senior Data Engineer to join their innovative team. This role offers a unique opportunity to shape the future of data-driven decision-making within a rapidly growing organization.Key Responsibilities:Design, implement, and maintain robust data pipelines...

  • Senior Data Engineer

    9 hours ago

    London, Greater London, United Kingdom Tribal Tech - The Digital, Data & AI Specialists Full time £70,000 - £90,000

    Senior Data Engineer OpportunityTribal Tech - The Digital, Data & AI Specialists is seeking an experienced Senior Data Engineer to join their innovative team. This role offers a unique opportunity to shape the future of data-driven decision-making within a rapidly growing organization.Key Responsibilities:Design, implement, and maintain robust data pipelines...

  • Senior Data Engineering Project Manager

    6 days ago

    London, Greater London, United Kingdom NTT DATA Full time

    About the RoleWe are seeking an experienced Senior Data Engineering Project Manager to join our team at NTT DATA. As a key member of our Data Engineering service line, you will be responsible for overseeing Data Engineering projects and programmes across our Data transformation portfolio.Key ResponsibilitiesLead highly-skilled technical teams in a...

  • Senior Data Engineering Project Manager

    7 days ago

    London, Greater London, United Kingdom NTT DATA Full time

    About the RoleWe are seeking an experienced Senior Data Engineering Project Manager to join our team at NTT DATA. As a key member of our Data Engineering service line, you will be responsible for overseeing Data Engineering projects and programmes across our Data transformation portfolio.Key ResponsibilitiesLead highly-skilled technical teams in a...

  • Data Engineering Leader

    6 days ago

    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Job SummaryHarnham - Data & Analytics Recruitment is partnering with a leading InsurTech company to find a highly skilled Head of Data Engineering to lead their data platform team.About the CompanyThe company is a fully digital InsurTech that aims to make insurance more accessible, affordable, and tailored to individual needs. With a strong focus on...

  • Data Engineering Leader

    1 week ago

    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Job SummaryHarnham - Data & Analytics Recruitment is partnering with a leading InsurTech company to find a highly skilled Head of Data Engineering to lead their data platform team.About the CompanyThe company is a fully digital InsurTech that aims to make insurance more accessible, affordable, and tailored to individual needs. With a strong focus on...

  • Senior Data Engineer

    4 hours ago

    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our expanding data team at Harnham - Data & Analytics Recruitment. As a Senior Data Engineer, you will be responsible for building and maintaining our company's Azure platform, working closely with stakeholders to understand data collected, and implementing best coding practices using...

  • Senior Data Engineer

    56 minutes ago

    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our expanding data team at Harnham - Data & Analytics Recruitment. As a Senior Data Engineer, you will be responsible for building and maintaining our company's Azure platform, working closely with stakeholders to understand data collected, and implementing best coding practices using...

  • Senior Data Solutions Architect

    2 days ago

    London, Greater London, United Kingdom ON Data Staffing Full time

    About the RoleWe are seeking a highly skilled Senior Data Solutions Architect to join our team at ON Data Staffing. As a key member of our data engineering team, you will play a pivotal role in delivering innovative big data solutions to our clients.Key ResponsibilitiesClient Collaboration: Collaborate directly with our clients to understand their business...

  • Senior Data Solutions Architect

    2 days ago

    London, Greater London, United Kingdom ON Data Staffing Full time

    About the RoleWe are seeking a highly skilled Senior Data Solutions Architect to join our team at ON Data Staffing. As a key member of our data engineering team, you will play a pivotal role in delivering innovative big data solutions to our clients.Key ResponsibilitiesClient Collaboration: Collaborate directly with our clients to understand their business...

  • Staff Data Engineer

    4 days ago

    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    About the RoleWe are seeking a highly skilled Staff Data Engineer to join our expanding data team at Harnham - Data & Analytics Recruitment. As a Staff Data Engineer, you will be responsible for building and maintaining our company's AWS platform, working closely with stakeholders to understand their data needs, and implementing best coding practices using...

  • Staff Data Engineer

    4 days ago

    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    About the RoleWe are seeking a highly skilled Staff Data Engineer to join our expanding data team at Harnham - Data & Analytics Recruitment. As a Staff Data Engineer, you will be responsible for building and maintaining our company's AWS platform, working closely with stakeholders to understand their data needs, and implementing best coding practices using...