Data Engineering Leader

2 days ago

London, Greater London, United Kingdom Core Consultants Full time

**Job Title:** Data Engineering Leader

**Location:** Remote (hybrid work environment)

**Estimated Salary:** $120,000 - $180,000 per year

At Core Consultants, we're seeking a highly skilled Data Engineering Leader to spearhead the design, implementation, and technical oversight of our internal data ingestion platform. As a key member of our team, you'll lead a group of data engineers, drive the development of configurable Spark ETL pipelines, and leverage modern data architecture principles to support downstream analytics and visualization requirements.

**Key Responsibilities:**

  • Recruit, train, and manage a high-performing data engineering team.
  • Establish best practices for data engineering processes and mentor team members to develop their skills.
  • Act as the product owner for the internal data ingestion platform, ensuring alignment with business needs and long-term scalability.
  • Provide technical oversight for the design and development of configurable Spark ETL pipelines that consume data from Kafka streams.
  • Manage the hosting and deployment of the platform on Azure Kubernetes Service (AKS).

**Requirements:**

  • Extensive experience with Apache Spark, Kafka, and Airflow for data ingestion and orchestration.
  • Deep understanding of Databricks for data preprocessing and transformation.
  • Hands-on experience with Snowflake, SQL warehouses, and Delta Lake for data storage.
  • Proven ability to lead and develop data engineering teams.
  • Strong collaboration skills, working with data analysts, consultants, and cross-functional teams.

**Benefits:**

  • A comprehensive benefits package, including medical, dental, and vision insurance.
  • A generous 401(k) matching program.
  • Flexible remote work options.

  • Data-Driven Recruitment Specialist

    1 week ago

    London, Greater London, United Kingdom Leader Engineering Full time

    About Leader EngineeringWe're shifting our focus to renewable energy, helping shape a cleaner, more sustainable world. Our ambitious, data-driven plan for the next five years is centered around innovation and growth.Your ProfileYou're a results-driven professional with a passion for recruitment. You excel at identifying top talent, analyzing data to inform...

  • Data Engineer Leader

    1 week ago

    London, Greater London, United Kingdom Data Idols Full time £75,000 - £95,000

    **About Data Idols**Data Idols is a renowned retail brand in the UK, seeking an exceptional Senior Data Engineer to drive data transformation. As a Senior Data Engineer at Data Idols, you will play a pivotal role in delivering high-quality data solutions.The ideal candidate will have extensive experience with data pipelines, data warehousing, and cloud-based...

  • Strategic Growth Manager

    1 week ago

    London, Greater London, United Kingdom Leader Engineering Full time

    Company Overview:Leader Engineering is a pioneering force in energy recruitment, dedicated to transforming the industry with innovative approaches and data-driven strategies. With a strong foundation in oil and gas, we are now expanding our focus to renewable energy, aiming to shape a cleaner, more sustainable world.

  • Data Engineer Leader

    4 weeks ago

    London, Greater London, United Kingdom Data Idols Full time £80,000 - £90,000

    Job OverviewData Idols is a pioneering retailer transforming into a data-driven organisation. As a Senior Data Platform Engineer, you will shape the data landscape by designing, implementing, and maintaining a robust data platform using Azure Services.We offer a competitive salary of £80,000 - £90,000 + bonus, along with 20% discount across all products,...

  • Data Scientist Leader

    1 day ago

    London, Greater London, United Kingdom Data Science Talent Full time

    About Data Science Talent">We're a team of innovators driving the future of data-driven performance at F1. With a strong focus on delivering cutting-edge insights, we're shaping the racing car's competitive edge.Job Title: Senior Data ScientistKey Responsibilities:Transforming data utilisation strategies to enhance peak performanceExploring innovative...

  • Digital Recruitment Strategist

    6 days ago

    London, Greater London, United Kingdom Leader Engineering Full time

    Digital Recruitment StrategistLeader Engineering is revolutionizing energy recruitment by focusing on renewable energy and creating a cleaner, more sustainable world.Your Key Responsibilities:Develop a collaborative, high-performance team culture.Analyze data to optimize recruitment processes and identify growth opportunities.Design and implement innovative...

  • Talent Acquisition Specialist

    1 week ago

    London, Greater London, United Kingdom Leader Engineering Full time

    About Leader EngineeringWe're expanding our focus to renewable energy and seeking talented professionals who want to make a real impact in the industry.Your ProfileYou're a strategic growth hacker with a passion for recruitment and a track record of success in data-driven strategy development.Role: Talent Acquisition SpecialistKey ResponsibilitiesTalent...

  • Growth Strategist

    1 week ago

    London, Greater London, United Kingdom Leader Engineering Full time

    About Leader EngineeringWe are transforming the energy recruitment landscape, shifting our focus to renewable energy and seeking bold, innovative team members who want to make a real impact.Your ProfileYou're a data-savvy professional with a passion for recruitment. You excel at spotting talent, using data to optimize strategies, and fostering a...

  • Cloud Data Engineer Leader

    2 days ago

    London, Greater London, United Kingdom Data Idols Full time £80,000 - £90,000

    Job DescriptionWe are currently seeking a Senior Data Platform Engineer to join our team. This role involves designing and implementing scalable, reliable, and secure data platform infrastructure using Azure Services.Maintaining an optimised platform by monitoring performance across compute and storage solutionsLeading CI/CD deployments for data...

  • Renewable Energy Growth Specialist

    6 days ago

    London, Greater London, United Kingdom Leader Engineering Full time

    Job Title: Renewable Energy Growth SpecialistWe're transforming energy recruitment at Leader Engineering, expanding our focus to renewable energy and shaping a cleaner, more sustainable world.Your Role:Built a collaborative, performance-driven culture.Utilized analytics to boost recruitment efficiency and uncover growth opportunities.Experimented with new...

  • Recruitment Innovator

    1 week ago

    London, Greater London, United Kingdom Leader Engineering Full time

    About Leader EngineeringWe are on a mission to transform energy recruitment, building real partnerships in the oil and gas industry and expanding our focus to renewable energy.Your ProfileYou're a results-driven growth hacker with a passion for recruitment. You excel at optimizing strategies, using data to spot talent, and fostering a collaborative team...

  • Chief Talent Acquisition Strategist

    1 month ago

    London, Greater London, United Kingdom Leader Engineering Full time

    Company OverviewLeader Engineering is transforming energy recruitment with an ambitious, data-driven plan for the next five years. We're expanding our focus to renewable energy and helping shape a cleaner, more sustainable world.SalaryWe offer a competitive salary of $80,000 - $110,000 per year, depending on experience.Job DescriptionYou'll be responsible...

  • Senior Engineering Manager

    16 hours ago

    London, Greater London, United Kingdom Data Science Festival Full time

    Senior Engineering Manager - DataSalary: £90,000 – £95,000Location: London – hybridWe are looking for an exceptional Senior Engineering Manager - Data to join our team at Data Science Festival. As a leader in data engineering, you will play a critical role in shaping our data strategy and driving innovation across the organization.About the RoleAs a...

  • Data Engineer for Data Transformation

    2 days ago

    London, Greater London, United Kingdom Data Idols Full time

    About UsData Idols is a renowned retail brand in the UK, and we're looking for a highly skilled Staff Data Engineer to join our team. With an exciting project on the horizon, this role offers the perfect opportunity for someone with experience in building and maintaining data pipelines to make a real impact.The OpportunityAs a Staff Data Engineer, you will...

  • Data Insights Leader

    2 weeks ago

    London, Greater London, United Kingdom Aspire Data Recruitment Full time

    Aspire Data Recruitment seeks an experienced Data Insights Leader to lead a small team in delivering high-impact data projects. With a strong background in data and consulting, this individual will be responsible for managing the ideation, planning, execution, and delivery of new products, as well as organizing teams to deliver specific outcomes within given...

  • Data Engineering Leader

    1 week ago

    London, Greater London, United Kingdom UKForex Limited Full time

    We are seeking a highly experienced Data Engineering Leader to join our leadership team at UKForex Limited. As a senior leader, you will be responsible for leading our data engineering team and driving business growth through data-driven insights.About the RoleYou will work closely with cross-functional teams to develop and execute data strategies that meet...

  • Data Engineer Leader

    2 days ago

    London, Greater London, United Kingdom InterEx Group Full time

    At InterEx Group, we are looking for a highly skilled Data Engineer Leader to join our team. This role involves designing and implementing big data solutions that meet the needs of our clients.As a Data Engineer Leader, you will be responsible for providing technical leadership and expertise in the design, implementation, and maintenance of big data systems....

  • Senior Data Engineer in F1 Motorsport

    2 days ago

    London, Greater London, United Kingdom Data Science Talent Full time

    Job DescriptionWe are seeking an experienced Senior Data Scientist to join our Data Science Team. In this role, you will work under the guidance of our Data Science Team Leader and collaborate with a brilliant group of people to deliver innovative solutions. Your freedom and flexibility to explore new ways of getting the best out of data structures and...

  • Enterprise Data Analytics Sales Leader

    1 month ago

    London, Greater London, United Kingdom Altair Engineering Full time

    Altair Engineering is a renowned organization in the data analytics sector, and we are seeking a skilled Enterprise Data Analytics Sales Leader to join our team.We offer a competitive salary of $120,000 - $150,000 per year, reflecting the industry standards for this role in London.Job DescriptionThis is a pivotal position that requires strategic thinking,...

  • Data Engineering Leader

    2 days ago

    London, Greater London, United Kingdom Cognify Search Full time £100,000

    Cognify Search is a fast-growing E-commerce business following a data mesh architecture. We are seeking a highly skilled Data Engineering Leader to join our team and drive the development of our Analytics and Data platform. This is an exciting opportunity to lead a best-in-class platform, working closely with business stakeholders to understand needs and...