Data Engineer

4 weeks ago

City of London Greater London, United Kingdom Omnis Partners Full time

Full Time | Hybrid (2-3 days in office)
#Up to £75,000 + 20% Bonus

Omnis Partners is proud to represent a leading data and AI consultancy that is driving transformation across industries. Our client empowers organisations to harness the full potential of their data, reducing costs, mitigating risk, and uncovering new revenue opportunities through cutting-edge solutions and world-class talent.

Working with major technology partners including Databricks, Snowflake, and Collibra, they deliver projects that revolutionise how data is used across sectors such as financial services, pharmaceuticals, energy, retail, healthcare, and manufacturing.

The Role: Data Engineer (Databricks)
We are seeking an experienced Data Engineer with strong expertise in Databricks , Apache Spark, Delta Lake, Python, and SQL to take a lead role in delivering innovative data projects.

You will design and build scalable, cloud-based data pipelines on platforms such as AWS, Azure, or GCP, and provide technical leadership within delivery squads. Working closely with both clients and internal teams, you’ll translate business requirements into powerful, production-grade data solutions.

Design, build, and optimise large-scale data pipelines using Databricks and Spark.
Implement and maintain Delta Lake architectures and data governance best practices.
Deliver end-to-end solutions across cloud platforms (AWS, Azure, or GCP).
Provide technical leadership and mentor junior engineers within project teams.
Apply modern engineering practices including CI/CD and automated testing.

Proven experience as a Data Engineer working in cloud environments.
Advanced Python and SQL programming skills.
Strong understanding of CI/CD pipelines, automated testing, and data governance.
Leadership opportunities on high-impact data projects.
~ Continuous learning with funded certifications and access to a vibrant Databricks community.
~ Clear progression pathways and ongoing professional development.
~25 days annual leave plus bank holidays.
~ Hybrid working model 2–3 days per week in the Central London office.

  • Data Engineer

    2 days ago

    City of London, United Kingdom Data Idols Full time

    **Data Engineer - Biotechnology** Data Idols are working with an exciting and innovative biotechnology startup who are working to assist biopharma teams to find better medicines and drugs quicker and more efficiently. **The Opportunity** This is an opportunity for a Data Engineer to join a small team and have a big impact. As a Data Engineer you will...

  • Data Engineer

    4 days ago

    Greater London, United Kingdom Data Idols Full time

    Base Pay RangeSalary: £80,000 - £85,000Location: Hybrid - London - 1 day per weekOverviewWe are currently looking for a Data Engineer to join our client's forward-thinking, collaborative, and technology-driven team. In this role, you'll take the lead in shaping and delivering modern cloud data solutions, working closely with a highly skilled Data & BI...

  • Data Science and AI Engineering Manager

    3 weeks ago

    City of London, Greater London, United Kingdom Data Idols Full time

    Data Science and AI Engineering Manager Salary: £100,000 - £125,000 + bonus Location: London / Hybrid Data Idols are working with a major UK brand embarking on an exciting transformation to embed AI at the heart of its technology strategy. This is a brand-new role, a chance to build and lead an AI Engineering function from the ground up within an...

  • Data Engineering Manager

    3 days ago

    City Of London, United Kingdom Data Science Festival Full time

    Location: London – HybridData Idols are proud to partner with one of the UK’s most loved retail brands going through a major data transformation.As Data Engineering Manager, you’ll lead and inspire a talented team of data engineers through a period of exciting change – helping shape and deliver the company’s evolving data strategy and unlock real...

  • Head of Data Engineering

    6 days ago

    Greater London, United Kingdom NTT DATA Full time

    What you'll be doing : We are seeking an experienced and visionary Head of Data Engineering to lead our dynamic Data Engineering Team. The successful candidate will oversee a team of approximately 40 Data Engineers, ensuring the delivery of high-quality data solutions and driving the strategic direction of our Data Engineering efforts. Key Responsibilities :...

  • Senior Data Engineer

    2 days ago

    City Of London, United Kingdom Data Science Festival Full time

    Data Idols are working with a high-growth, product-led tech company on a mission to transform a global consumer category. With a rapidly growing customer base and a digital product used by millions, they are scaling their data team to power the next phase of growth and innovation. This role sits at the heart of their data platform strategy, perfect for an...

  • Data Engineer

    3 days ago

    Greater London, United Kingdom Data Science Festival Full time

    Data Engineer Salary: £80,00 – £85,000Location: Hybrid – London – 1 day per week We are currently looking for a Data Engineer to join our client’s forward-thinking, collaborative, and technology-driven team. In this role, you’ll take the lead in shaping and delivering modern cloud data solutions, working closely with a highly skilled Data & BI...

  • Data Science and AI Engineering Manager

    4 days ago

    City of London, United Kingdom Data Idols Full time

    Data Science and AI Engineering Manager Salary: £100,000 - £125,000 + bonus Location: London / Hybrid Data Idols are working with a major UK brand embarking on an exciting transformation to embed AI at the heart of its technology strategy. This is a brand-new role, a chance to build and lead an AI Engineering function from the ground up within an...

  • Data Science and AI Engineering Manager

    3 weeks ago

    london (city of london), United Kingdom Data Idols Full time

    Data Science and AI Engineering ManagerSalary: £100,000 - £125,000 + bonus Location: London / Hybrid Data Idols are working with a major UK brand embarking on an exciting transformation to embed AI at the heart of its technology strategy. This is a brand-new role, a chance to build and lead an AI Engineering function from the ground up within an...

  • Data Engineer

    1 week ago

    London, United Kingdom Data Idols Full time

    **Data Engineer** Would you like to build enterprise scale data solutions for a global organisation that reaches 400 million users monthly? We are supporting an ambitious data-driven client in the world of Multimedia with their search for a Data Engineer to develop and maintainnew features of their data platform and end-to-end delivery of exciting data...