Data Engineer

2 months ago


London, UK, United Kingdom Opus Recruitment Solutions Full time

Data Engineer


£40-55K


I am currently looking for an entry level Data Engineer to hit the ground running with a leader in the UK's digital and software services landscape, where your work in cutting-edge technology will empower customers to manage, share, and exploit data more effectively.


We’re seeking a Senior Data Engineer to lead the delivery of transformative solutions for our clients. You will lead the delivery of tailored solutions to our clients where you will be responsible for the design, delivery and implementation solutions, spanning from end user interfaces and innovative user experience to data driven solutions.


In addition to the relevant technical experience in the different domains identified, you will have a depth of experience in different software engineering languages and commercial off the shelf tools across cloud and on-prem settings where you will be expected to build impactful Technical Solutions, Concept Demonstrators and Minimum Value Propositions.


Job Responsibilities


  • Build, optimise, and maintain scalable data pipelines that handle high-volume, high-velocity data in complex SaaS environments.
  • Design efficient, scalable, and flexible data models in multiple technologies to meet business requirements.
  • Analyse and consolidate business requirements and use cases to meet technical and non-technical debt.
  • Design tailored and bespoke solutions to address and mitigate challenges faced by our clients.
  • Make key decisions on build vs buy for data and digital engineering solutions and platforms.
  • Work closely with the entire business far beyond just product or technology, including driving innovation through concept demonstrators and offerings and support the sales activities, from a pre-sales perspective.
  • Ensure solution, hosting and service architectures are subject to robust cost and effort estimation, covering design, development, transition, operation, maintenance and exit costs.


Skills Required


Data Engineering

  • Fluency in one or more of the following languages: SQL, Scala, Python, R, PySpark, Elasticsearch.
  • Data Pipeline Development: Hands-on experience in building data pipelines in AWS, Azure and/or open-source frameworks like Spark, Beam, or Airflow.
  • Experience with real time data streaming frameworks, (e.g. Kafka, Pubsub etc.).
  • Data quality/validation experience: designing metrics and KPIs to verify and automated management of data quality – experience in Purview would be very welcome.
  • Build and optimise data models, ensuring data is structured, accessible, and performant for downstream analytics and machine learning models
  • Good working experience of AWS (e.g. S3, Kinesis, Glue, Redshift, Lambda and EMR) or Azure data services (e.g. ADF, Synapse, Fabric, Azure Functions)
  • Knowledge and experience of Palantir Foundry or Gotham is a major plus.
  • Working experience in Data Lakehouse environments such as Databricks, Snowflake and/or Microsoft Fabric is an advantage.


If any of this piques your interest, please let me know and we can get a call booked in to discuss further


  • Staff Data Engineer

    4 days ago


    London, UK, UK, United Kingdom Data Idols Full time

    Staff Data Engineer Joining one of the best-known retail brands in the UK as a Staff Data Engineer, you will support the delivery of data transformation during an exciting time within the company. They are looking for someone with experience in building and maintaining data pipelines and to collaborate with the wider data teams.The Opportunity For this role...


  • London, UK, UK, United Kingdom Data Idols Full time

    Senior Data Engineer Joining one of the best-known retail brands in the UK as a Senior Data Engineer, you will support the delivery of data transformation during an exciting time within the company. They are looking for someone with experience in building and maintaining data pipelines and to collaborate with the wider data teams.The Opportunity For this...


  • London, UK, UK, United Kingdom Data Idols Full time

    Senior Data Platform Engineer Salary: £80,000 - 90,000 + Bonus and benefitsLocation: London - HybridWe are currently seeking a Senior Data Platform Engineer to join a prestigious retailer that's evolving into a digital-first, data-led organisation. In this role, you'll be pivotal to shaping the data landscape and will work alongside a talented,...

  • Data Scientist

    4 days ago


    London, UK, UK, United Kingdom Data Idols Full time

    Data ScientistSalary: £60k - £80k plus bonus and benefits Location: London - HybridData Idols are proud to partner with a renowned tech giant as they continue to push the boundaries of innovation. We are assisting them in expanding their data capabilities by hiring an experienced and driven Data Scientist. This is a fantastic opportunity to join a...

  • Data Engineer

    4 days ago


    London,, UK, United Kingdom Gravitas Recruitment Group Ltd Full time

    Data Engineer Are you passionate about data engineering and eager to make a real impact in the insurance industry? Join our client's dynamic team as an Azure Data Engineer and help shape their data engineering roadmap to align with critical business priorities. This is your chance to thrive in a growing team, enhance your expertise, and be immersed in...


  • London, UK, UK, United Kingdom Data Idols Full time

    Machine Learning Engineer Salary: £65,000 - £80,0000Location: Central London - 1 day per week in the officeWe are currently recruiting a Machine Learning Engineer to join a global publishing company. Producing high-quality educational resources, they are publishing impactful research that has the power to improve society and empower policy makersThe...

  • Controls Engineer

    2 months ago


    London,, UK, United Kingdom Vantage Data Centers Full time

    About Vantage Data CentersVantage Data Centers is a leading wholesale data center provider in North America with campuses in six strategic markets: Silicon Valley; Northern Virginia; Phoenix, Arizona; Quincy, Washington; Montreal and Quebec City, Canada. Founded in 2010, Vantage has an unceasing commitment to provide major hyperscale, cloud and enterprise...

  • Data Engineer

    4 days ago


    London,, UK, United Kingdom Swoop Recruitment Full time

    An exciting opportunity for an experienced Data Engineer to join the Engineering team working within the Digital & Product Department.Location: Chiswick (West London)Work Type: 3 days in office, 2 day from homeSalary: £60k - £70k dependent on experienceFull time permanent positionThe successful candidate will be responsible for creating the pipelines that...

  • Data Engineer

    2 days ago


    London,, UK, United Kingdom Eden Smith Group Full time

    Data EngineerLondon/hybridSalary up to £75,000 per annumAn exciting opportunity has arisen to join a well known organisation within the media/entertainment space. This company are recognised for their exciting work, superb culture and work/life balance.They are looking for a new Data Engineer (or Senior Data Engineer) with strong experience with AWS, who...

  • Data Engineer

    4 days ago


    London,, UK, United Kingdom Oakwell Hampton Full time

    We are looking for a talented Data Engineer with a strong Python development background to help build an innovative AI-driven accounting product. This role offers the flexibility of freelance work with the potential for a permanent position. Hybrid role with some time in London is preferred.Key Responsibilities:Build, optimize, and maintain scalable data...

  • Data Engineer

    4 days ago


    London,, UK, United Kingdom KDR Talent Solutions Full time

    GCP Data Engineer | £60,000 basic + package | Remote-first | LondonAbout the ClientThis is a chance to join a global business on the ground floor of a brand-new R&D function focused on the cutting edge of Synthetic Data Generation. Be one of the first on board and help shape the future of this exciting initiative!About the RoleWe're looking for a...

  • Data Engineer

    4 days ago


    London,, UK, United Kingdom Movement8 Full time

    Data Engineer - SQL | Snowflake | DBT | Power BIThis is a fantastic opportunity to join an industry leader in the Property Sector as they continue to evolve their Data Engineering division.This is a permanent position, paying up to £65k + bens and offered on a hybrid working basis – 3 days onsite in one of their London offices (Liverpool St, Hammersmith...

  • Data Engineer

    4 weeks ago


    London,, UK, United Kingdom Penna Full time

    Job Title: Data EngineerSalary: £700 Umbrella (6 Months)We are looking for a forward thinking Data Engineer to build a robust Vault 2.0 architecture on Snowflake, to better serve and deliver valuable data products to our customers (internal and end-client).Key Responsibilities:1. Data Vault 2.0 Implementation:o Design and implement Data Vault 2.0...

  • Data Engineer

    2 months ago


    London,, UK, United Kingdom Vallum Associates Full time

    Data Engineer - London - Hybrid - Up to £100,000I am currently working with a Leading Lloyd's Syndicate who are looking for a Data Engineer to build and run the core components of an effective Azure Data, Integration and Analytics/AI Platform. This position is paying up to £100,000 and would be based in the office 2/3 days per week.Duties and...

  • Data Engineer

    2 weeks ago


    London, UK, United Kingdom Macquarie Group Full time

    Our Data Engineering team is at the cutting edge of data management and analytics. By joining us, you will become an integral part of a dynamic team dedicated to innovating and transforming how data is utilised across Macquarie. We focus on designing, implementing, and maintaining scalable data platforms that support our mission-critical analytics and...

  • Data Engineer

    4 weeks ago


    London,, UK, United Kingdom Harnham Full time

    Data Engineer – Music StartupSalary: £70,000Location: Central LondonWFH: 3 days a week in office About Our ClientOur client is transforming the music industry with a platform that combines music streaming and direct-to-fan engagement, creating a transparent and innovative ecosystem.Role OverviewAs a Data Engineer, you’ll design and maintain data...

  • Data Engineer

    4 days ago


    London, UK, UK, United Kingdom Harnham Full time

    DATA ENGINEERLONDON BASED£55,000-65,000 PER ANNUMThis UK-based Music company are searching for a new Data Engineer, you will be joining their product engineering organisation, and will be responsible for building a new data lake in AWS. You will also be responsible for building new data pipelines in python.THE COMPANYThe company is one of the largest in the...

  • Data Engineer

    4 weeks ago


    London,, UK, United Kingdom Harnham Full time

    Data EngineerLocation: London (Wimbeldon)WFH: 1 day a week in office Salary: £75,000About Our ClientOur client is an innovative company revolutionizing the home insurance industry by addressing complex customer needs with cutting-edge technology and outstanding support. They value flexibility through hybrid working and a collaborative, fast-paced...

  • Data Engineer

    2 weeks ago


    London, UK, United Kingdom TwentyAI Full time

    twentyAI is partnering with a leading global insurance company, recognised for its innovative risk solutions across sectors such as marine, professional liability, and trade credit. They are seeking a talented Data Engineer to join their dynamic technology team in London. The company operates across multiple international markets, leveraging cutting-edge...

  • Data Engineer

    4 days ago


    London, UK, UK, United Kingdom Harnham Full time

    Data EngineerLondon office RemoteTHE COMPANYOur client is a leading provider of Travel Insurance products, specializing in innovative solutions for the over-50 market and those with pre-existing medical conditions. With a strong emphasis on leveraging cutting-edge technology and fostering a customer-first approach, they are shaping the future of the...