Data Engineer
3 weeks ago
Data Engineer - Azure Databricks/ SC Clearance - ContractActive SC Clearance is required for this position Hybrid working - 3 days / week on site required Up to £520 / day - Inside IR35 We are currently recruiting for a well experienced Data Engineer, required for a leading global transformation consultancy, based in London. The Lead Technical Developer will be responsible for providing hands-on, technical expertise within an agile team. The ideal candidate will be well experienced in collaborating with cross-functional teams to deliver digital products. Key skills and responsibilities: Design, build, and maintain scalable ETL pipelines to ingest, transform, and load data from diverse sources (APIs, databases, files) into Azure Databricks.Implement data cleaning, validation, and enrichment using Spark (PySpark/Scala) and related tools to ensure quality and consistency.Utilize Unity Catalog, Delta Lake, Spark SQL, and best practices for Databricks development, optimization, and deployment. Program in SQL, Python, R, YAML, and JavaScript.Integrate data from multiple sources and formats (CSV, JSON, Parquet, Delta) for downstream analytics, dashboards, and reporting.Apply Azure Purview for governance and quality checks. Monitor pipelines, resolve issues, and enhance data quality pr...
-
Data Engineer
1 week ago
London, United Kingdom Data Idols Full time**Data Engineer** Would you like to build enterprise scale data solutions for a global organisation that reaches 400 million users monthly? We are supporting an ambitious data-driven client in the world of Multimedia with their search for a Data Engineer to develop and maintainnew features of their data platform and end-to-end delivery of exciting data...
-
Data Engineer
2 days ago
London, Greater London, United Kingdom Data Idols Full timeData EngineerSalary: £80,00 - £85,000Location: Hybrid - London - 1 day per weekWe are currently looking for a Data Engineer to join our client's forward-thinking, collaborative, and technology-driven team. In this role, you'll take the lead in shaping and delivering modern cloud data solutions, working closely with a highly skilled Data & BI function....
-
Data Engineer
5 days ago
London, United Kingdom Data Idols Full time**Data Engineer** Data Idols are excited to be working with one of the top 100 companies in the world to recruit a Data Engineer! A company which owns multiple brands and who are investing heavily into 'all things data' to revolutionise their extraordinary team. **Skills and Experience**: - Experience with Azure - Experience with SQL - Experience with...
-
Data Engineer
1 week ago
London, United Kingdom Data Idols Full time**Data Engineer** Data Idols are proud to be working with a growing veterinary business who are extremely data driven and have a great mission to use data to improve the welfare of animals. They have a revolutionary data team who want to be recognised as the UK's leadingveterinary group and are home to some of the best clinicians world-wide; would you like...
-
Data Engineer
3 days ago
London, United Kingdom Data Idols Full time**Data Engineer** Data Idols are proud to be working with a leading technology and engineering consultancy who have been running for decades globally. They work with a variety of clients across different industries on their biggest challenges. Would you like to work alongsidethis company, where you get the chance to work across a wide range of tools, tech,...
-
Data Engineer
1 week ago
London, United Kingdom Data Idols Full time**Data Engineer** Are you a contractor seeking a new project where you take ownership of Data Science, ETL pipelines, warehouses and everything else analytics, within an alternative and refreshing industry? Our client are a global fashion marketplace, with a mission to praisecreativity, connect consumers to unique and sustainable products, and support...
-
Data Engineer
3 days ago
Greater London, United Kingdom Data Idols Full timeBase Pay RangeSalary: £80,000 - £85,000Location: Hybrid - London - 1 day per weekOverviewWe are currently looking for a Data Engineer to join our client's forward-thinking, collaborative, and technology-driven team. In this role, you'll take the lead in shaping and delivering modern cloud data solutions, working closely with a highly skilled Data & BI...
-
Lead Data Engineer
2 weeks ago
London, United Kingdom Data Idols Full time**Lead Data Engineer** Are you a Senior or Lead Data Engineer, or perhaps a Data Engineer with more than 4 years experience wanting to up your leadership abilities, and looking for involvement within a nice mix both BAU and greenfield projects? Data Idols are working with a well-known retail company whose brands are certainly well known to households in the...
-
Data Engineering Manager
1 day ago
London, United Kingdom Data Idols Full time**Data Engineering Manager** Data Idols are proud to be working with an iconic UK brand to assist them in hiring a Data Engineering Manager as they undertake a digital and data-driven journey that will transform the business. Data is at the heart of the organisation and forms a keypart of their future plans. **The Opportunity** As a Data Engineering...
-
Senior Data Engineer
2 weeks ago
London, United Kingdom Data Idols Full time**Senior Data Engineer** Would you like to work for a successful start-up in the Healthtech world? They are ready to welcome their first dedicated Senior Data Engineer into their wider tech team of Data Analysts, reporting to their Head of Data, empowering them to own, shape andgrow their data stack and technologies. **The Opportunity** As the Senior Data...