Senior/Lead Data Engineer
1 month ago
Job Description: Lead Data Engineer Location: Central London (Hybrid: 2 days per week onsite.)
£My Client is a leading financial organisation committed to leveraging cutting-edge technology and data-driven insights to empower stakeholders and drive innovation within the industry. As they continue to expand their data capabilities, they are seeking a skilled Lead Data Engineer to spearhead the development and implementation of their data platform whilst also advising and consulting on legacy data migrations from on-prem to the cloud to increase carbon neutrality.
As a Lead Data Engineer, you will play a pivotal role in designing, building, and maintaining their data infrastructure while collaborating closely with senior stakeholders across the organisation. Your expertise in Azure, Databricks, Spark, Python, and data modelling will be critical in driving the success of their data initiatives.
Lead the complete development cycle of data engineering projects, maintaining anonymity from conceptualisation through deployment to ensure scalability and top-notch quality.
Leverage internal data platforms to translate data into actionable insights, driving informed business decisions through adept application of analytical methods.
Employ data engineering techniques to automate manual processes, tackling complex business challenges and enhancing efficiency.
Enforce adherence to digital principles, ensuring the integrity, security, and compliance of solutions while meeting both functional and non-functional requirements.
Embed observability into solutions, monitoring production performance, resolving incidents, and addressing underlying risks and issues.
Influence the Data and Distribution architecture and technology stack within cloud-based infrastructure, serving as a hands-on lead in the realm of big data and data lakes.
A comprehensive of data modelling, data warehousing principles, and the innovative Lakehouse architecture.
Exceptional proficiency in ETL methodologies, preferably utilising Azure Databricks or equivalent technologies (Spark, Spark SQL, Python, SQL), including deep insight into ETL/ELT design patterns.
Proficient in Databricks, SQL, and Python, with a robust understanding of software development life cycles.
Familiarity with columnar and/or time series data design patterns, as well as performance optimisation techniques.
Sound understanding of Infrastructure as Code and scripting languages.
Awareness of Information Security principles to ensure the secure handling and governance of data.
Thorough understanding of Information Security principles for ensuring compliant data management.
Hands-on experience with Agile methodologies (SCRUM, Kanban).
Proven track record as a collaborative team player with exceptional leadership qualities, capable of working across business units, teams, and geographical regions.
-
Senior Data Engineer
1 month ago
London, United Kingdom Data Idols Full time**Senior Data Engineer** Data Idols are proud to be working with a leading technology and engineering consultancy who have been running for decades globally. They work with a variety of clients across different industries on their biggest challenges. Would you like to work alongsidethis company, where you get the chance to work across a wide range of tools,...
-
Senior Data Engineer
1 month ago
London, United Kingdom Data Idols Full time**Senior Data Engineer** Data Idols are excited to be working with a well-funded startup who are moving into their scale-up phase. We are working to recruit the first Data Engineer, you will be involved in architecting and building their greenfield data platform. In this excitingand dynamic role, you will be involved from the very beginning, selecting the...
-
Senior Engineer, Data Engineering
1 month ago
London, United Kingdom Data Idols Full timeSenior Data Engineer Location: London (Hybrid) Data Idols are working with one of the fast-growing companies in the logistics sector that are making the world a greener place. They are looking for a Senior Data Engineer to join their team within the Data Space. As a Senior Data Engineer, you will work alongside different data teams to design,...
-
Senior Engineer, Data Engineering
1 month ago
London, United Kingdom Data Idols Full timeSenior Data Engineer Location: London (Hybrid) Data Idols are working with one of the fast-growing companies in the logistics sector that are making the world a greener place. They are looking for a Senior Data Engineer to join their team within the Data Space. As a Senior Data Engineer, you will work alongside different data teams to design,...
-
Senior Engineer, Data Engineering
3 weeks ago
London, United Kingdom Data Idols Full timeJob Description Senior Data Engineer Location: London (Hybrid) Data Idols are working with one of the fast-growing companies in the logistics sector that are making the world a greener place. They are looking for a Senior Data Engineer to join their team within the Data Space. As a Senior Data Engineer, you will work alongside different data teams to...
-
Senior Data Engineer
1 month ago
London, United Kingdom Data Idols Full time**Senior Data Engineer** Data Idols are proud to be working with a company who has a mission to improve the lives of learners globally, who want to build a more sustainable future everyone can reach their potential in. Do you want to be a part of a change into the sustainable future? **The Opportunity** Within this role as a Senior Data Engineer you will be...
-
Lead Data Engineer
2 months ago
London, United Kingdom Harnham - Data & Analytics Recruitment Full time**LEAD DATA ENGINEER £70,000 - £75,000 + BENEFITS HYBRID - LONDON OR MAIDENHEAD** Are you a Senior Data Engineer looking for an exciting new role working within a team of likeminded individuals? Do you want to become an integral part of a team working within a betting company? If this is the role you have been searching for read on! **THE...
-
Lead Data Engineer
2 months ago
City of London, United Kingdom Data Idols Full time**Lead Data Engineer** Data Idols are proud to be working with an iconic UK brand to assist them in hiring a Lead Data Engineer as they undertake a digital and data-driven journey that will transform the business. Data is at the heart of the organisation and forms a key part oftheir future plans. **Skills and Experience**: - Awareness and understanding of...
-
Senior Engineer, Data Engineering
2 months ago
London, United Kingdom Data Idols Full timeSenior Data Engineer Location: London, 3/2 days in the office per week Data Idols are currently working with a company that focus on the european marketplace for transport who are looking to make the future greener! Within this role as a Senior Data Engineer, you will be monitoring, designing and implementing a datawarehouse, whilst working with...
-
Senior Engineer, Data Engineering
2 months ago
London, United Kingdom Data Idols Full timeSenior Data Engineer Location: London, 3/2 days in the office per week Data Idols are currently working with a company that focus on the european marketplace for transport who are looking to make the future greener! Within this role as a Senior Data Engineer, you will be monitoring, designing and implementing a datawarehouse, whilst working with...
-
Lead Data Engineer
5 days ago
London, United Kingdom Harnham - Data & Analytics Recruitment Full time**DATA ENGINEER - SENIOR MANAGER** **UP TO £95,000 + BENEFITS** **LONDON, CURRENTLY FLEXIBLE / REMOTE / HOME WORKING** I am currently recruiting for a Data Engineer Lead with a very exciting airline company looking to build out its legacy system into Data Bricks. This is a role that will offer opportunities to work with operations, corporate, and the data...
-
Lead Engineer/Data Engineer
6 days ago
London, United Kingdom Abs Data Full timeLead Data Engineer Do you enjoy creating valuable insights with data? Do you want to play a key role in transforming our firm into an agile organization? Being agile will make us more responsive, more adaptable, and ultimately more innovative. We’re looking for a Data Engineer to: ~ transform data into valuable insights that inform business...
-
Lead Engineer/Data Engineer
2 months ago
London, United Kingdom Abs Data Full timeLead Data Engineer Do you enjoy creating valuable insights with data? Do you want to play a key role in transforming our firm into an agile organization? Being agile will make us more responsive, more adaptable, and ultimately more innovative. We’re looking for a Data Engineer to: ~ transform data into valuable insights that inform business...
-
Senior Data Engineer
4 weeks ago
London, United Kingdom Harnham - Data & Analytics Recruitment Full time**SENIOR DATA ENGINEER** **£75,000 - £80,000** **HYBRID WORKING - LONDON** Join a dynamic and forward-thinking charity organization as a Senior Data Engineer! We are seeking a highly motivated and experienced data engineer to lead the development of our data architecture and drive insights from complex data sets. This is a critical role within the...
-
Senior Data Engineer
1 day ago
London, United Kingdom Harnham - Data & Analytics Recruitment Full time**SENIOR DATA ENGINEER** **£75,000 - £80,000** **HYBRID WORKING - LONDON** Join a dynamic and forward-thinking charity organization as a Senior Data Engineer! We are seeking a highly motivated and experienced data engineer to lead the development of our data architecture and drive insights from complex data sets. This is a critical role within the...
-
Senior Engineer, Data Engineering
23 hours ago
London, United Kingdom Data Science Festival Full time €70,000 - €85,000Senior Data Engineer Location: London, 3/2 days in the office per week Data Idols are currently working with a company that focus on the european marketplace for transport who are looking to make the future greener! Within this role as a Senior Data Engineer, you will be monitoring, designing and implementing a datawarehouse, whilst working with...
-
Senior Engineer, Data Engineering
21 hours ago
London, United Kingdom Data Science Festival Full time €70,000 - €85,000Senior Data Engineer Location: London, 3/2 days in the office per week Data Idols are currently working with a company that focus on the european marketplace for transport who are looking to make the future greener! Within this role as a Senior Data Engineer, you will be monitoring, designing and implementing a datawarehouse, whilst working with...
-
Senior Data Science Lead
6 days ago
London, United Kingdom Open Data Science Conferenc Full time €120,000 - €140,000We’re here to create the world’s most compelling financial data products. The products we’re building are used by some of the world’s most prestigious institutions to help millions of their customers take control of their finances. The role of Technical Lead for Data is responsible for managing the technical execution that allows us to achieve that...
-
Senior Data Science Lead
1 day ago
London, United Kingdom Open Data Science Conferenc Full time €120,000 - €140,000We’re here to create the world’s most compelling financial data products. The products we’re building are used by some of the world’s most prestigious institutions to help millions of their customers take control of their finances. The role of Technical Lead for Data is responsible for managing the technical execution that allows us to achieve that...
-
Senior Data Science Lead
1 day ago
London, United Kingdom Open Data Science Conferenc Full time €120,000 - €140,000We’re here to create the world’s most compelling financial data products. The products we’re building are used by some of the world’s most prestigious institutions to help millions of their customers take control of their finances. The role of Technical Lead for Data is responsible for managing the technical execution that allows us to achieve that...
