Data Engineering Team Manager

2 weeks ago


London, United Kingdom MS Amlin Full time

We are seeking a seasoned and results-driven Data Engineering Team Manager to lead our dynamic team of Data Engineers in the design, construction and maintenance of MS AISE’s Cloud based Data Lake solution. As the Data Engineering Manager you will play a pivotal role in overseeing the migration of MS AISE’s current Data Warehouse environment to the cloud as well as the development and optimization of MS AISE’s new Cloud based data infrastructure ensuring seamless data flows of as well structured data as unstructured data. In addition you will be responsible for managing outsourcing partners to efficiently handle MS AISE’s IT infrastructure in the cloud.

The MS AISE Data Engineering Team Manager will report into MS AISE’s Chief Data Officer (CDO) and will work in close cooperation with the Data Governance & Data Architecture team as well as the Data Reporting & Analytics Team.

Key Responsibilities

Team leadership: Lead and inspire a high-performing team of data engineers and administrators, providing guidance, mentorship and fostering a collaborative and innovative team culture. Cloud based Data Lake Solution: Oversee the end-to-end design, development and maintenance of a robust Cloud based Data Lake ensuring scalability, performance and alignment with business strategy and objectives. Data Infrastructure: Lead the planning and delivery of MS AISE’s new data infrastructure including developments of data pipelines, ETL processes and data storage solutions utilizing cloud based technologies. Performance Optimization: Monitor and optimize the performance and costs of the data infrastructure and pipelines proactively identifying and resolving bottlenecks to maintain optimal data flow against minimum costs. Manage Outsourcing Partners: Manage the relationship with outsourcing partners responsible for MS AISE IT Data & Analytics infrastructure in the cloud in cooperation with MS AISE’s IT organisation. Ensure effective collaboration, adherence to service-level agreements and drive continuous improvement initiatives. Planning and Coordination: Collaborate with the Data Reporting & Analytics team to ensure delivery plans are realistic, resource requirements are made available and execution is in line with plan. Data Security and Compliance: Collaborate MS AISE’s CISO and MS AISE’s Data Privacy Officer (DPO) to ensure MS AISE’s data cloud solution is in line with data security standards and GDPR regulation to safeguard sensitive information on the one hand and ensure compliance with data privacy regulations on the other hand. Data Governance and Data Quality: ensure data architecture is in line with policies and standards as set by the Data Governance and Data Architecture team, including data quality, data control and data reconciliation reporting Training and Development: Identify training needs within the team and facilitate professional development opportunities. Stay current on emerging technologies and industry best practices. Documentation: Develop and maintain comprehensive documentation for data engineering processes, architectures and best practices ensuring knowledge sharing within the team and across MS AISE’s Data Function. Strategic Planning: Contribute to the development of MS AISE’s Data Strategy and roadmap in cooperation with MS AISE’s Chief Data Officer (CDO).

Key skills / experience

Minimum 8+ years Experience in Business Intelligence / Reporting Solution design and delivery Proven experience in a leadership role overseeing business intelligence and analytics teams. Strong experience with relational data structures, theories, principles and practices Good understanding Data Lake and Data Warehousing Methodologies Good understanding or experience with Cloud Technologies (Azure, Google Cloud, Synapse, DataBricks, AWS, Snowflake, etc) Experience in Business Intelligence Tooling (Power BI, Tableau, Qlik, etc) Knowledge of insurance market business applications & procedures and/or from an equivalent industry Proven track record of successfully delivering large scale BI and/or analytics solutions. Demonstratable experience with large scale data migration strategies & delivery Strong understanding of Data Governance and Data Management (DCAM) Track record of delivering results against tight timelines in an ambiguous environment Consulting experience to support multiple projects

Competencies

Strategic and analytical mindset Ability to prioritise and execute critical deliverables Ability to deliver from start to finish with minimal oversight Pragmatic, self-starter and solution oriented Ability to identify / anticipate problem areas before they occur Ability to build and maintain strong working relationships with senior stakeholders Strong communication and presentation skills Ability to explain complex technical details in simple terms.

  • London, United Kingdom Data Idols Full time

    **Data Engineering Manager** Data Idols are proud to be working with an iconic UK brand to assist them in hiring a Data Engineering Manager as they undertake a digital and data-driven journey that will transform the business. Data is at the heart of the organisation and forms a keypart of their future plans. **The Opportunity** As a Data Engineering...

  • Data Engineer

    7 days ago


    London, United Kingdom Data Idols Full time

    **Data Engineer** Data Idols are excited to be working with one of the top 100 companies in the world to recruit a Data Engineer! A company which owns multiple brands and who are investing heavily into 'all things data' to revolutionise their extraordinary team. **Skills and Experience**: - Experience with Azure - Experience with SQL - Experience with...


  • London, United Kingdom Abs Data Full time

    Lead Data Engineer Do you enjoy creating valuable insights with data? Do you want to play a key role in transforming our firm into an agile organization? Being agile will make us more responsive, more adaptable, and ultimately more innovative. We’re looking for a Data Engineer to: ~ transform data into valuable insights that inform business...


  • London, United Kingdom Data Idols Full time

    Senior Data Engineer Location: London (Hybrid) Data Idols are working with one of the fast-growing companies in the logistics sector that are making the world a greener place. They are looking for a Senior Data Engineer to join their team within the Data Space. As a Senior Data Engineer, you will work alongside different data teams to design,...


  • London, United Kingdom Data Idols Full time

    Senior Data Engineer Location: London (Hybrid) Data Idols are working with one of the fast-growing companies in the logistics sector that are making the world a greener place. They are looking for a Senior Data Engineer to join their team within the Data Space. As a Senior Data Engineer, you will work alongside different data teams to design,...

  • Data Engineer

    3 weeks ago


    City of London, United Kingdom Data Idols Full time

    **Senior Data Engineer** Data Idols are proud to be working with an iconic UK brand to assist them in hiring a Senior Data Engineer as they undertake a digital and data-driven journey that will transform the business. Data is at the heart of the organisation and forms a key partof their future plans. **The Opportunity** As a Senior Data Engineer you will be...


  • London, United Kingdom Data Idols Full time

    **Senior Data Engineer** If you're a Senior Data Engineer seeking a meaningful new contract opportunity, look no further. We are working with a fast-growing digital HealthTech company, saving the NHS millions per year, and are radically transforming the delivery of health servicesto make healthcare work for patients, doctors and other healthcare...

  • Data Engineer

    6 days ago


    London, United Kingdom Data Idols Full time

    **Data Engineer** Data Idols are proud to be working with a leading technology and engineering consultancy who have been running for decades globally. They work with a variety of clients across different industries on their biggest challenges. Would you like to work alongsidethis company, where you get the chance to work across a wide range of tools, tech,...


  • London, United Kingdom Data Idols Full time

    **Senior Data Engineer** Data Idols are excited to be working with a well-funded startup who are moving into their scale-up phase. We are working to recruit the first Data Engineer, you will be involved in architecting and building their greenfield data platform. In this excitingand dynamic role, you will be involved from the very beginning, selecting the...


  • London, United Kingdom Data Idols Full time

    **Senior Data Engineer** Data Idols are working with a very exciting FinTech who are looking for a Senior Data Engineer to join their Data Team. This role will initially be remote but as restrictions ease the role will be based in their central London office. **THE ROLE** Within this role as a Senior Data Engineer you will be working to help build a...


  • London, United Kingdom Data Idols Full time

    **Senior Data Engineer** Data Idols are proud to be working with a leading technology and engineering consultancy who have been running for decades globally. They work with a variety of clients across different industries on their biggest challenges. Would you like to work alongsidethis company, where you get the chance to work across a wide range of tools,...


  • London, United Kingdom Data Idols Full time

    Senior Data Engineer Location: London, 3/2 days in the office per week Data Idols are currently working with a company that focus on the european marketplace for transport who are looking to make the future greener! Within this role as a Senior Data Engineer, you will be monitoring, designing and implementing a datawarehouse, whilst working with...


  • London, United Kingdom Data Idols Full time

    Senior Data Engineer Location: London, 3/2 days in the office per week Data Idols are currently working with a company that focus on the european marketplace for transport who are looking to make the future greener! Within this role as a Senior Data Engineer, you will be monitoring, designing and implementing a datawarehouse, whilst working with...


  • London, United Kingdom Abs Data Full time

    Regulatory Reporting, Big Data Software Engineer We’re looking for software engineers to: provide technology solutions that will solve business problems and strengthen our position as digital leaders in financial services work with our Regulatory Reporting team to translate business and external regulatory needs using Behavior Driven Development...

  • Data Engineer

    3 days ago


    City of London, United Kingdom Data Idols Full time

    **Data Engineer - Biotechnology** Data Idols are working with an exciting and innovative biotechnology startup who are working to assist biopharma teams to find better medicines and drugs quicker and more efficiently. **The Opportunity** This is an opportunity for a Data Engineer to join a small team and have a big impact. As a Data Engineer you will...

  • Lead Data Engineer

    3 weeks ago


    City of London, United Kingdom Data Idols Full time

    **Lead Data Engineer** Data Idols are proud to be working with an iconic UK brand to assist them in hiring a Lead Data Engineer as they undertake a digital and data-driven journey that will transform the business. Data is at the heart of the organisation and forms a key part oftheir future plans. **Skills and Experience**: - Awareness and understanding of...

  • Data Engineer

    3 weeks ago


    London, United Kingdom Abs Data Full time

    Data Engineer/Analyst Risk & Margin We’re looking for a software engineer to: provide technology solutions that will solve business problems in the Risk and Margin space work with risk managers to translate business needs using Behavior Driven Development (BDD) into functional requirements. Key to success will be the ability to understand the data...


  • London, United Kingdom Abs Data Full time

    Data Science Manager, Operations For too long, banking has been obtuse, complex and opaque. We want to change that and build a bank with everyone, for everyone. Our amazing community suggests features, test the app and give us constant feedback so we can build something everyone loves. We’re focused on solving problems, rather than selling financial...

  • Lead Data Engineer

    2 days ago


    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Lead Data Engineer - Residential Property Company Location: London (flexible working available) **Salary**: Competitive We are a leading residential property company looking to hire a Lead Data Engineer to join our growing data-focused team. You will be responsible for leading a team of data engineers and playing a key role in the development and...

  • Aws Data Engineer

    3 days ago


    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **AWS Data Engineer** **£450 - 550 a day, Inside IR35.** **Hybrid role, 2 days a week on-site. London office.** **6-Month Contract, potential to keep rolling** Fantastic opportunity to join an oil and gas company is an expanding team. You will join the business as an AWS Data Engineer playing a major role in a migration project that is ongoing, helping...