Data Engineer Technical Design Lead

2 weeks ago

London, United Kingdom MS Amlin Full time

We are looking for a highly skilled and enthusiastic Technical Design Lead to contribute to and oversee the technical aspects of developing MS AISE’s new data landscape in the cloud. In this role you will play a pivotal role in ensuring that the architectural choices, development standards and best practices are followed to deliver a scalable and efficient cloud-based data solution.

The MS AISE Technical Design Lead sit in MS AISE’s Data Engineering team and will report to MS AISE’s Data Engineering Manager. Delivery of the new data landscape will be done in close cooperation with the MS AISE Data Governance & Data Architecture team as well as the MS AISE Reporting & Analytics team which also sits in MS AISE’s Data Function as managed by MS AISE’s Chief Data Officer (CDO).

Key Responsibilities

Architectual Contribution: Contribute to the design and development of a new cloud-based data landscape ensuring alignment with business requirements and scalability needs. Technical Planning: Collaborate with Data Architects, Reporting & Analytics team and business to develop technical plans that align with business requirements and delivery timelines. Development Standards: take responsibility to define and enforce coding standards, best practices and development methodologies to ensure the highest code quality and maintainability. Code Reviews: conduct and participate in code reviews to ensure that the codebase adheres to the technical design, coding standards and quality expectations Performance Optimization: Monitor and optimize the performance of the data infrastructure and pipelines proactively identifying and resolving bottlenecks to maintain optimal data flows. Data Infrastructure: Contribute to the planning and delivery of MS AISE’s new data infrastructure including developments of data pipelines, ETL processes and data storage solutions utilizing cloud based technologies. Data Security and Compliance: Implement and maintain data security measurea to protect sensitive information and ensure compliance with data privacy regulations and organizational policies in close cooperation with the MS AISE Data Engineering Team Manager. Data Governance and Data Quality: ensure data architecture is in line with policies and standards as set by the Data Governance and Data Architecture team, including data quality, data control and data reconciliation reporting Ccontinuous improvement: Stay invormed about emerging technologies, industry trendsand best practices. Advocate for continuous improvement in development processes and technologies. Training and Mentorship: Provide guidance, training and mentorship to team members ensuring they stay current with the latest technologies and methodologies. Documentation: Develop and maintain comprehensive documentation for data engineering processes, architectures and best practices ensuring knowledge sharing within the team and across MS AISE’s Data Function.

Key skills / experience

Minimum 5+ years of experience in Business Intelligence / Reporting Solution design and delivery  Proven experience in a senior development role overseeing technical design aspecs of business intelligence initiatives.  Demonstratable experience with large scale data migration strategies & delivery  Strong experience with with relational data structures, theories, principles and practices  Proven experience with building Data Lake, Delta lake and large scale Data Warehouses Strong experience in implementing large scale data migration / data engineering projects, preferably on Azure  Proficient in Azure Data Factory, Azure Data Lake, Azure DevOps, Azure Databricks, Azure SQL Database, Stream Analytics. Knowledge of Microsoft Fabric is a strong plus  Good knowledge or experience with other Cloud platforms is a strong plus (Google Cloud, Databricks, AWS, Snowflake, etc) Good knowledge of tools associated with data ingestions & data transformations (e.g. SQL, Spark, Python)  Knowledge of insurance market business applications & procedures and/or from an equivalent industry

Competencies

Strong analytical & conceptual mindset Strong teamplayer Ability to prioritise and execute critical deliverables Ability to deliver from start to finish with minimal oversight Pragmatic, self-starter and solution oriented Ability to identify / anticipate problem areas before they occur Strong communication skills Ability to explain complex technical details in simple terms.

  • Lead Data Engineer

    2 days ago

    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Lead Data Engineer - Residential Property Company Location: London (flexible working available) **Salary**: Competitive We are a leading residential property company looking to hire a Lead Data Engineer to join our growing data-focused team. You will be responsible for leading a team of data engineers and playing a key role in the development and...

  • Lead Engineer/Data Engineer

    3 weeks ago

    London, United Kingdom Abs Data Full time

    Lead Data Engineer Do you enjoy creating valuable insights with data? Do you want to play a key role in transforming our firm into an agile organization? Being agile will make us more responsive, more adaptable, and ultimately more innovative. We’re looking for a Data Engineer to: ~ transform data into valuable insights that inform business...

  • Lead Data Engineer

    3 weeks ago

    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **LEAD DATA ENGINEER £70,000 - £75,000 + BENEFITS HYBRID - LONDON OR MAIDENHEAD** Are you a Senior Data Engineer looking for an exciting new role working within a team of likeminded individuals? Do you want to become an integral part of a team working within a betting company? If this is the role you have been searching for read on! **THE...

  • Lead Data Engineer

    3 weeks ago

    City of London, United Kingdom Data Idols Full time

    **Lead Data Engineer** Data Idols are proud to be working with an iconic UK brand to assist them in hiring a Lead Data Engineer as they undertake a digital and data-driven journey that will transform the business. Data is at the heart of the organisation and forms a key part oftheir future plans. **Skills and Experience**: - Awareness and understanding of...

  • Data Engineering Manager

    3 days ago

    London, United Kingdom Data Idols Full time

    **Data Engineering Manager** Data Idols are proud to be working with an iconic UK brand to assist them in hiring a Data Engineering Manager as they undertake a digital and data-driven journey that will transform the business. Data is at the heart of the organisation and forms a keypart of their future plans. **The Opportunity** As a Data Engineering...

  • Lead Data Engineer

    2 weeks ago

    London, United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer.As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...

  • Data Technical Lead

    3 weeks ago

    London, United Kingdom Brown & Brown Europe Full time

    Data Technical Lead Location: Hybrid - London Package: Negotiable + Benefits Brown & Brown, Inc. is one of the largest insurance brokers globally having in excess of $4bn revenue in 2023 by providing risk management solutions to help protect what our customers value most. We have experienced significant growth over the last 5 years both organic and...

  • Data Technical Lead

    3 weeks ago

    London, United Kingdom Brown & Brown Europe Full time

    Data Technical Lead Location: Hybrid - London Package: Negotiable + BenefitsBrown & Brown, Inc. is one of the largest insurance brokers globally having in excess of $4bn revenue in 2023 by providing risk management solutions to help protect what our customers value most. We have experienced significant growth over the last 5 years both organic and inorganic...

  • Data Technical Lead

    3 weeks ago

    London, United Kingdom Brown & Brown Europe Full time

    Data Technical Lead Location: Hybrid - London Package: Negotiable + Benefits Brown & Brown, Inc. is one of the largest insurance brokers globally having in excess of $4bn revenue in 2023 by providing risk management solutions to help protect what our customers value most. We have experienced significant growth over the last 5 years both organic and...

  • Lead Data Engineer

    6 days ago

    London, United Kingdom McGregor Boyall Full time

    **Permanentrole** **£120k - £140k per annum (+ package)** **Hybrid working - home/office split** **The role** As a Lead Data Engineer, you will be a trusted technical authority within the organisation and in charge of a squad of data engineers. As the Lead of the Data Engineering team, your primary responsibility will be defining and enabling a data...

  • Data Technical Lead

    3 weeks ago

    London Area, United Kingdom Brown & Brown Europe Full time

    Data Technical Lead Location: Hybrid - London Package: Negotiable + BenefitsBrown & Brown, Inc. is one of the largest insurance brokers globally having in excess of $4bn revenue in 2023 by providing risk management solutions to help protect what our customers value most. We have experienced significant growth over the last 5 years both organic and inorganic...

  • Data Technical Lead

    3 weeks ago

    London Area, United Kingdom Brown & Brown Europe Full time

    Data Technical Lead Location: Hybrid - London Package: Negotiable + BenefitsBrown & Brown, Inc. is one of the largest insurance brokers globally having in excess of $4bn revenue in 2023 by providing risk management solutions to help protect what our customers value most. We have experienced significant growth over the last 5 years both organic and inorganic...

  • Data Technical Lead

    3 weeks ago

    London Area, United Kingdom Brown & Brown Europe Full time

    Data Technical Lead Location: Hybrid - London Package: Negotiable + BenefitsBrown & Brown, Inc. is one of the largest insurance brokers globally having in excess of $4bn revenue in 2023 by providing risk management solutions to help protect what our customers value most. We have experienced significant growth over the last 5 years both organic and inorganic...

  • Data Technical Lead

    1 week ago

    London Area, United Kingdom Brown & Brown Europe Full time

    Data Technical Lead Location: Hybrid - London Package: Negotiable + Benefits Brown & Brown, Inc. is one of the largest insurance brokers globally having in excess of $4bn revenue in 2023 by providing risk management solutions to help protect what our customers value most. We have experienced significant growth over the last 5 years both organic and...

  • Lead Data Engineer

    2 days ago

    London, Greater London, United Kingdom JR United Kingdom Full time

    Lead Data Engineer (Azure / SQL) London £70k2-3 days per week in officeMy client is looking for a Data Lead to take responsibility for the technical design and implementation of data integration projects using Azure and Integration Services.Core duties will include technical leadership of the team whilst ensuring the overall performance of the solutions...

  • Associate Director of Data Science

    11 hours ago

    London, United Kingdom Data Idols Full time

    **Associate Director of Data Science**: Data Idols are working with a global publishing company to recruit an Associate Director of Data Science. You will be responsible for developing a Data Science competency throughout the organisation that supports the growing library product space. As an Associate Director of Data Science, you will be working closely...

  • Technical Delivery Lead; Data

    6 days ago

    London, United Kingdom first moment Fotografie GmbH Full time

    Technical Delivery Lead - Data Architecture Modernisation project £750-£850/day OUTSIDE IR35 6 months (+++ work) Job Summary: - Working on a large modernisation programme which updates many core systems - many IT services will move to the cloud in SaaS, PaaS and IaaS architectures and points will be amended and created as the technology evolves - to...

  • Senior Engineer, Data Engineering

    4 days ago

    London, United Kingdom Data Idols Full time

    Senior Data Engineer Location: London (Hybrid) Data Idols are working with one of the fast-growing companies in the logistics sector that are making the world a greener place. They are looking for a Senior Data Engineer to join their team within the Data Space. As a Senior Data Engineer, you will work alongside different data teams to design,...

  • Senior Engineer, Data Engineering

    4 days ago

    London, United Kingdom Data Idols Full time

    Senior Data Engineer Location: London (Hybrid) Data Idols are working with one of the fast-growing companies in the logistics sector that are making the world a greener place. They are looking for a Senior Data Engineer to join their team within the Data Space. As a Senior Data Engineer, you will work alongside different data teams to design,...

  • Data Software Engineer | Python

    3 weeks ago

    London, United Kingdom Abs Data Full time

    Regulatory Reporting, Big Data Software Engineer We’re looking for software engineers to: provide technology solutions that will solve business problems and strengthen our position as digital leaders in financial services work with our Regulatory Reporting team to translate business and external regulatory needs using Behavior Driven Development...