Data Engineer

4 weeks ago

London, United Kingdom MS Amlin Full time

We are looking for a highly skilled and motivated Data Engineer to join our dynamic team. As a Data Engineer you will play an important role in designing, building and maintaining the systems and architecture that enable MS AISE to collect, store and analyze large volumes of data. The ideal candidate is passionate about data, possesses strong analytical skills and has a proven track record of implementing robust and scalable data solutions in the cloud.

As an MS AISE Data Engineer you will reportin into MS AISE’s Data Engineering Team Manager and will work closely with the MS AISE’s Reporting & Analytics team as well as other key stakeholders with a strong interest in data, such as technical pricing, actuarial and finance.

Key Responsibilities

Data architecture design: design and implement scalable and robust data architectures to support MS AISE’s data needs. Collaborate with stakeholders to understand data requirements and translate them into technical specifications. Data Integration: Develop and implement ETL (Extract, Transform, Load) processes to integrate data from various sources into a unified data lake. Ensure data integrity, accuracy and reconciliation throughout the integration process Data Management: Manage and optimize database / datamart design including schema design, indexing and performance tuning as well as data security and access controls to ensure protection of sensitive data. Data Modeling: Create and maintain data models to represent the structure and relationships within the data of MS AISE. Data Pipeline Development: Build and maintain data pipelines to ensure automated collection, processing and storage of data. Monitor and troubleshoot data pipeline issues to ensure smooth and reliable data flow and availability. Collaboration with cross-functional teams: Collaborate with the MS AISE Reporting & Analytics team and other key stakeholders to understand data requirements and contribute to the delivery of solutions that meet business objectives. Documentation: contribute to creating and maintaining comprehensive documenatation for data engineering processes, workflows and data dictionaries. Technological Evaluation: Ensure you stay informed about emerging technologies and evaluate their applicability to the organization’s data architecture and processes.

Key skills / experience

Minimum 3+ years of Experience as a Data Engineer Strong Experience with relational data structures, theories, principles and practices  Strong hands-on experience with SQL Language, data transformation and modelling tools.  Proven experience with building Data Lake, Delta lake and large scale Data Warehouses Strong experience in implementing large scale cloud data architecture using Azure, Synapse, Azure Databricks, Data Fabric etc Proficient in Azure Data Factory, Azure Data Lake, Azure DevOps, Azure Databricks, Azure SQL Database, Stream Analytics. Knowledge of Microsoft Fabric is a strong plus  Good knowledge of tools associated with data ingestions & data transformations (e.g. SQL, Spark, Python)  Good knowledge or experience with Python Programming Language  Good knowledge or experience with other Cloud platforms is a strong plus (Google Cloud, Databricks, AWS, Snowflake, etc) Knowledge of insurance market business applications & procedures and/or from an equivalent industry

Competencies

Strong analytical & conceptual mindset Strong teamplayer Ability to deliver from start to finish with minimal oversight Ability to work in a structured and efficient manner Ability to work in line with standard development framework & practices Pragmatic, self-starter and solution oriented Ability to identify and anticipate on problems early and communicate timely

Good communication skills

  • Data Engineer

    1 month ago

    City of London, United Kingdom Data Idols Full time

    **Senior Data Engineer** Data Idols are proud to be working with an iconic UK brand to assist them in hiring a Senior Data Engineer as they undertake a digital and data-driven journey that will transform the business. Data is at the heart of the organisation and forms a key partof their future plans. **The Opportunity** As a Senior Data Engineer you will be...

  • Senior Engineer, Data Engineering

    3 weeks ago

    London, United Kingdom Data Idols Full time

    Senior Data Engineer Location: London (Hybrid) Data Idols are working with one of the fast-growing companies in the logistics sector that are making the world a greener place. They are looking for a Senior Data Engineer to join their team within the Data Space. As a Senior Data Engineer, you will work alongside different data teams to design,...

  • Senior Engineer, Data Engineering

    3 weeks ago

    London, United Kingdom Data Idols Full time

    Senior Data Engineer Location: London (Hybrid) Data Idols are working with one of the fast-growing companies in the logistics sector that are making the world a greener place. They are looking for a Senior Data Engineer to join their team within the Data Space. As a Senior Data Engineer, you will work alongside different data teams to design,...

  • Senior Engineer, Data Engineering

    2 days ago

    London, United Kingdom Data Idols Full time

    Job Description Senior Data Engineer Location: London (Hybrid) Data Idols are working with one of the fast-growing companies in the logistics sector that are making the world a greener place. They are looking for a Senior Data Engineer to join their team within the Data Space. As a Senior Data Engineer, you will work alongside different data teams to...

  • Gcp Data Engineer

    1 month ago

    London, United Kingdom Data Idols Full time

    **GCP Data Engineer** Would you like to build enterprise scale data solutions for a global organisation that reaches 400 million users monthly? As a GCP Data Engineer, you will be involved in delivering solutions from initial concept to production. **The Opportunity** Working for a well known brand you will be responsible for all aspects of the data...

  • Lead Engineer/Data Engineer

    1 month ago

    London, United Kingdom Abs Data Full time

    Lead Data Engineer Do you enjoy creating valuable insights with data? Do you want to play a key role in transforming our firm into an agile organization? Being agile will make us more responsive, more adaptable, and ultimately more innovative. We’re looking for a Data Engineer to: ~ transform data into valuable insights that inform business...

  • Lead Data Engineer

    1 month ago

    City of London, United Kingdom Data Idols Full time

    **Lead Data Engineer** Data Idols are proud to be working with an iconic UK brand to assist them in hiring a Lead Data Engineer as they undertake a digital and data-driven journey that will transform the business. Data is at the heart of the organisation and forms a key part oftheir future plans. **Skills and Experience**: - Awareness and understanding of...

  • Data Software Engineer | Python

    1 month ago

    London, United Kingdom Abs Data Full time

    Regulatory Reporting, Big Data Software Engineer We’re looking for software engineers to: provide technology solutions that will solve business problems and strengthen our position as digital leaders in financial services work with our Regulatory Reporting team to translate business and external regulatory needs using Behavior Driven Development...

  • Data Engineer

    4 weeks ago

    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **DATA ENGINEERING £70,000 - £80,000 + BONUS FLEXIBLE - LONDON** Are you a Data Engineer with a strong background in Data Engineering supporting the Data Analytics and Data Science team? Want to become part of a growing insurance company going through some exciting new changes? Read on! **THE COMPANY**: Harnham is partnered with an exciting insurance...

  • Data Engineer

    4 weeks ago

    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    DATA ENGINEER **Salary: £50,000 - £70,000** **LONDON** This is an extremely technically driven company offering many benefits. They are data-driven and are situated globally, streaming, and using data to best help their customer. **THE COMPANY** This global data company is heavily driven by Data and Analytics and is looking for a Data Engineer to...

  • Data Engineering Lead Engineer

    2 weeks ago

    London, United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer. As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...

  • Data Engineer

    1 month ago

    London, United Kingdom Open Data Science Conferenc Full time

    You have prior experience as a data engineer, software engineer, or data architect. You are experienced in designing and production of solutions for complex problems. You thrive in a fast-paced, start-up environment. You seek to continuously improve processes and find the most optimal way to solve problems. You can work remotely and independently,...

  • Data Engineer

    1 month ago

    London, United Kingdom Abs Data Full time

    Data Engineer/Analyst Risk & Margin We’re looking for a software engineer to: provide technology solutions that will solve business problems in the Risk and Margin space work with risk managers to translate business needs using Behavior Driven Development (BDD) into functional requirements. Key to success will be the ability to understand the data...

  • Senior Engineer, Data Engineering

    1 month ago

    London, United Kingdom Open Data Science Conferenc Full time

    You have prior experience as a data engineer, software engineer, or data architect. You can work remotely and independently, taking ownership of your work. You have proven English language communication skills that enable you to collaborate in a remote-first company with a diverse international workforce. Experience with Java11+ for ingesting,...

  • Java Data Engineer

    1 month ago

    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **DATA ENGINEER £70,000 - £80,000 + BONUS REMOTE** Are you a Data Engineer with a strong background in Data Engineering looking for an exciting challenge? Want to become part of an exciting start-up in the telecoms industry as a Data Engineer? Read on! **THE COMPANY**: Harnham has partnered with an exciting Start-Up who thanks to their success, are...

  • Lead Data Engineer

    1 month ago

    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **LEAD DATA ENGINEER** **£100,000 - £110,000 + EQUITY** **LONDON - HYBRID** This role is with a rapidly growing FinTech Scale up who are looking to build out their data engineering team. They are looking to hire a Lead Data Engineer to work closely with the Engineering Manager and Architects to take their data platform & capabilityto the next...

  • Principal Data Engineer

    1 month ago

    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **MID-LEVEL DATA ENGINEER** **£60,000 - £70,000 + BENEFITS** **LONDON (FLEXI-WORKING)** Are you a Data Engineer looking for an exciting challenge? Want to become a pivotal part of a globally recognised insurance company? If becoming a Principal Data Engineer is the role you have been looking for, read on to discover more. **THE COMPANY**: Harnham is...

  • Lead Data Engineer

    1 month ago

    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **LEAD DATA ENGINEER £70,000 - £75,000 + BENEFITS HYBRID - LONDON OR MAIDENHEAD** Are you a Senior Data Engineer looking for an exciting new role working within a team of likeminded individuals? Do you want to become an integral part of a team working within a betting company? If this is the role you have been searching for read on! **THE...

  • Senior Data Engineer

    4 weeks ago

    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **DATA ENGINEER** **SALARY: £70,000 - £85,000** **LONDON** Are you looking to work within the Advertising Industry, this company is looking for skilled data engineers that can help drive the business to new heights. Allowing this individual to have massive influence and ownership on the technical direction. **THE COMPANY** This company is extremely...

  • Senior Data Engineer

    1 month ago

    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **SENIOR DATA ENGINEER** **LONDON BASED** **£90,000-100,000 PER ANNUM** This UK-based Fintech are searching for a new Senior Data Engineer to help architect and build a new data platform in AWS. You will also be responsible for liaising with stakeholders and influencing future business decisions. **THE COMPANY** This growing UK-based Fintech company...