Senior Engineer, Data Engineering

2 weeks ago

London, United Kingdom Aventum Group Full time

Job Title - Data Engineer Entity - Aventum
Reports to - Head of Data
Location - London/Hybrid

A family that dreams big and always works together to make insurance better. We offer our employees a unique benefits package that includes personal training sessions, well-being provisions, and an additional day off for your birthday You will work in various settings to build systems that collect, manage, and convert raw data into usable information for data scientists and business analysts to interpret. Your ultimate goal is to make data accessible so that Aventum stakeholders can use it to evaluate and optimise their performance.

Technical and business processes are used to combine data from multiple sources to provide a unified, single view of the data. Partly responsible for accessing, validating, and querying data from various repositories using available tools. Build and maintain data integration processes using SQL Services and other ETL / ELT processes and scripting tools as well as ongoing requests and projects related to the data warehouse, MI, or fast-moving financial data.
Designing the infrastructure/architecture of the big data platform.
Evaluating, comparing and improving the different approaches including design patterns innovation, data lifecycle design, data ontology alignment, annotated datasets, and elastic search approaches
Developing, creating and maintaining a reliable data pipeline and schemas that feed other data processes; includes both technical processes and business logic to transform data from disparate sources into cohesive meaningful and valuable data with quality, governance and compliance considerations.
Customising and managing integration tools, databases, warehouses, and analytical systems.
Design and implement the management, monitoring, security, and privacy of data using the full stack of Azure data services to satisfy business needs.
Ensuring non-functional system characteristics such as such as security, maintainability, quality, performance, and reliability are captured, prioritized, and incorporated into products.
Leverage Agile, CI / CD and DevOps methodologies to deliver high-quality products on time.
Architecting, building, testing, and maintaining data platform. Develop and support a wide range of data transformations and migrations for the whole business.
Design and implement data pipelines, data marts and schemas, access versatile data sources and apply data quality measures.
Monitoring the complete process and applying necessary infrastructure changes to speed up the query execution and analyse data more efficiently; this includes Database optimisation techniques (data partitioning, database indexing and denormalisation) & efficient data ingestion (data mining techniques and different data ingestion APIs).
Responding to errors and alerts to correct and re-process data. Investigate data mismatches and apply solutions. Data scrubbing and analysis to troubleshoot data integration issues and determine root cause.
Bachelor’s degree or equivalent in an engineering/numerate subject (e.g. Engineering, Stats, Maths, Computer Sciences)
Experience in full-stack development and applying it to build science products (E.g. could include some or all Python/R, Linux scripting, SQL, Docker coupled with front ends such as Javascript)
Some experience as a developer building data pipelines and schemas, with data WH implementation, with SQL database development
Stored Procedures, ADF, NoSQL Databases, JSON/XML data formats)
Hands-on experience with Azure Functions, Azure service bus, Azure Data Factory data integration techniques
Knowledge of Data Modelling concepts, monitoring, designs and techniques
Knowledge of Data Warehouse project lifecycle, tools, technologies, and best practices
Experience using Cloud Computing platforms (ADLS Gen2), Microsoft Stack (Synapse, DataBricks, Fabric, Profisee), Snowflake Data Integration, Azure Service Bus, Deltalake, BigQuery, Azure DevOps, Azure Monitor, Azure Data Factory, SQL Server, Azure DataLake Storage, Azure App Service, Apache Airflow, Apache Iceberg, Apache Spark, Apache Hudi, Apache Kafka, Power BI, BigQuery, Azure ML is a plus
Experience with Azure SQL Database, Cosmos DB, NoSQL, MongoDB
Experience with Agile, DevOps methodologies
Awareness and knowledge of ELT/ETL, DWH, APIs (RESTful), Spark APIs, FTP protocols, SSL, SFTP, PKI (Public Key Infrastructure) and Integration testing

Knowledge of Python, SQL, SSIS, and Spark languages.
Demonstrative ability to develop complex SQL queries and Stored Procedures
Relationship-building and stakeholder management

We value applicants from all backgrounds and foster a culture of inclusivity. We understand the need for flexibility, so work in a hybrid model.

  • Senior Engineer, Data Engineering

    2 weeks ago

    London, United Kingdom Data Idols Full time

    Senior Data Engineer Location: London (Hybrid) Data Idols are working with one of the fast-growing companies in the logistics sector that are making the world a greener place. They are looking for a Senior Data Engineer to join their team within the Data Space. As a Senior Data Engineer, you will work alongside different data teams to design,...

  • Senior Engineer, Data Engineering

    2 weeks ago

    London, United Kingdom Data Idols Full time

    Senior Data Engineer Location: London (Hybrid) Data Idols are working with one of the fast-growing companies in the logistics sector that are making the world a greener place. They are looking for a Senior Data Engineer to join their team within the Data Space. As a Senior Data Engineer, you will work alongside different data teams to design,...

  • Data Engineer

    4 weeks ago

    City of London, United Kingdom Data Idols Full time

    **Senior Data Engineer** Data Idols are proud to be working with an iconic UK brand to assist them in hiring a Senior Data Engineer as they undertake a digital and data-driven journey that will transform the business. Data is at the heart of the organisation and forms a key partof their future plans. **The Opportunity** As a Senior Data Engineer you will be...

  • Senior Data Engineer

    4 weeks ago

    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **SENIOR DATA ENGINEER** **LONDON BASED** **£90,000-100,000 PER ANNUM** This UK-based Fintech are searching for a new Senior Data Engineer to help architect and build a new data platform in AWS. You will also be responsible for liaising with stakeholders and influencing future business decisions. **THE COMPANY** This growing UK-based Fintech company...

  • Lead Engineer/Data Engineer

    4 weeks ago

    London, United Kingdom Abs Data Full time

    Lead Data Engineer Do you enjoy creating valuable insights with data? Do you want to play a key role in transforming our firm into an agile organization? Being agile will make us more responsive, more adaptable, and ultimately more innovative. We’re looking for a Data Engineer to: ~ transform data into valuable insights that inform business...

  • Senior Engineer, Data Engineering

    4 weeks ago

    London, United Kingdom Open Data Science Conferenc Full time

    You have prior experience as a data engineer, software engineer, or data architect. You can work remotely and independently, taking ownership of your work. You have proven English language communication skills that enable you to collaborate in a remote-first company with a diverse international workforce. Experience with Java11+ for ingesting,...

  • Gcp Data Engineer

    4 weeks ago

    London, United Kingdom Data Idols Full time

    **GCP Data Engineer** Would you like to build enterprise scale data solutions for a global organisation that reaches 400 million users monthly? As a GCP Data Engineer, you will be involved in delivering solutions from initial concept to production. **The Opportunity** Working for a well known brand you will be responsible for all aspects of the data...

  • Java Data Engineer

    1 month ago

    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **DATA ENGINEER £70,000 - £80,000 + BONUS REMOTE** Are you a Data Engineer with a strong background in Data Engineering looking for an exciting challenge? Want to become part of an exciting start-up in the telecoms industry as a Data Engineer? Read on! **THE COMPANY**: Harnham has partnered with an exciting Start-Up who thanks to their success, are...

  • Lead Data Engineer

    4 weeks ago

    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **LEAD DATA ENGINEER £70,000 - £75,000 + BENEFITS HYBRID - LONDON OR MAIDENHEAD** Are you a Senior Data Engineer looking for an exciting new role working within a team of likeminded individuals? Do you want to become an integral part of a team working within a betting company? If this is the role you have been searching for read on! **THE...

  • Lead Data Engineer

    4 weeks ago

    City of London, United Kingdom Data Idols Full time

    **Lead Data Engineer** Data Idols are proud to be working with an iconic UK brand to assist them in hiring a Lead Data Engineer as they undertake a digital and data-driven journey that will transform the business. Data is at the heart of the organisation and forms a key part oftheir future plans. **Skills and Experience**: - Awareness and understanding of...

  • Senior Consultant

    3 weeks ago

    London, United Kingdom Data Idols Full time

    Senior Analytics Consultant Brighton - Hybrid/Remote Data Idols are working with a Google Cloud Consultancy that helps organisations transform their data analytics functions using modern technologies. With clients across the globe, they are looking for a Senior Analytics Consultant to join their expanding team. As a Senior Analytics Consultant, you...

  • Senior Consultant

    3 weeks ago

    London, United Kingdom Data Idols Full time

    Senior Analytics Consultant Brighton - Hybrid/Remote Data Idols are working with a Google Cloud Consultancy that helps organisations transform their data analytics functions using modern technologies. With clients across the globe, they are looking for a Senior Analytics Consultant to join their expanding team. As a Senior Analytics Consultant, you...

  • Senior Engineer, Data Engineering

    4 days ago

    London, United Kingdom Harnham Full time

    SENIOR DATA ENGINEER LONDON, CURRENTLY FLEXIBLE / REMOTE / HOMEWORKING As a Senior Data Engineer, you will be working on an AWS data platform for a successful AI company that has disrupted the market with its product line. It has only been in the last few years that this company has invested in their data function which has massively impacted the...

  • Senior Engineer, Data Engineering

    6 days ago

    London, United Kingdom Harnham Full time

    SENIOR DATA ENGINEER LONDON, 4 DAYS A WEEK IN THE OFFICE, CENTRAL LONDON This is a driven marketing agency offering many benefits. They are data-driven and are situated in the sports industry, streaming and using data to best help their customer. This data company is heavily driven by Data and Analytics and is looking for a Senior Data Engineer to...

  • Senior Engineer, Data Engineering

    18 hours ago

    London, United Kingdom Harnham Full time

    Job Description SENIOR DATA ENGINEER LONDON, 4 DAYS A WEEK IN THE OFFICE, CENTRAL LONDON This is a driven marketing agency offering many benefits. They are data-driven and are situated in the sports industry, streaming and using data to best help their customer. This data company is heavily driven by Data and Analytics and is looking for a Senior Data...

  • Senior Mlops Engineer

    6 days ago

    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **Senior MLOps Engineer** **FinTech** **£85,000 - £95,000** This is an exciting opportunity for an ML Ops expert to join a tech-driven finance company! **THE COMPANY** This very successful FinTech company are continuing to grow their Data presence by hiring an ML Ops Engineer to sit between their Data Science & Data Engineering team. You'll be focusing...

  • Senior Engineer, Data Engineering

    19 hours ago

    London, United Kingdom Xcede Full time

    Job Description Senior Data Engineer (AWS) London - 2/3 days a week My Client is an exciting scale up focused on the Art world, looking for a Senior Data Engineer to join a team of software engineers, data engineers, data scientists, and analysts. You will be responsible for designing and constructing reliable data pipelines. You will leverage the most...

  • Senior Engineer, Data Engineering

    18 hours ago

    London, United Kingdom numi Full time

    Job Description Senior Data Engineer - London (hybrid) - £90-120,000 + bonus numi have partnered with an absolute powerhouse in the global analytics, reporting and intelligence trade to hire a Senior AI Data Engineer! This is part of a HUGE new team build out that will be supporting a large number of greenfield projects. As their latest AI Data Engineer...

  • Senior Engineer, Data Engineering

    1 week ago

    London, United Kingdom numi Full time

    Senior Data Engineer - London (hybrid) - £90-120,000 + bonus numi have partnered with an absolute powerhouse in the global analytics, reporting and intelligence trade to hire a Senior AI Data Engineer! This is part of a HUGE new team build out that will be supporting a large number of greenfield projects. As their latest AI Data Engineer you'll be...

  • Senior Engineer, Data Engineering

    7 days ago

    London, United Kingdom numi Full time

    Senior Data Engineer - London (hybrid) - £90-120,000 + bonus numi have partnered with an absolute powerhouse in the global analytics, reporting and intelligence trade to hire a Senior AI Data Engineer! This is part of a HUGE new team build out that will be supporting a large number of greenfield projects. As their latest AI Data Engineer you'll be...