Data Engineer

3 days ago


London, UK, United Kingdom W Talent Full time

Are you a Data Engineer with a demonstrable background of building and maintaining data pipelines in Azure? There is a high growth technology consulting business we are working with at the moment to help find people like you to add to their highly skilled team. If you are an Azure Data Engineer looking to apply your skills on interesting projects and learn directly from some experienced leaders in this space, this is the role for you. You would be working on cutting edge Digital Transformation programmes of work that make the lives of UK Citizens better and safer.


Job Role:


As a Data Engineer, you will play a pivotal role in ensuring the efficient and accurate management of data for public sector clients. Your primary responsibilities will include working with Microsoft products such as Azure Data Factory, Azure SQL, Power BI, and the broader Microsoft Azure platform. You will closely collaborate with Technology teams to construct and maintain robust data pipelines, optimize data flows, and contribute to data analysis and reporting processes.


Duties & Responsibilities:


  • Collaborate with Technology teams to develop and maintain data pipelines, ensuring smooth and efficient data flow from multiple sources to various systems.
  • Design, develop, automate, and implement data integration solutions using Microsoft products, including Azure Data Factory, Azure SQL, Power BI, and the broader Microsoft Azure platform.
  • Assist in building and maintaining data warehouses, data marts, and other data storage systems.
  • Troubleshoot data-related issues and conduct root cause analysis to identify and resolve problems.
  • Participate in the design and development of data models and schemas to support data analytics and reporting requirements.
  • Collaborate with business stakeholders to understand their data needs and assist in generating actionable insights.
  • Stay updated with emerging trends and technologies in data engineering, healthcare, and Microsoft products to contribute to ongoing improvement efforts.


Requirements:


  • 2+ years of experience as a Data Engineer
  • Knowledge in Azure
  • Strong knowledge of ETL and data modelling, Expertise in Azure Data Factory for data orchestration, ETL workflows, and data integration
  • Experience in designing and implementing data models to support analytical and reporting needs
  • Proficiency in modern data tools, such as SQL and Python, Terraform, Git, and GitLab pipelines

  • Senior Data Engineer

    2 weeks ago


    London, UK, UK, United Kingdom Data Idols Full time

    Senior Data EngineerSalary: up to £85,000Location: London (Hybrid)Data Idols are working with an exciting scale-up revolutionising delivery logistics and moving items across the UK with efficiency and ease all whilst cutting emissions. Trusted by millions of customers already they are expanding their data team to manage increased volumes of data and demand....


  • London, UK, United Kingdom Paritas Recruitment - Data & Tech Full time

    We are seeking a Data Architect to take the lead in a newly formed department within a trading house. Leading a multi disciplinary team, we are seeking individuals who can come in and make the decisions on future architecture designs, contribute to a wider data strategy and face off to a range of senior stakeholders across the business. Experience in other...

  • Data Engineer

    7 days ago


    London,, UK, United Kingdom The People Network Full time

    Data EngineerA Data Engineer is required to join a global consultancy providing top quality Data solutions to the Government sector.In this exciting Data Engineer role, you will work on designing, constructing, and maintaining scalable data pipelines and transforming raw data.This is a fantastic opportunity for someone who comes from a Data Engineering...

  • Data Engineer

    2 weeks ago


    London,, UK, United Kingdom Mastek Full time

    Job Description: Data EngineerLocation: [UK]SC Cleared: RequiredJob Type: Full-TimeExperience: 12-14 yearsJob description:We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. The Data Engineer will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support data-driven...

  • Data Engineer

    3 days ago


    London,, UK, United Kingdom Oliver Bernard Full time

    Data Engineer - up to £70kWe have partnered with a growing SaaS company who operate within the hospitality sector. Their purpose is to boost performance by pulling together data from all different technologies within the business in real time to improve performance.As a Data Engineer you will be expected to build and maintain their data pipeline and ETL...

  • Data Engineer

    3 days ago


    London,, UK, United Kingdom Oliver Bernard Full time

    Data Engineer - up to £55k We have partnered with a growing SaaS company who operate within the hospitality sector. Their purpose is to boost performance by pulling together data from all different technologies within the business in real time to improve performance. As a Data Engineer you will be expected to build and maintain their data pipeline and ETL...

  • Data Engineer

    2 weeks ago


    London,, UK, United Kingdom Prism Digital Full time

    Lead Azure Data Engineer | PySpark (Python) & Synapse | Tech for Good / CharityEssential skills required:Azure – solid experience required of the Azure Data ecosystemPython - ESSENTIAL as PySpark is used heavily. You will be tested on PySparkAzure Synapse - ESSENTIAL as is used heavilySparkAzure Data Lake / Data Bricks / Data FactoryBe happy to act as a...

  • Data Engineer

    1 month ago


    London,, UK, United Kingdom Response Informatics Full time

    We are looking for a Lead Data Engineer to join our Data Engineering Team. In this senior role, you will be responsible for managing our Enterprise Data Warehouse and ensuring the efficient flow and quality of data.Your tasks will include implementing data processes, managing data architecture, designing ETL processes, and analyzing data for business...

  • Data Engineer

    7 hours ago


    London,, UK, United Kingdom Ocean Red Partners Full time

    **Exciting Opportunity for a Data Engineer in Commodity Trading**At Ocean Red Partners, we are experts in recruiting top talent for the energy and commodities trading sectors. We are currently looking for a skilled Data Engineer to join a prestigious global trading company, a leader in sourcing, supplying, and trading a diverse range of commodities. This...

  • Data Engineer

    4 weeks ago


    London,, UK, United Kingdom Prism Digital Full time

    Lead Azure Data Engineer | PySpark (Python) & Synapse | Tech for Good / CharityEssential skills required:Azure – solid experience required of the Azure Data ecosystemPython - ESSENTIAL as PySpark is used heavily. You will be tested on PySparkAzure Synapse - ESSENTIAL as is used heavilySparkAzure Data Lake / Data Bricks / Data FactoryBe happy to act as a...

  • Data Engineer

    4 weeks ago


    London,, UK, United Kingdom Prism Digital Full time

    Lead Azure Data Engineer | PySpark (Python) & Synapse | Tech for Good / CharityEssential skills required:Azure – solid experience required of the Azure Data ecosystemPython - ESSENTIAL as PySpark is used heavily. You will be tested on PySparkAzure Synapse - ESSENTIAL as is used heavilySparkAzure Data Lake / Data Bricks / Data FactoryBe happy to act as a...

  • Data Engineer

    1 month ago


    London,, UK, United Kingdom Travelex Full time

    Job Title: Data EngineerJob Type: Full Time, PermanentWorking location: London, HybridRole Purpose At Travelex we are developing modern data services, which will be at the heart of our relationship with our customers. Our data architecture is becoming more service-oriented and more real-time – which creates a range of engineering problems for you to solve....

  • Data Engineer

    4 weeks ago


    London,, UK, United Kingdom Travelex Full time

    Job Title: Data EngineerJob Type: Full Time, PermanentWorking location: London, HybridRole Purpose At Travelex we are developing modern data services, which will be at the heart of our relationship with our customers. Our data architecture is becoming more service-oriented and more real-time – which creates a range of engineering problems for you to solve....

  • Data Engineer

    4 weeks ago


    London,, UK, United Kingdom Understanding Recruitment Full time

    Data EngineerDo you want to join a leading investment firm specializing in quantitative trading, driven by innovation and excellence? Keep reading! Location: London, UKAs a Data Engineer, you'll build and maintain infrastructure for trading strategies, collaborating with data scientists and analysts.Responsibilities: Data Pipelines Data Integration️...

  • Data Engineer

    4 weeks ago


    London,, UK, United Kingdom Understanding Recruitment Full time

    Data EngineerDo you want to join a leading investment firm specializing in quantitative trading, driven by innovation and excellence? Keep reading! Location: London, UKAs a Data Engineer, you'll build and maintain infrastructure for trading strategies, collaborating with data scientists and analysts.Responsibilities: Data Pipelines Data Integration️...

  • Data Engineer

    1 month ago


    London,, UK, United Kingdom Bolton Associates Full time

    We are working on behalf of an International (Re)Insurance client based in London to recruit a Lead/Senior Data Engineer, joining an established team of Analytics Engineers helping optimise the Actuarial teams' efficiency through data automation and the use of emerging technologies.The successful candidate will work on the following:- Actuarial Data...

  • Data Engineer

    4 weeks ago


    London,, UK, United Kingdom Vallum Associates Full time

    RequirementsAt least two years of professional experience as a data engineer with a proven ability to provide effective data solutions in a production setting.Knowledge of developing real-time data stream systems (ideally Kafka).Proven track record in developing data systems using PySpark and Apache Spark for batch processing.Capable of managing data intake...

  • Data Engineer

    4 weeks ago


    London,, UK, United Kingdom Vallum Associates Full time

    RequirementsAt least two years of professional experience as a data engineer with a proven ability to provide effective data solutions in a production setting.Knowledge of developing real-time data stream systems (ideally Kafka).Proven track record in developing data systems using PySpark and Apache Spark for batch processing.Capable of managing data intake...

  • Data Engineer

    1 month ago


    London,, UK, United Kingdom Hexegic Full time

    Data Engineers are responsible for aiding UK Health in developing a cleaned, validated, and discoverable data foundation to enable new analytical workflows and applications.They will need to work closely with UK Health subject matter experts to scope new data integrations, design a data model, and perform data cleansing and transformation within the data...

  • Data Engineer

    1 week ago


    London,, UK, United Kingdom Omnis Partners Full time

    Data Engineer Up to £70,000Healthcare Hybrid in Central London Join a global healthcare company in Central London as a Data Engineer, providing data solutions with a focus on ETL development, cloud deployment, and building data & analytics capabilities; offering up to £70,000, hybrid work, and a discretionary bonusCompanyA global Healthcare company host to...