Lead Data Engineer

4 weeks ago


Leeds, United Kingdom HCLTech Full time

Lead Data Engineer:


We need some strong Data engineer profiles… they need good experience with

Pyspark, Python, SQL, ADF and preferably Databricks experience

Job description:

  • Building new data pipelines and optimizing data flows using the Azure cloud stack.
  • Building data products from scratch.
  • Support Business Analysts and Data Architects with discovery and best practices.
  • Self-directed and comfortable supporting the data needs of multiple teams, systems and products.

What’s required ?

  • Advanced Azure knowledge and experience working and migrating data products from on-prem to Azure.
  • Experience building and optimizing ‘big data' data pipelines, architectures and data sets using Py-spark.
  • Experience building real-time data pipelines using Event-hub, storage queues and Azure stream analysis.
  • Strong analytic skills related to working with unstructured datasets.
  • Build processes supporting data transformation, data structures, metadata, dependency and workload management.
  • Cloud Big Data Analytics in Azure Synapse Analytics, Azure Analysis Services
  • Data Ingestion and Storage including Azure Data Factory, Azure Databricks, Azure Data Lake, Kafka and Spark Streaming, Azure EventHub/IoT Hub, and Azure Stream Analytics

Experience with Object-oriented/ object function scripting languages: Python preferred


  • Lead Data Engineer

    3 weeks ago


    Leeds, Leeds, United Kingdom Sky Betting and Gaming Full time

    What you'll doAn opportunity has arisen for a Lead Data Engineer to join one of our most exciting areas - the Data tribe. If you thrive in a fast paced, collaborative environment and share our passion for working with the newest technology across Data, then we're looking to hear from youIdeally, you will have existing experience in either software or data...

  • Lead Data Engineer

    1 week ago


    Leeds, United Kingdom HCLTech Full time

    Lead Data Engineer:Make your application after reading the following skill and qualification requirements for this position.We need some strong Data engineer profiles… they need good experience withPyspark, Python, SQL, ADF and preferably Databricks experienceJob description:Building new data pipelines and optimizing data flows using the Azure cloud...

  • Lead Data Engineer

    4 weeks ago


    Leeds, United Kingdom HCLTech Full time

    Lead Data Engineer:We need some strong Data engineer profiles… they need good experience withPyspark, Python, SQL, ADF and preferably Databricks experience Job description:Building new data pipelines and optimizing data flows using the Azure cloud stack.Building data products from scratch.Support Business Analysts and Data Architects with discovery and...

  • Lead Data Engineer

    1 day ago


    Leeds, United Kingdom HCLTech Full time

    Lead Data Engineer:Make your application after reading the following skill and qualification requirements for this position.We need some strong Data engineer profiles… they need good experience withPyspark, Python, SQL, ADF and preferably Databricks experienceJob description:Building new data pipelines and optimizing data flows using the Azure cloud...

  • Lead Data Engineer

    3 weeks ago


    Leeds, United Kingdom HCLTech Full time

    Lead Data Engineer: We need some strong Data engineer profiles… they need good experience with Pyspark, Python, SQL, ADF and preferably Databricks experience Job description: Building new data pipelines and optimizing data flows using the Azure cloud stack. Building data products from scratch. Support Business Analysts and Data Architects with...

  • Lead Data Engineer

    6 hours ago


    Leeds, United Kingdom HCLTech Full time

    Job Description Lead Data Engineer: We need some strong Data engineer profiles… they need good experience with Pyspark, Python, SQL, ADF and preferably Databricks experience Job description: Building new data pipelines and optimizing data flows using the Azure cloud stack. Building data products from scratch. Support Business Analysts and Data...


  • Leeds, United Kingdom HCLTech Full time

    Job Description Lead Data Engineer: We need some strong Data engineer profiles… they need good experience with Pyspark, Python, SQL, ADF and preferably Databricks experience Job description: Building new data pipelines and optimizing data flows using the Azure cloud stack. Building data products from scratch. Support Business Analysts and...


  • Leeds, United Kingdom Abs Data Full time

    Process Engineer – Manufacturing Saint-Gobain Highly competitive pay/package and professional development program. Are you a Process Engineer who is passionate about delivering manufacturing Improvement projects while ensuring optimum manufacturing performance is maintained? The British Gypsum manufacturing facility in Sherburn in Elmet is part of...


  • Leeds, United Kingdom Novuna Consumer Finance Full time

    Are you passionate about data? This role is Hybrid and will require 1 day in the office per week, applicants must be in commutable distance from either our Newbury or Staines sites. At Novuna, we care about building a better tomorrow. With a focus on sustainability, and a passion for phenomenal customer experiences, we provide consumers and businesses with...


  • Leeds, United Kingdom Scot Lewis Associates Full time

    Principal Engineer - Data and Platform Engineering - £90-£110k Are you a forward-thinking tech leader with a passion for data and cloud solutions? My client is seeking a Principal Engineer with expertise in Databricks, AWS, and GCP to join their team and drive innovation in data processes and cloud infrastructure. As a Principal Engineer, you'll lead...

  • Data Engineer

    2 weeks ago


    Leeds, United Kingdom G.Digital Full time

    AWS Data Engineer | £50-60k | Fintech | Hybrid Leeds Want to work for a business that uses Data to create predictions that shape the future of fintech decision making? If so, AWS Data Engineers this one is for you... About the business


  • Leeds, United Kingdom Page Group Full time

    To maintain Engineering documentation for the Manufacturing Department. Carry out projects within the Manufacturing Department to improve efficiency and reduce costs **Client Details** One of the world's leading engineering companies which helps customers to use electrical power effectively and to increase industrial productivity in a sustainable way;...


  • Leeds, United Kingdom staq Full time

    Exciting Opportunity for Lead Sim Developer! We've teamed up with an innovative company in the simulation and training industry! Our client's mission is to transform the way people are trained by harnessing human performance data in simulation and training and they're looking for a Lead Sim Developer to work on their Simulator. What Will You Do? Lead and...


  • Leeds, United Kingdom Investigo Full time

    Group Head of Data Engineering & Governance Are you an accomplished Head of Data Engineering & Governance looking for the next move in your career? InX are currently working on a retained Search basis with a Financial Services organisation to place a Group Head of Data in the CIO's senior management team. The Role As the Group Head of Data...


  • Leeds, United Kingdom Investigo Full time

    Group Head of Data Engineering & Governance Are you an accomplished Head of Data Engineering & Governance looking for the next move in your career? InX are currently working on a retained Search basis with a Financial Services organisation to place a Group Head of Data in the CIO's senior management team. The Role As the Group Head of Data Engineering...


  • Leeds, United Kingdom Investigo Full time

    Group Head of Data Engineering & GovernanceAre you an accomplished Head of Data Engineering & Governance looking for the next move in your career? InX are currently working on a retained Search basis with a Financial Services organisation to place a Group Head of Data in the CIO's senior management team.The Role As the Group Head of Data Engineering &...

  • Data Engineer

    3 weeks ago


    Leeds, United Kingdom Asda Stores Ltd Full time

    Job Title Data Engineer Location Asda House Employment Type Full time Contract Type Permanent Graduate (Fixed Term) Hours per Week 37.5 Salary Competitive salary Category Data Science Closing Date 26 May 2024 Are you a recent graduate in Data or similar that wants to kick start their career? Look no...

  • Data Engineer

    2 weeks ago


    Leeds, United Kingdom ASDA Full time

    Job Title Data Engineer Location Asda House Employment Type Full time Contract Type Permanent Graduate (Fixed Term) Hours per Week 37.5 Salary Competitive salary Category Data Science Closing Date 26 May 2024 Are you a recent graduate in Data or similar that wants to kick start their career? Look no further as have an exciting opportunity to join...

  • AWS Data Engineer

    3 days ago


    Leeds, United Kingdom Corecom Consulting Full time

    I’m working with an industry leading brand that are currently undertaking a large scale data transformation across the whole group. You will be joining an fast paced Engineering team that need support from an analytical perspective. Your responsibilities will include extracting data from multiple sources into the AWS database and helping to transform the...


  • Leeds, United Kingdom Investigo Full time

    Group Head of Data Engineering & Governance Are you an accomplished Head of Data Engineering & Governance looking for the next move in your career? InX are currently working on a retained Search basis with a Financial Services organisation to place a Group Head of Data in the CIO's senior management team. The Role As the Group Head of Data...