Lead Data Engineer

2 weeks ago


Leeds, United Kingdom HCLTech Full time
Job Description

Lead Data Engineer:

We need some strong Data engineer profiles… they need good experience with

Pyspark, Python, SQL, ADF and preferably Databricks experience

Job description:

  • Building new data pipelines and optimizing data flows using the Azure cloud stack.
  • Building data products from scratch.
  • Support Business Analysts and Data Architects with discovery and best practices.
  • Self-directed and comfortable supporting the data needs of multiple teams, systems and products.

What’s required ?

  • Advanced Azure knowledge and experience working and migrating data products from on-prem to Azure.
  • Experience building and optimizing ‘big data' data pipelines, architectures and data sets using Py-spark.
  • Experience building real-time data pipelines using Event-hub, storage queues and Azure stream analysis.
  • Strong analytic skills related to working with unstructured datasets.
  • Build processes supporting data transformation, data structures, metadata, dependency and workload management.
  • Cloud Big Data Analytics in Azure Synapse Analytics, Azure Analysis Services
  • Data Ingestion and Storage including Azure Data Factory, Azure Databricks, Azure Data Lake, Kafka and Spark Streaming, Azure EventHub/IoT Hub, and Azure Stream Analytics

Experience with Object-oriented/ object function scripting languages: Python preferred



  • Leeds, United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Data Engnieering professional to join our client, a growing consultancy, as a Data Engineering Manager.As Data Engineering Manager, you will play a pivotal role in driving the success of our client's Data Engineering practice through your expertise in presales, strong technical acumen, consulting skills, and effective...

  • Lead Data Engineer

    3 days ago


    Leeds, United Kingdom Harnham Full time

    **Lead Data Engineer** **Up to £95,000 per annum** **Location** - Fully remote We have a fantastic opportunity for a Lead Data Engineer! **The Company** This client operates within the aviation industry and is one of the UK's leading service providers. They have a network of over 1000 routes across 35 countries. They lead the industry in data, digital,...

  • Lead Data Engineer

    1 month ago


    Leeds, Leeds, United Kingdom Sky Betting and Gaming Full time

    What you'll doAn opportunity has arisen for a Lead Data Engineer to join one of our most exciting areas - the Data tribe. If you thrive in a fast paced, collaborative environment and share our passion for working with the newest technology across Data, then we're looking to hear from youIdeally, you will have existing experience in either software or data...

  • Lead Data Engineer

    4 days ago


    Leeds, United Kingdom ASDA Full time €5,700

    Job Title Lead Data Engineer Location Asda House Employment Type Full time Contract Type Permanent Hours Per Week 37.5 Salary Competitive salary plus benefits Category Software Engineering Closing Date 6 June 2024 Your Role We are looking for an Azure Lead Engineer to join our Data Insights and Analytics team. The role will be responsible for...

  • Lead Data Engineer

    5 days ago


    Leeds, United Kingdom Asda Stores Ltd Full time

    Job Title Lead Data Engineer Location Asda House Employment Type Full time Contract Type Permanent Hours Per Week 37.5 Salary Competitive salary plus benefits Category Software Engineering Closing Date 6 June 2024 Your Role We are looking for an Azure Lead Engineer to join our Data Insights and...


  • Leeds, United Kingdom ASDA Full time €5,700

    Job Title Lead Data Engineer Location Asda House Employment Type Full time Contract Type Permanent Hours Per Week 37.5 Salary Competitive salary plus benefits Category Software Engineering Closing Date 6 June 2024 Your Role We are looking for an Azure Lead Engineer to join our Data Insights and Analytics team. The role will be...

  • Lead data engineer

    2 weeks ago


    Leeds, United Kingdom Hunter Bond Full time

    Lead Data Engineer Hyper Scaling ML Startup Location: London/Hybrid My client is seeking a Lead Data Engineer to own the delivery of scalable data pipelines that are critical to the entire firm's infrastructure. Being a Lead Data Engineer at a truly elite hedge fund, you will join an environment that prides itself on working with the most cutting-edge...

  • Lead Data Engineer

    2 days ago


    Leeds, United Kingdom DWP Digital Full time

    DWP. Digital with purpose.To be considered for an interview, please make sure your application is full in line with the job specs as found below.Are you a leader in data engineer with the experience and drive to lead a team of talented Data Engineers to success?Are you passionate about building and supporting data capabilities that are essential to DWP...


  • Leeds, United Kingdom Abs Data Full time

    Process Engineer – Manufacturing Saint-Gobain Highly competitive pay/package and professional development program. Are you a Process Engineer who is passionate about delivering manufacturing Improvement projects while ensuring optimum manufacturing performance is maintained? The British Gypsum manufacturing facility in Sherburn in Elmet is part of...

  • Lead Data Engineer

    2 weeks ago


    Leeds, United Kingdom Reed Remote Work Freelance Full time

    Role: Lead Data EngineerLocation: Leeds - 2 days per week onsite / 3 days WFHStart: ASAPDuration: 6-12 monthsRequirements: SnowflakeDBT / AirflowAzurePowerBI / DaxTraditional SQLJIRA, Confluence, (GitHub / BitBucket)Azure Data Factory

  • Lead Data Engineer

    7 hours ago


    Leeds, United Kingdom Asda Full time

    Lead Data Engineer - Leeds Job TitleLead Data EngineerLocationAsda HouseEmployment TypeFull timeContract TypePermanentHours Per Week37.5SalaryCompetitive salary plus benefitsCategorySoftware EngineeringClosing Date6 June 2024 Your RoleWe are looking for an Azure Lead Engineer to join our Data Insights and Analytics team. The role will be responsible for...

  • Lead Data Engineer

    4 days ago


    Leeds, United Kingdom Asda Full time

    Lead Data Engineer - Leeds Job TitleLead Data EngineerLocationAsda HouseEmployment TypeFull timeContract TypePermanentHours Per Week37.5SalaryCompetitive salary plus benefitsCategorySoftware EngineeringClosing Date6 June 2024 Your RoleWe are looking for an Azure Lead Engineer to join our Data Insights and Analytics team. The role will be responsible for...

  • Lead Data Engineer

    3 days ago


    Leeds, United Kingdom Harnham Full time

    **LEAD/HEAD OF DATA ENGINEERING** **REMOTE (MUST BE UK BASED)** **£80,000 - £100,000** **The Company** This company work with 100 schools across the world, and have recently received massive amounts of investment money to further expand globally! You'll therefore have lots of access to international cultures, and have huge international exposure for...


  • Leeds, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **Senior Data Engineer** **Remote - 1 day per month in London per month** **Up to £80, 000** **Permanent** An opportunity for a Senior Data Engineer has opened up at a massive media company, who are looking to build out their APIs and query the datasets. **The Company** An excellent opportunity for a Senior Data Engineer to join a prestigious media...


  • Leeds, United Kingdom Novuna Consumer Finance Full time

    Are you passionate about data? This role is Hybrid and will require 1 day in the office per week, applicants must be in commutable distance from either our Newbury or Staines sites. At Novuna, we care about building a better tomorrow. With a focus on sustainability, and a passion for phenomenal customer experiences, we provide consumers and businesses with...

  • Data Engineer

    4 days ago


    Leeds, United Kingdom BJSS Full time

    About UsnWe’re an award-winning innovative tech consultancy - a team of creative problem solvers. Since 1993 we’ve been finding better, more sustainable ways to solve complex technology problems for some of the world’s leading organisations and delivered solutions that millions of people use every day.In the last 30 years we won several awards,...

  • Data Engineer

    5 days ago


    Leeds, United Kingdom BJSS Full time

    About Us We’re an award-winning innovative tech consultancy - a team of creative problem solvers. Since 1993 we’ve been finding better, more sustainable ways to solve complex technology problems for some of the world’s leading organisations and delivered solutions that millions of people use every day. In the last 30 years we won several awards,...

  • Data Engineer

    4 days ago


    Leeds, United Kingdom BJSS Full time

    Job Description About Us We’re an award-winning innovative tech consultancy - a team of creative problem solvers. Since 1993 we’ve been finding better, more sustainable ways to solve complex technology problems for some of the world’s leading organisations and delivered solutions that millions of people use every day. In the last 30 years we won...

  • Data Engineer

    5 days ago


    Leeds, United Kingdom BJSS Full time

    About Us We’re an award-winning innovative tech consultancy - a team of creative problem solvers. Since 1993 we’ve been finding better, more sustainable ways to solve complex technology problems for some of the world’s leading organisations and delivered solutions that millions of people use every day. In the last 30 years we won several awards,...

  • Data Engineer

    4 days ago


    Leeds, United Kingdom BJSS Full time

    About UsWe’re an award-winning innovative tech consultancy - a team of creative problem solvers. Since 1993 we’ve been finding better, more sustainable ways to solve complex technology problems for some of the world’s leading organisations and delivered solutions that millions of people use every day.In the last 30 years we won several awards,...