Lead Engineer/Data Engineer

3 weeks ago


Leeds, United Kingdom HCLTech Full time

Job Description Lead Data Engineer:

We need some strong Data engineer profiles… they need good experience with
Pyspark, Python, SQL, ADF and preferably Databricks experience

Job description:
Building new data pipelines and optimizing data flows using the Azure cloud stack.
Building data products from scratch.
Support Business Analysts and Data Architects with discovery and best practices.
Self-directed and comfortable supporting the data needs of multiple teams, systems and products.
What’s required ?
Advanced Azure knowledge and experience working and migrating data products from on-prem to Azure.
Experience building and optimizing ‘big data' data pipelines, architectures and data sets using Py-spark.
Experience building real-time data pipelines using Event-hub, storage queues and Azure stream analysis.
Strong analytic skills related to working with unstructured datasets.
Build processes supporting data transformation, data structures, metadata, dependency and workload management.
Cloud Big Data Analytics in Azure Synapse Analytics, Azure Analysis Services
Data Ingestion and Storage including Azure Data Factory, Azure Databricks, Azure Data Lake, Kafka and Spark Streaming, Azure EventHub/IoT Hub, and Azure Stream Analytics
Experience with Object-oriented/ object function scripting languages: Python preferred


  • Lead Data Engineer

    2 days ago


    Leeds, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **Lead Data Engineer** **Up to £95,000 per annum** **Location** - Fully remote We have a fantastic opportunity for a Lead Data Engineer! **The Company** This client operates within the aviation industry and is one of the UK's leading service providers. They have a network of over 1000 routes across 35 countries. They lead the industry in data, digital,...

  • Lead Data Engineer

    6 days ago


    Leeds, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **Lead Data Engineer** **Up to £100,000 per annum** **Location** - Remote - attend office in London once every 3 weeks **URGENT HIRE** Lead Data Engineer sought for a well-established insurance company! **The Company** This company is a fast-growing data-focused general insurance provider. They offer a range of products and services, which include car,...


  • Leeds, United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Data Engnieering professional to join our client, a growing consultancy, as a Data Engineering Manager.As Data Engineering Manager, you will play a pivotal role in driving the success of our client's Data Engineering practice through your expertise in presales, strong technical acumen, consulting skills, and effective...

  • Lead Data Engineer

    1 week ago


    Leeds, United Kingdom Harnham Full time

    **Lead Data Engineer** **Up to £95,000 per annum** **Location** - Fully remote We have a fantastic opportunity for a Lead Data Engineer! **The Company** This client operates within the aviation industry and is one of the UK's leading service providers. They have a network of over 1000 routes across 35 countries. They lead the industry in data, digital,...

  • Lead Data Engineer

    1 month ago


    Leeds, Leeds, United Kingdom Sky Betting and Gaming Full time

    What you'll doAn opportunity has arisen for a Lead Data Engineer to join one of our most exciting areas - the Data tribe. If you thrive in a fast paced, collaborative environment and share our passion for working with the newest technology across Data, then we're looking to hear from youIdeally, you will have existing experience in either software or data...


  • Leeds, United Kingdom ASDA Full time €5,700

    Job Title Lead Data Engineer Location Asda House Employment Type Full time Contract Type Permanent Hours Per Week 37.5 Salary Competitive salary plus benefits Category Software Engineering Closing Date 6 June 2024 Your Role We are looking for an Azure Lead Engineer to join our Data Insights and Analytics team. The role will be...

  • Lead Data Engineer

    22 hours ago


    Leeds, Leeds, United Kingdom Asda Full time

    Lead Data Engineer - Leeds Job TitleLead Data EngineerLocationAsda HouseEmployment TypeFull timeContract TypePermanentHours Per Week37.5SalaryCompetitive salary plus benefitsCategorySoftware EngineeringClosing Date6 June 2024Your RoleWe are looking for an Azure Lead Engineer to join our Data Insights and Analytics team. The role will be responsible for...

  • Lead data engineer

    3 weeks ago


    Leeds, United Kingdom Hunter Bond Full time

    Lead Data Engineer Hyper Scaling ML Startup Location: London/Hybrid My client is seeking a Lead Data Engineer to own the delivery of scalable data pipelines that are critical to the entire firm's infrastructure. Being a Lead Data Engineer at a truly elite hedge fund, you will join an environment that prides itself on working with the most cutting-edge...

  • Lead Data Engineer

    1 week ago


    Leeds, United Kingdom ASDA Full time €5,700

    Job Title Lead Data Engineer Location Asda House Employment Type Full time Contract Type Permanent Hours Per Week 37.5 Salary Competitive salary plus benefits Category Software Engineering Closing Date 6 June 2024 Your Role We are looking for an Azure Lead Engineer to join our Data Insights and Analytics team. The role will be responsible for...

  • Lead Data Engineer

    6 days ago


    Leeds, United Kingdom Harnham Full time

    **Lead Data Engineer** **Up to £100,000 per annum** **Location - Fully remote** We have a fantastic opportunity for a Lead Data Engineer! **The Company** The company is a growing group of committed colleagues, in financially responsible schools around the world, all of which aim to be the school of choice in their local area. They went through...

  • Lead Data Engineer

    2 weeks ago


    Leeds, United Kingdom Asda Stores Ltd Full time

    Job Title Lead Data Engineer Location Asda House Employment Type Full time Contract Type Permanent Hours Per Week 37.5 Salary Competitive salary plus benefits Category Software Engineering Closing Date 6 June 2024 Your Role We are looking for an Azure Lead Engineer to join our Data Insights and...

  • Lead Data Engineer

    2 days ago


    Leeds, United Kingdom Asda Stores Ltd Full time

    Job Title Lead Data Engineer Location Asda House Employment Type Full time Contract Type Permanent Hours Per Week 37.5 Salary Competitive salary plus benefits Category Software Engineering Closing Date 6 June 2024 Your Role We are looking for an Azure Lead Engineer to join our Data Insights and...

  • Lead Data Engineer

    1 week ago


    Leeds, United Kingdom DWP Digital Full time

    DWP. Digital with purpose.To be considered for an interview, please make sure your application is full in line with the job specs as found below.Are you a leader in data engineer with the experience and drive to lead a team of talented Data Engineers to success?Are you passionate about building and supporting data capabilities that are essential to DWP...


  • Leeds, United Kingdom Abs Data Full time

    Process Engineer – Manufacturing Saint-Gobain Highly competitive pay/package and professional development program. Are you a Process Engineer who is passionate about delivering manufacturing Improvement projects while ensuring optimum manufacturing performance is maintained? The British Gypsum manufacturing facility in Sherburn in Elmet is part of...

  • Lead Data Engineer

    7 days ago


    Leeds, United Kingdom Asda Full time

    Lead Data Engineer - Leeds Job TitleLead Data EngineerLocationAsda HouseEmployment TypeFull timeContract TypePermanentHours Per Week37.5SalaryCompetitive salary plus benefitsCategorySoftware EngineeringClosing Date6 June 2024 Your RoleWe are looking for an Azure Lead Engineer to join our Data Insights and Analytics team. The role will be responsible for...

  • Lead Data Engineer

    2 weeks ago


    Leeds, United Kingdom Asda Full time

    Lead Data Engineer - Leeds Job TitleLead Data EngineerLocationAsda HouseEmployment TypeFull timeContract TypePermanentHours Per Week37.5SalaryCompetitive salary plus benefitsCategorySoftware EngineeringClosing Date6 June 2024 Your RoleWe are looking for an Azure Lead Engineer to join our Data Insights and Analytics team. The role will be responsible for...

  • Lead Data Engineer

    2 days ago


    Leeds, United Kingdom Asda Full time

    Lead Data Engineer - Leeds Job TitleLead Data EngineerLocationAsda HouseEmployment TypeFull timeContract TypePermanentHours Per Week37.5SalaryCompetitive salary plus benefitsCategorySoftware EngineeringClosing Date6 June 2024 Your RoleWe are looking for an Azure Lead Engineer to join our Data Insights and Analytics team. The role will be responsible for...

  • Lead Data Engineer

    3 weeks ago


    Leeds, United Kingdom Reed Remote Work Freelance Full time

    Role: Lead Data EngineerLocation: Leeds - 2 days per week onsite / 3 days WFHStart: ASAPDuration: 6-12 monthsRequirements: SnowflakeDBT / AirflowAzurePowerBI / DaxTraditional SQLJIRA, Confluence, (GitHub / BitBucket)Azure Data Factory


  • Leeds, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **Senior Data Engineer** **Remote - 1 day per month in London per month** **Up to £80, 000** **Permanent** An opportunity for a Senior Data Engineer has opened up at a massive media company, who are looking to build out their APIs and query the datasets. **The Company** An excellent opportunity for a Senior Data Engineer to join a prestigious media...

  • Lead Data Engineer

    1 week ago


    Leeds, United Kingdom Harnham Full time

    **LEAD/HEAD OF DATA ENGINEERING** **REMOTE (MUST BE UK BASED)** **£80,000 - £100,000** **The Company** This company work with 100 schools across the world, and have recently received massive amounts of investment money to further expand globally! You'll therefore have lots of access to international cultures, and have huge international exposure for...