Lead Data Engineer

4 weeks ago

United Kingdom HCLTech Full time

Lead Data Engineer:

We need some strong Data engineer profiles… they need good experience with

Pyspark, Python, SQL, ADF and preferably Databricks experience

Job description:

  • Building new data pipelines and optimizing data flows using the Azure cloud stack.
  • Building data products from scratch.
  • Support Business Analysts and Data Architects with discovery and best practices.
  • Self-directed and comfortable supporting the data needs of multiple teams, systems and products.

What’s required ?

  • Advanced Azure knowledge and experience working and migrating data products from on-prem to Azure.
  • Experience building and optimizing ‘big data' data pipelines, architectures and data sets using Py-spark.
  • Experience building real-time data pipelines using Event-hub, storage queues and Azure stream analysis.
  • Strong analytic skills related to working with unstructured datasets.
  • Build processes supporting data transformation, data structures, metadata, dependency and workload management.
  • Cloud Big Data Analytics in Azure Synapse Analytics, Azure Analysis Services
  • Data Ingestion and Storage including Azure Data Factory, Azure Databricks, Azure Data Lake, Kafka and Spark Streaming, Azure EventHub/IoT Hub, and Azure Stream Analytics

Experience with Object-oriented/ object function scripting languages: Python preferred

  • Lead Data Engineer-Data Management

    4 weeks ago

    United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer. As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...

  • Lead Data Engineer-Data Management

    4 weeks ago

    United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer. As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...

  • Lead Data Engineer

    3 weeks ago

    United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer.As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...

  • Lead Data Engineer

    3 weeks ago

    United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer.As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...

  • Lead Data Engineer

    4 weeks ago

    United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer.As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...

  • Lead Data Engineer

    3 weeks ago

    United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer. As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...

  • Lead Data Engineer

    4 weeks ago

    United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer. As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...

  • Lead Data Engineer

    4 weeks ago

    United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer. As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...

  • Lead Data Scientist

    3 weeks ago

    United Kingdom Data Idols Full time

    Lead Data Scientist Data Idols are working with a great company who are on the mission to save households £1000's every year! They are looking for a Lead Data Scientist to lead their existing Data Science team and promote best practices. You will be part of a customer focused, data driven environment where you are encouraged to explore new ideas and...

  • Lead Data Scientist

    3 weeks ago

    United Kingdom Data Idols Full time

    Lead Data Scientist Data Idols are working with a great company who are on the mission to save households £1000's every year! They are looking for a Lead Data Scientist to lead their existing Data Science team and promote best practices. You will be part of a customer focused, data driven environment where you are encouraged to explore new ideas and...

  • Lead Engineer

    4 weeks ago

    United Kingdom Lead Engineer – 5G RAN Testing Full time

    Responsibilities: • Responsible for development product, which includes System-validation, feature validation and performance analysis, customer review sessions for LTE/5G and ORAN products focusing on Air interface, E2E performance, and Call Processing with excellent understanding of HW-SW architecture. • Strong Knowledge of 5GNR & O-RAN with clear...

  • Senior Data Engineer

    4 weeks ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients. This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Data Engineer

    4 weeks ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients. This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Data Engineer

    3 weeks ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients.This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Data Engineer

    3 weeks ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients.This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Data Engineer

    4 weeks ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients. This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Data Engineer

    4 weeks ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients.This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Data Engineer

    3 weeks ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients. This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Data Engineer

    4 weeks ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients. This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Engineer, Data Engineering

    4 weeks ago

    United Kingdom Data Science Talent Full time

    Data Engineering in Animal Health 80% remote £60-70k basic salary plus 10% bonus If you’re as much of an animal lover as you are a data engineer, you won’t find a better opportunity to use your skills for good. In this newly created role you’ll be setting up the data infrastructure that will help this thriving veterinary care company to...