Data Engineering Technical Lead

20 hours ago


Luton, United Kingdom Experis LTD Full time

Data Engineering Technical Lead, Hybrid working 1 day office, Big data, SQL, Apache Airflow

**Salary**: £80,000 to £90,000

My leading client is looking for a Data Engineering Technical lead, who is responsible for technical design of data solutions and platforms within the IT estate, adhering to enterprise standards and best practice.

The role will involve working closely with the enterprise architects, technical architects, solution architects, business analysts, engineers, and project managers to deliver IT change that meets the needs of projects and programmes within the enterpriseportfolio.

The technical Skills below:

- Solid understanding of data concepts and data modelling principles; applied across traditional warehousing, OLTP and also modern data lakes.
- 5+ years of solid experience in designing and building solutions on a big data distributed system - data lake, data warehouse, or lakehouse.
- Proficient in Apache Spark or any other distributed data programming frameworks (e.g. Flink, Arrow, MapR).
- Strong SQL background - comfortable writing efficient SQL (Transact-SQL, Hive -HQL) to meet the requirement.
- Commercial experience of building and architecting scalable Extract Load Transform (ELT) data pipeline implementations at varying frequencies - batch, near-real-time and real-time, from a myriad of source types - relational, non-relational, API, streaming(e.g. Kafka topic)
- Experience with Apache Airflow/Spring DataFlow, Control-M, or a similar orchestration tool in a Production setting.
- Exposure to working with large datasets (transforming, cleansing, loading) on a distributed computing environment.
- Experience working with low-latency data requirements where the speed of decision making dictates the speed of data delivery to the consumer.
- Strong understanding of Data Management principles (security and data privacy) and how they can be applied to Data Engineering processes/solutions, e.g. access management, data privacy, handling of sensitive data (e.g. GDPR)
- Experience working with a combination of cloud-based big data technologies (HDFS, Blob Storage, Spark, Kafka, Delta, Hive, Oozie, NiFi).

If this opportunity sounds like it could be of interest, please send me your CV ASAP.


  • Lead Data Engineer

    3 days ago


    Luton, United Kingdom Advantage Resourcing Full time

    Job Title: Data Engineering Design Lead Pay Rate: Negotiable Contract Length: 6 months Location: Luton/remote (on-site requirement - 2/3 days a week) Advantage Resourcing are working in partnership with a well-known brand who are currently recruiting a Data Engineering Design Lead. *Serve as the technical expert responsible for designing production-grade...

  • Senior UPS

    2 weeks ago


    Luton, United Kingdom Rise Technical Full time

    Senior UPS / Technical Engineer £55,000 - £60,000 + Overtime + Progression to Management + Vehicle & Fuel Card + Company Benefits Home Based (Travelling to Clients across the UK)Do you have experience working with UPS Systems or Generators? Are you looking to take the next step in your career and become the go to technical expert with an expanding company...


  • Luton, United Kingdom Experis LTD Full time

    Delivery lead - Data engineering, Hybrid working 1 day office, Data lead, Python, SQL, Scala, Azure, Big data, DevOps My leading client is looking for Delivery lead - Data engineering, who is responsible for leading internal and external resources within the Data Engineering practice who contribute to and execute on delivering enterprise-grade data products...

  • Senior UPS

    5 days ago


    Luton, United Kingdom Rise Technical Recruitment Limited Full time

    Senior UPS / Technical Engineer £55,000A high number of candidates may make applications for this position, so make sure to send your CV and application through as soon as possible.- £60,000 Overtime Progression to Management Vehicle & Fuel Card Company Benefits Home Based (Travelling to Clients across the UK) Do you have experience working with UPS...

  • Senior UPS

    5 days ago


    Luton, United Kingdom Rise Technical Recruitment Limited Full time

    Senior UPS / Technical Engineer £55,000A high number of candidates may make applications for this position, so make sure to send your CV and application through as soon as possible.- £60,000 Overtime Progression to Management Vehicle & Fuel Card Company Benefits Home Based (Travelling to Clients across the UK) Do you have experience working with UPS...


  • Luton, United Kingdom Tenth Revolution Group Full time

    Overview Data Engineering Lead - Hybrid - Azure / Databricks - London Permanent Salary: £90,000 Are you a seasoned Data Engineering professional ready to lead the charge in building scalable, high-performance data platforms? An industry leading, global firm is seeking a Data Engineering Lead to drive innovation across their hybrid Azure / Databricks...


  • Luton, Luton, United Kingdom Advanced Technical Recruitment Full time £40,000 - £60,000 per year

    Life Science Sales Engineer – Home Counties – LM1232Salary:Competitive base salary, + PackageJob Term:Full Time/PermanentJob Outline:A leading distributor of specialist Instrumentation and Equipment for the Microbiology, Organic Chemistry and Life Science sector, is now looking for an additional Technical Sales Engineer.Joining their growing team at...

  • Data Engineer

    4 days ago


    Luton, United Kingdom ANSON MCCADE Full time £65,000

    Data Engineer £Up to £65,000 GBP Hybrid WORKING Location: London; Norwich; Watford; Colchester; Chelmsford; Woking; Chatham; Slough, Central London, Greater LondonAll the relevant skills, qualifications and experience that a successful applicant will need are listed in the following description.- United Kingdom Type: Permanent Must Have: Active SC...

  • Senior Data Engineer

    19 hours ago


    Luton, United Kingdom Experis LTD Full time

    **Data Engineer** **Luton, United Kingdom** We have an exciting opportunity with one of our top clients, Europe's leading airline. To join this thriving team of Data Specialists you will play a major role in adhering to big data best practices whilst building and maintaining reliable data pipelinesand data products across a range of exciting initiatives....

  • Senior Data Engineer

    20 hours ago


    Luton, United Kingdom Experis LTD Full time

    Senior Data Engineer, Hybrid working 1 day office, Senior Data Developer, Data Lead, Python, SQL, Scala, Azure, Big Data, ETL My leading client is looking for x2 Senior Data Engineers to help them expand their data practise to drive the business to harness the power of data to championing the central Data Platform and Data Product adoption for all analytical...