Data Office Transformation Data Engineering Lead

3 weeks ago

London, United Kingdom Arqiva Full time

Location: We operate a flexible, hybrid working environment with the candidate required to travel to either our Winchester or London office once or twice a week.

10% Bonus

* 6% pension contribution

* Private Medical

* 25 days annual leave

* Access to our comprehensive flexible benefits including discounts on big brands, wellness and employee assistance programmes, gymflex, buy and sell annual leave, travel and dental insurance

* Our commitment to a flexible and hybrid working culture

We are Arqiva, a company that provides critical data, network, and communications services to broadcasters, utilities, and other customers in the UK and around the world. We are looking for a data engineering lead to join our team and deliver upon a major transformation project that will build a modern lakehouse solution using cutting-edge technologies such as Spark, Databricks, AWS, Kinesis, Airflow, Qlik, Great Expectations, GitHub, CodePipeline, Terraform, and Python.

As a Data Engineering Lead at Arqiva, you will:

• Work closely with the data engineering manager, business analysts,

data architects, and other stakeholders to understand the business requirements and design the data lakehouse solution.

• Lead and mentor a team of data engineers and developers in building, testing, deploying, and maintaining scalable, reliable, and secure data pipelines and platforms using best practices of software engineering such as code quality, testing, documentation, version control, continuous integration, and continuous delivery.

• Implement data ingestion, processing, storage, and delivery systems

using Spark, Databricks, AWS, Kinesis, Kafka, Airflow, Glue, Qlik, Great Expectations, GitHub, CodePipeline, Terraform, and Python.

• Optimize the performance, reliability, and cost-efficiency of the data lakehouse solution.

• Troubleshoot and resolve any data-related issues and ensure the data quality and integrity using Great Expectations or other tools.

At least 5 years of proven experience in data engineering or a similar role.

• Strong knowledge and experience in working with Spark, GitHub, CI/CD, Python, AWS, and other related technologies.

• Strong big data development background and experience in building scalable, distributed, and fault-tolerant systems using microservices architecture and API strategy development.

• Excellent SQL skills and experience in working with various relational and non-relational databases.

• We are the undisputed leader in UK TV and radio broadcast, and the UK’s leading Smart utilities platform. This means we have a strong heritage and foundation for future growth for you to grow your career with us.

Our wellbeing mission is to help our people to be the best version of themselves at work and still have the time and energy to live a full life outside of work.

Our networks include our Diversity Ambassadors, Eldercare, Spectrum, Working Families, Pride, Veterans and Inspiring Women - join and contribute to our active networks

  • Lead Data Engineer

    1 month ago

    City of London, United Kingdom Data Idols Full time

    **Lead Data Engineer** Data Idols are proud to be working with an iconic UK brand to assist them in hiring a Lead Data Engineer as they undertake a digital and data-driven journey that will transform the business. Data is at the heart of the organisation and forms a key part oftheir future plans. **Skills and Experience**: - Awareness and understanding of...

  • Lead Engineer/Data Engineer

    2 months ago

    London, United Kingdom Abs Data Full time

    Lead Data Engineer Do you enjoy creating valuable insights with data? Do you want to play a key role in transforming our firm into an agile organization? Being agile will make us more responsive, more adaptable, and ultimately more innovative. We’re looking for a Data Engineer to: ~ transform data into valuable insights that inform business...

  • Lead Engineer/Data Engineer

    13 hours ago

    London, United Kingdom Abs Data Full time

    Lead Data Engineer Do you enjoy creating valuable insights with data? Do you want to play a key role in transforming our firm into an agile organization? Being agile will make us more responsive, more adaptable, and ultimately more innovative. We’re looking for a Data Engineer to: ~ transform data into valuable insights that inform business...

  • Data Engineer

    1 month ago

    City of London, United Kingdom Data Idols Full time

    **Senior Data Engineer** Data Idols are proud to be working with an iconic UK brand to assist them in hiring a Senior Data Engineer as they undertake a digital and data-driven journey that will transform the business. Data is at the heart of the organisation and forms a key partof their future plans. **The Opportunity** As a Senior Data Engineer you will be...

  • Lead Data Engineer

    3 hours ago

    City of London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Job Title: Lead Data Engineer Location: London **Salary**: Up to £100K + 10 % - 20 % **Job Description**: We are seeking a highly motivated and experienced Lead Data Engineer to join a data-centric insurance company. As the Lead Data Engineer, you will be responsible for managing the development, deployment, and maintenance of our data infrastructure....

  • Lead Data Engineer

    2 months ago

    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **LEAD DATA ENGINEER £70,000 - £75,000 + BENEFITS HYBRID - LONDON OR MAIDENHEAD** Are you a Senior Data Engineer looking for an exciting new role working within a team of likeminded individuals? Do you want to become an integral part of a team working within a betting company? If this is the role you have been searching for read on! **THE...

  • AI Data Science Engineer

    3 days ago

    London, United Kingdom Abs Data Full time

    AI Squad – Data Engineer KPMG Azure Data EngineerBase Location: London – (Hybrid working – 2 days in the offices)The KPMG Audit Technology team is dedicated to building cutting-edge solutions in close collaboration with the Audit function. We blend audit expertise with the latest technology, enabling us to understand the challenges our customers...

  • Data Office Transformation Data Engineering Lead

    3 weeks ago

    London, United Kingdom DATAHEAD Full time

    Senior Data Engineering Lead - Analytics & Infrastructure Financial Services £120,000 + 20% Bonus 2 days in the office per week (Central London) A leading global insurer is on a transformative journey to become the benchmark for quality across all its insurance markets. Leveraging a state-of-the-art Data and Analytics strategy, we are redefining client...

  • Data Office Transformation Data Engineering Lead

    3 weeks ago

    London, United Kingdom DATAHEAD Full time

    Senior Data Engineering Lead - Analytics & Infrastructure Financial Services £120,000 + 20% Bonus 2 days in the office per week (Central London) A leading global insurer is on a transformative journey to become the benchmark for quality across all its insurance markets. Leveraging a state-of-the-art Data and Analytics strategy, we are redefining client...

  • Data Office Transformation Data Engineering Lead

    9 hours ago

    London, United Kingdom DATAHEAD Full time

    Senior Data Engineering Lead - Analytics & Infrastructure Financial Services £120,000 + 20% Bonus 2 days in the office per week (Central London) A leading global insurer is on a transformative journey to become the benchmark for quality across all its insurance markets. Leveraging a state-of-the-art Data and Analytics strategy, we are redefining client...

  • Data Office Transformation Data Engineering Lead

    9 hours ago

    London, United Kingdom DATAHEAD Full time

    Senior Data Engineering Lead - Analytics & Infrastructure Financial Services £120,000 + 20% Bonus 2 days in the office per week (Central London) A leading global insurer is on a transformative journey to become the benchmark for quality across all its insurance markets. Leveraging a state-of-the-art Data and Analytics strategy, we are redefining client...

  • Data Office Transformation Data Engineering Lead

    2 weeks ago

    London, United Kingdom DATAHEAD Full time

    Job Description Senior Data Engineering Lead - Analytics & Infrastructure Financial Services £120,000 + 20% Bonus 2 days in the office per week (Central London) A leading global insurer is on a transformative journey to become the benchmark for quality across all its insurance markets. Leveraging a state-of-the-art Data and Analytics strategy, we are...

  • Data Engineer

    1 month ago

    London, United Kingdom Data Idols Full time

    **Data Engineer** Data Idols are proud to be working with a growing veterinary business who are extremely data driven and have a great mission to use data to improve the welfare of animals. They have a revolutionary data team who want to be recognised as the UK's leadingveterinary group and are home to some of the best clinicians world-wide; would you like...

  • Data Engineer

    4 weeks ago

    London, United Kingdom Data Idols Full time

    **Data Engineer** Data Idols are proud to be working with a leading technology and engineering consultancy who have been running for decades globally. They work with a variety of clients across different industries on their biggest challenges. Would you like to work alongsidethis company, where you get the chance to work across a wide range of tools, tech,...

  • Data Office Transformation Data Engineering Lead

    7 days ago

    London, United Kingdom Cynergy Bank Limited Full time

    Job Title: Data Engineering & Architecture Lead Contract Perm/FTC: Permanent Worktype Place – Full time in office or Hybrid: Hybrid, 3 days in office, 2 WFH Cynergy Bank is the UK’s human digital bank serving the needs of ‘scale up’ or medium sized and fast-growing SMEs; high net worth and mass affluent individuals, in essence those market...

  • Data Office Transformation Data Engineering Lead

    1 week ago

    London, United Kingdom Cynergy Bank Limited Full time

    Job Title: Data Engineering & Architecture Lead Contract Perm/FTC: Permanent Worktype Place – Full time in office or Hybrid: Hybrid, 3 days in office, 2 WFH Cynergy Bank is the UK’s human digital bank serving the needs of ‘scale up’ or medium sized and fast-growing SMEs; high net worth and mass affluent individuals, in essence those market...

  • Data Engineer

    1 month ago

    London, United Kingdom Data Idols Full time

    **Data Engineer** Data Idols are excited to be working with one of the top 100 companies in the world to recruit a Data Engineer! A company which owns multiple brands and who are investing heavily into 'all things data' to revolutionise their extraordinary team. **Skills and Experience**: - Experience with Azure - Experience with SQL - Experience with...

  • Data Engineering Lead Engineer

    3 weeks ago

    London, United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer. As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...

  • Data Engineering Lead Engineer

    1 week ago

    London, United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer. As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...

  • Senior Engineer, Data Engineering

    13 hours ago

    London, United Kingdom Abs Data Full time

    Data Engineer With more than 55,000 people in 40+ countries, working at Jacobs offers an exciting range of opportunities to develop your career within a supportive and diverse team who always strive to do the right thing for our people, clients and communities. People are Jacobs’ greatest asset, and we offer a competitive package to retain and attract...