Lead Data/BI Engineer

2 weeks ago

London, Greater London, United Kingdom Entertainment Services Alliance, Inc. Full time
Shaping culture is in the DNA of ITV.

So, it's not surprising that you'll find us in every home in the UK, our productions are famous all over the world and we're at the forefront of the digital streaming revolution.

With opportunities to learn, to grow and make a real difference. Our data team is responsible for helping us realise the value of data. That could mean anything from up-skilling and training our people, to increasing our revenue through experimentation and personalisation. The Innovation strand consists of Data Scientists, Operational Researchers and Behavioural Scientists.

As we enter the fourth industrial revolution, anyone who joins the team will have the opportunity to work on genuinely groundbreaking innovations so that we can continue to blend science into a creative business.

As a Lead Data Engineer, both directly and via your team, you will be responsible for developing, maintaining, and optimising our data pipeline infrastructure using our proprietary central data platform (Symphony), which is based on Databricks.

You will collaborate with cross-functional teams to design and implement scalable data solutions, ensuring efficient data ingestion, transformation, storage, and analysis.

This is a hands-on leadership role where you will be responsible for a small team of data engineers.

You will work in partnership with your agile delivery manager and product manager to size up and breakdown work, and distribute that across your team, and be proactive in bringing that activity to closure.

Deliver technical leadership monitoring productivity and output; contributing to reviews and performance assessment of a small number of data engineers

  • Ownership and delivery of the design, development, and maintenance of scalable data pipelines, infrastructure and data products using Databricks. Including implementation of efficient and reliable data ingestion, processing, and storage solutions at scale and prototyping new approaches.
  • Develop and optimise extract, transform, load (ELT) processes ensuring smooth flow of data from various sources into the data platform. Perform data cleansing, validation, and enrichment to support accurate and reliable data analysis.
  • Ensure adherence to data architecture principles, best practices and processes, collaborating with data scientists, analysts and stakeholders capturing and defining data requirements, designing appropriate data models and architectures whilst optimising data storage formats and partitioning for efficient data retrieval and analysis.
  • Monitor and optimise data pipelines and workflows to ensure high performance and reliability. Identify and resolve performance bottlenecks, data quality issues, and data integration challenges.
  • Define the data quality characteristics of your data products and work with the QA team to implement automated quality processes to measure data correctness and report outcomes through our observability infrastructure
  • Implement data governance practices and ensure compliance with ITV data privacy and security regulations. Establish data access controls, encryption mechanisms, and data retention policies. Ensure all data products conform to all observability requirements and suitable dashboards are in place.
  • Work closely with cross-functional teams, including data scientists, analysts, and software engineers, to understand their requirements and provide data engineering support. Document data pipelines, workflows, data presentation implementations and technical specifications for future reference.
  • This will include writing and giving presentations to the wider team
  • Extensive experience leading small teams of data engineers
Experience designing and building Databricks data products
Strong programming skills in languages such as Python (PySpark preferred), Scala, or SQL
Experience in owning, designing and implementing data pipelines ingesting enterprise levels of data volume with strong knowledge of data engineering concepts, data integration, and ETL processes
Ability to write production-grade code including automated testing and able to deploy code via CI/CD platforms (e.g. Experience in Proficiency in working with distributed computing frameworks, such as Apache Spark and data modelling, database systems, and SQL optimisation techniques
AWS, Azure, Google Cloud) and associated services (e.g., Knowledge of the UK broadcast industry & broadcast/OTT advertising market and digital marketing and advertising industry
Data design techniques for classification and regression as well as knowledge of A/B testing, experimental design, and general statistical modelling
Architecture disciplines such as Data Mesh Architecture, Data Architecture, BI Architecture and Enterprise Architecture
Data governance, data privacy, and security principles.
Tools across other data management capabilities – data engineering, data governance, data quality, metadata management and master data management
Designing and building out data visualisation solutions based on technology such as: Tableau, AWS QuickSight, Looker, ThoughtSpot

  • Lead BI Analyst

    2 weeks ago

    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    LEAD BI ANALYSTLONDON - HYBRID - Minimum 2 days in the office.Up to £65,000We are looking for a Lead BI Analyst to build and expand one of the UK's top finance provider's Business Intelligence capabilities from the ground up. With an eye on growing the team rapidly, this company is looking for a lead in BI practices with strongdata analysis, data modelling,...

  • BI & Data Engineer

    2 weeks ago

    London, Greater London, United Kingdom MRP Technology Ltd Full time

    BI & Data Engineer at Leading Global BrandA fantastic opportunity for a skilled BI & Data Engineer to join a renowned global brand. This is a 100% remote working role on a 12-month contract, with the potential for extension. In this position, you will play a crucial role in supporting the business's cloud migration journey across Europe.Key Requirements: -...

  • BI Data Engineer

    2 weeks ago

    London, Greater London, United Kingdom Yolk Recruitment Ltd Full time

    BI Engineer (AWS) | London | Hybrid (2 days per week onsite) | Up to £65,000 | 2 stage interview processAre you a highly skilled BI Data Engineer looking for a new challenge? Yolk Recruitment is excited to support a leading UK publisher in their search for a talented individual to join their team as a BI Data Engineer. If you're ready to take your career...

  • Lead BI Developer

    2 weeks ago

    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    SENIOR BI DEVELOPERLONDON£80, ,000Do you want to work with a global home improvement retailer as they look to expand its eCommerce platform to service its eight brands?THE COMPANYThe company is looking to integrate data generated from its multiple channels into a single customer platform to improve commercial operations. As the Senior BI Developer, you will...

  • Data and Analytics BI Lead

    2 weeks ago

    London, Greater London, United Kingdom AECOM Full time

    Company DescriptionWhen you join AECOM, you become part of the world's premier infrastructure firm - 56,000 strong across seven continents who all contribute in pioneering the future. Our teams around the world are involved in some of the most cutting-edge and innovative projects and programs of our time, addressing the big challenges of today and shaping...

  • Power BI Developer

    2 weeks ago

    London, Greater London, United Kingdom Data Idols Full time

    Power BI DeveloperData Idols is working with a global FMCG on a contract position that requires a detailed Power BI Developer for an initial 3-month project. You will work with a wider data team to translate business requirements into dashboards with good UX/UI abilities to make the information clear and concise for multiple stakeholders.The OpportunityThis...

  • Power BI Developer

    2 weeks ago

    London, Greater London, United Kingdom Data Idols Full time

    Power BI DeveloperApply promptly A high volume of applicants is expected for the role as detailed below, do not wait to send your CV.Data Idols is working with a global FMCG on a contract position that requires a detailed Power BI Developer for an initial 3-month project. You will work with a wider data team to translate business requirements into dashboards...

  • Data Engineer

    2 weeks ago

    London, Greater London, United Kingdom Data Idols Full time

    Data Engineer Are you a mid-level Data Engineer skilled in Azure technologies, seeking an new 'feel-good' permanent opportunity? Data Idols are proud to be supporting a HealthTech client, who use remote-first technology focusing on engagingpatients across their healthcare journey while saving hospitals time, effort, and money This opportunity provides remote...

  • Power BI Developer

    2 weeks ago

    London, Greater London, United Kingdom Data Idols Full time

    Power BI Developer Data Idols is collaborating with a global FMCG on a contract role that needs a meticulous Power BI Developer for an initial 3-month project. You will collaborate with a diverse data team to interpret business needs into dashboards with great UX/UI skills to present information clearly and concisely to various stakeholders. The...

  • Lead Data Engineer

    2 weeks ago

    London, Greater London, United Kingdom Eames Consulting Full time

    My client, a leading tech-focused insurance broker, is looking for a Lead Data Engineer to join their central Data Innovation Team and deliver a new Azure data platform. They offer global broking solutions with a footprint in over 90 countries. The Successful Lead Data Engineer will:Lead on the design and development of high-performance data solutionsDefine...

  • Senior Engineer, Data Engineering

    2 weeks ago

    London, Greater London, United Kingdom Data Science Festival Full time £70,000 - £85,000

    Senior Data Engineer Location: London, 3/2 days in the office per week Data Idols are currently working with a company that focus on the european marketplace for transport who are looking to make the future greener Within this role as a Senior Data Engineer, you will be monitoring, designing and implementing a datawarehouse, whilst working with different...

  • BI Engineer

    2 weeks ago

    London, Greater London, United Kingdom Harnham Full time £50,000 - £70,000

    BI ENGINEER CENTRAL LONDON – HYBRID (3 DAYS A WEEK)£A great opportunity for a BI Engineer to bridge the gap between Data Engineering and BI reporting at an asset management firm expanding their data and analytics team. Join a forward-thinking asset management firm dedicated to helping clients maximise their financial returns. With a focus on secured...

  • BI / Data Architect, Power Bi

    2 weeks ago

    London, Greater London, United Kingdom Arc IT Recruitment Full time

    **BI / Data Architect, Power BILondon / Remote£Competitive plus bonus plus benefits_Power BI_Data Architect is required to join the progressive data tech team within a vibrant global insurance organisation. This role will provide leadership in design, implementation, and maintenance of effective Power BI solutions for the organisation. You willcollaborate...

  • Senior BI Analyst

    2 weeks ago

    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **Senior BI Analyst - PowerBI, Azure, SQLCentral London£55,000 + bonus and benefits**A market-leading student accommodation business are looking to add a Senior BI Analyst to drive visualised and insight-led reporting across their business using SQL, PowerBI and Azure. You will be delivering that end to end, including working on data pipelines/ the data...

  • Lead Data Engineer

    2 weeks ago

    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Lead Data Engineer - Residential Property CompanyLocation: London (flexible working available)Salary: CompetitiveWe are a leading residential property company looking to hire a Lead Data Engineer to join our growing data-focused team. You will be responsible for leading a team of data engineers and playing a key role in the development and maintenance of our...

  • BI and Data Engineer

    2 weeks ago

    London, Greater London, United Kingdom Forward Trust Full time £41,000

    Data Visualisation Engineer We are Forward, the social enterprise that empowers people to break the cycle of crime or addiction to move forward with their lives. Our services have supported thousands of people to make positive changes and build productive lives with a job, family, friends and a sense of community. The Data Visualisation Engineer (DVE) is...

  • Lead Data Engineer

    2 weeks ago

    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Lead Data Engineer Location: LondonSalary: £100,000 + BenefitsExciting Opportunity in LondonDo you want to work in the media sector for a top company? We are currently seeking a skilled Lead Data Engineer ready for a new challenge and eager to grow in their career.About the CompanyThis innovative media company is data-driven and is seeking a Lead Data...

  • Senior BI Developer

    2 weeks ago

    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Senior BI DeveloperUp to £80,000 + competitive pension + private healthcareLondon**THE COMPANY**A FTSE100 company in the Digital space, growing at an exponential rate. This role is with a multinational retailing company based in London with over a thousand stores, dotted across nine different countries. They specialise in home improvement productsand own 6...

  • Lead Data Engineer

    2 weeks ago

    London, Greater London, United Kingdom Sterlings Full time

    Job DescriptionA Financial Service Company is currently seeking a Lead Data Engineer to join its EMEA Technology team.This person will lead the design, development, and maintenance of scalable and efficient data pipelines to support data-driven applicationsThe Lead Data Engineer will also collaborate with cross-functional teams, including data scientists,...

  • Power BI Data Analyst

    2 weeks ago

    London, Greater London, United Kingdom BAM UK & Ireland Full time

    Building a sustainable tomorrowBAM UK and Ireland is recruiting a BI Data Analyst to join the team. This role can be based out of of of our UK & Ireland office locations. BAM operates a flexible working policy.Your mission• Collaborate closely with stakeholders to understand their requirements and translate them into effective solutions using MS Power BI,...