Senior Data Pipeline Engineer
2 days ago
We are seeking a highly skilled Senior Data Pipeline Engineer to join our team at Principle. As a Lead Data Architect - SQL, you will be responsible for designing and building robust data pipelines that drive critical insights across the organisation.
Key Responsibilities:
- Designing and optimising end-to-end data pipelines for efficient data flow and scalability
- Building and maintaining Python-based ETL pipelines and data models for reliable data processing
- Collaborating with cross-functional teams to support both batch and real-time data needs
- Ensuring data accuracy, integrity, and performance across all data operations
Required Skills and Qualifications:
- 5+ years of Data Engineering experience
- Strong Python and SQL skills for data manipulation and pipeline development
- Hands-on experience with Airflow (workflow orchestration) and Spark (large-scale data processing)
- Ability to work with cross-functional teams
Benefits:
- Competitive salary: £80,000 - £110,000 per annum
- Bonus structure
- Comprehensive benefits package
Others:
Candidates must be physically based in the UK, hold a valid Work Permit / Visa, and have the right to work in the UK without sponsorship.
-
Data Pipeline Optimization Expert
6 days ago
London, Greater London, United Kingdom Northern Data Group Full timeOverviewNorthern Data Group is a cutting-edge company that's changing the face of High-Performance Computing. With a strong focus on innovation and sustainability, we're shaping the future of data centers worldwide.Job SummaryWe're seeking a highly skilled Senior Data Engineer to join our team. As a key member of our Data Team, you will play a crucial role...
-
Senior Data Pipeline Architect
2 days ago
London, Greater London, United Kingdom Data Idols Full timeYour Future Role:As a Staff Data Engineer at Data Idols, you will be responsible for designing, developing, and maintaining data pipelines that deliver high-quality insights. You will work closely with the wider data teams to ensure seamless data flow and implement best practices to drive continuous improvement in data quality and delivery. This is an...
-
Data Engineer
7 days ago
London, Greater London, United Kingdom Data Science Festival Full timeCompany OverviewThe Data Science Festival is one of the best-known retail brands in the UK, looking for a skilled Staff Data Engineer to support the delivery of data transformation during an exciting time within the company. As a Staff Data Engineer, you will collaborate with the wider data teams to build and maintain data pipelines.
-
Data Pipeline Architect
1 week ago
London, Greater London, United Kingdom Northern Data Group Full timeAbout the TeamNorthern Data Group is a leading provider of High-Performance Computing (HPC) solutions. Our team is dedicated to delivering innovative data-driven solutions to our clients.Main Responsibilities:Design, build, and maintain data pipelines and infrastructure to support data analysis and reporting.Collaborate with business stakeholders to...
-
Senior Data Engineer
2 days ago
London, Greater London, United Kingdom Data Idols Full timeThe OpportunityIn this key role, you will play a crucial part in driving high standards across the data function. You will support the team in building pipelines to deliver insights that enable informed decision-making, making us more data-driven. Additionally, you will work closely with the wider team, acting as a mentor to junior members and sharing your...
-
Senior Python Pipeline Developer
4 days ago
London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time£70,000 per annum, LondonAbout HarnhamWe are a dynamic and innovative insurance company with a passion for delivering high-quality solutions.Our team is committed to excellence and is now seeking a highly skilled Senior Python Pipeline Developer to join our team.In this role, you will be responsible for building and maintaining Python-based pipelines,...
-
Data Pipeline Architect
3 days ago
London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full timeJob DescriptionWe are seeking a highly skilled Data Engineer to join our team in London. As part of our data migration project, you will be responsible for designing and managing ETL processes to support seamless data integration from new acquisitions.About the ProjectWe are working with a high-growth insurance brokerage to migrate their data to a modern...
-
Lead Data Pipeline Developer
1 week ago
London, Greater London, United Kingdom Data Idols Full time £85,000 - £95,000About the Role: Lead Data Pipeline DeveloperWe are seeking an experienced lead developer to join our data team as a Lead Data Pipeline Developer. In this role, you will be responsible for designing, developing, and maintaining complex data pipelines that deliver business-critical insights. The ideal candidate will have experience in data warehousing, data...
-
Enterprise Data Pipeline Engineer
2 weeks ago
London, Greater London, United Kingdom Palantir Technologies Full timePalantir Technologies is looking for an Enterprise Data Pipeline Engineer to join our team. In this role, you will be responsible for designing and implementing large-scale data pipelines that meet the needs of our customers.The estimated salary for this position is $140,000 per year, based on the national average for a senior software engineer with similar...
-
Data Engineering Expert
3 days ago
London, Greater London, United Kingdom Data Idols Full time £75,000 - £100,000Company OverviewData Idols is a leading UK-based brand seeking an experienced Senior Data Engineer to support the delivery of data transformation during an exciting time within the company. With a strong focus on building and maintaining data pipelines using modern data technologies in a cloud environment, this role requires extensive experience with data...
-
Senior Data Pipeline Engineer
2 days ago
London, Greater London, United Kingdom Opus Recruitment Solutions Full timeJob DescriptionAs a Data Engineer, you will play a key role in shaping the data infrastructure and analytics capabilities of our client, a leading start-up in the financial sector. Your primary responsibilities will include:Developing and maintaining scalable and performant data pipelines using cloud infrastructure.Optimizing existing pipelines for speed,...
-
Data Engineer Leader
1 week ago
London, Greater London, United Kingdom Data Idols Full time £75,000 - £95,000**About Data Idols**Data Idols is a renowned retail brand in the UK, seeking an exceptional Senior Data Engineer to drive data transformation. As a Senior Data Engineer at Data Idols, you will play a pivotal role in delivering high-quality data solutions.The ideal candidate will have extensive experience with data pipelines, data warehousing, and cloud-based...
-
Full Stack Data Pipeline Expert
1 day ago
London, Greater London, United Kingdom Data Science Festival Full timeAbout the RoleWe are looking for a talented Full-stack Data Engineer to join our team at Data Science Festival. In this role, you will be responsible for improving data structures, pipelines, and reporting.Key Responsibilities:Modernise data pipelines, data standards, and data reportsImprove data handling and development processesAs a Full-stack Engineer,...
-
Senior Data Architect
4 weeks ago
London, Greater London, United Kingdom Data Idols Full timeSenior Data EngineerThe OpportunityWe are seeking a Senior Data Engineer to join our team at Data Idols, a leading retail brand in the UK. As a Senior Data Engineer, you will play a key role in driving high standards across the data function and building reliable and high-quality data solutions.Key ResponsibilitiesDesign and develop data pipelines using...
-
Data Pipeline Specialist
3 days ago
London, Greater London, United Kingdom ISR Recruitment Full timeSenior Data EngineerISR Recruitment is seeking a highly skilled Senior Data Engineer to join our client's team on a major central government project.The Opportunity: This exciting role involves providing data services to develop robust data pipelines, analytics and visualisation tools that support the integration of multiple infrastructure datasets across...
-
Senior Data Infrastructure Architect
2 days ago
London, Greater London, United Kingdom Data Idols Full timeDrive Business Growth with Data-Driven InsightsAt Data Idols, we believe that data is the key to driving business growth. As a Senior Data Engineer, you will play a critical role in designing and implementing data pipelines that provide actionable insights to our stakeholders.Your Key ResponsibilitiesDesign and implement data pipelines using Python and...
-
Senior Image Data Pipeline Specialist
4 days ago
London, Greater London, United Kingdom Xcede Full timeAbout the RoleXcede is seeking an experienced Senior Image Data Pipeline Specialist to join our team in London. The successful candidate will be responsible for designing and implementing scalable data pipelines for advanced analytics and machine learning applications. The ideal candidate will have a strong background in data engineering, image data...
-
Senior Data Pipeline Specialist
2 days ago
London, Greater London, United Kingdom FinTop Consulting Full timeJob Summary: We are seeking a highly skilled Senior Data Engineer to join our team at FinTop Consulting. As a Senior Data Engineer, you will design and develop scalable data pipelines, automate data processes, and ensure data quality. This role requires strong experience as a Data Engineer with knowledge of the Azure stack, proficiency in Python, PySpark,...
-
Senior Data Transformation Specialist
1 week ago
London, Greater London, United Kingdom Data Idols Full time £75,000 - £95,000**Overview of Role**We are seeking a highly skilled Senior Data Engineer to join our team at Data Idols. As a key member of our data function, you will be responsible for designing, building, and maintaining robust data pipelines that drive business growth.The successful candidate will have a strong background in data engineering, with expertise in data...
-
Senior Data Pipeline Specialist
7 days ago
London, Greater London, United Kingdom Vallum Associates Full timeSenior Data Pipeline SpecialistWe are seeking an experienced Senior Data Pipeline Specialist to join our team at Vallum Associates. This role is critical in designing, implementing, and maintaining efficient data pipelines using Apache Kafka. As a key member of our engineering team, you will work closely with stakeholders to identify business needs and...