Lead Data Pipelines Developer

3 weeks ago


Edinburgh, Edinburgh, United Kingdom AI Connect Full time

About the Role

">

AI Connect is seeking a talented Senior Data Engineer to join our team in Edinburgh or London. As a Senior Data Engineer, you will be responsible for developing innovative data-driven solutions, driving customer value, and promoting the adoption of new data techniques within our organization.

">

Key Responsibilities:

">
  • ">
  • Develop and implement data pipelines, models, and ETL processes to ensure commercial success and data safety.">
  • Understand complex business problems and apply suitable tools to gather and build data solutions.">
  • Automate end-user developed applications and data engineering pipelines to improve efficiency.">
  • Implement solutions for streaming data ingestion and transformations in line with our company's strategy.">
  • Promote the adoption of new data techniques through training and oversight.">
">

Requirements:

">

To be successful in this role, you should possess advanced technical skills in Python, PySpark, SQL, GitLab, and AWS tools. Familiarity with data warehousing and data modeling capabilities, as well as experience in ETL technical design, data quality testing, and data sourcing, is also necessary.

"]},

  • Edinburgh, Edinburgh, United Kingdom Addepar Full time

    Data Engineering Director Job DescriptionJoin Addepar's dynamic team as we seek a Data Engineering Director to lead our Portfolio Data Engineering team in Edinburgh. This role offers an exciting opportunity to drive business outcomes through agile collaboration with product counterparts.Role Overview:This key leadership position requires a seasoned data...


  • Edinburgh, Edinburgh, United Kingdom Incentive Games Full time

    We are seeking an experienced Data Engineer to join our team at Incentive Games. As a key member of our data team, you will be responsible for designing, implementing, and maintaining robust data infrastructure and pipelines.Job Description:Design and develop scalable ETL pipelines using AWS cloud technologies to ensure efficient data ingestion, processing,...


  • Edinburgh, Edinburgh, United Kingdom Bright Purple Full time

    Cloud Data Architect - New Year OpportunitiesBright Purple's esteemed client is inviting applications from experienced Cloud Data Architects to join a high-profile greenfield project in the UK.The successful candidate will design and develop an end-to-end data pipeline using AWS services, ensuring scalability, reliability, and security.Design and...


  • Edinburgh, Edinburgh, United Kingdom Be-IT Resourcing Full time

    We are looking for two experienced data engineers to join our team at Be-IT Resourcing on a 6-month contract. The ideal candidates will have a strong background in designing and building data processing pipelines using native AWS services.About the ContractThe contract is for an initial 6 months, with the possibility of extension depending on performance and...


  • Edinburgh, Edinburgh, United Kingdom ADLIB Full time

    Data Engineer Job DescriptionWe are seeking a skilled Data Engineer to join our team at ADLIB, a leading UK-based financial services company.Main ResponsibilitiesThe successful candidate will be responsible for:Crafting and managing sophisticated data pipelines on cloud and on-prem platforms.Collaborating with stakeholders to leverage data in new, innovative...

  • Data Scientist Lead

    3 weeks ago


    Edinburgh, Edinburgh, United Kingdom Build a Rocket Boy Full time

    Data Science Lead Job DescriptionWe are seeking a highly skilled Data Scientist Lead to join our team at Build a Rocket Boy. As a key member of our data science group, you will be responsible for leading the development of our data infrastructure and driving business growth through data-driven insights.The ideal candidate will have extensive experience in...


  • Edinburgh, Edinburgh, United Kingdom NearTech Search Full time

    About the JobNearTech Search is collaborating with a leading AI/Machine Learning start-up based in Edinburgh.The successful candidate will be pivotal in building and optimizing scalable AI and ML pipelines to support advanced NLP and LLM applications.You will work closely with data scientists and engineers to integrate AI solutions into the company's...

  • Data Engineering Lead

    2 weeks ago


    Edinburgh, Edinburgh, United Kingdom Addepar Full time

    Job DescriptionCompany Overview:We are a leading fintech company, Addepar, seeking an experienced Data Engineering Director to lead our Portfolio Data Engineering team in Edinburgh. Our platform provides a single source of truth "data fabric" used by the Addepar product set.About the Role:We are looking for a highly motivated and experienced professional to...


  • Edinburgh, Edinburgh, United Kingdom Lloyds Banking Group Full time

    Data & Tooling Technical LeadLloyds Banking Group seeks a skilled Data & Tooling Technical Lead to join its Chief Security Office.This role involves leading the development of vulnerability data pipelines, ensuring the quality of vulnerability data, and providing actionable insights from high-volume complex data.Responsibilities include creating and...


  • Edinburgh, Edinburgh, United Kingdom Trustpilot, Inc. Full time

    About the RoleWe are looking for an experienced Staff Data Governance and Security Engineer to join our team in Edinburgh. As a key member of our data engineering team, you will be responsible for optimizing the backbone of our data ecosystem, leading the design and development of performant data infrastructure, and identifying improvement opportunities for...

  • Data Engineering Lead

    2 weeks ago


    Edinburgh, Edinburgh, United Kingdom AI Connect Full time £70,000 - £120,000

    Senior Data Engineer £70,000 - £120,000 + Bonus & BenefitsWe are partnering with a retail bank to help them appoint a Senior Data Engineer. The successful candidate will join a major data engineering capability and work alongside peers who can support their development across a modern tech stack.Job Responsibilities:Develop innovative data-driven...

  • Lead Data Scientist

    4 weeks ago


    Edinburgh, Edinburgh, United Kingdom Royal London Mutual Insurance Society Full time

    Senior Data Engineer Job SpecificationWe require a highly skilled Senior Data Engineer to lead our data engineering team. The ideal candidate will have a strong understanding of data engineering principles, including data pipelines, data warehousing, and data lakes. They will also possess excellent communication skills, with the ability to collaborate with...


  • Edinburgh, Edinburgh, United Kingdom SGN Full time

    Job DescriptionAs a Pipelines Craftsperson, you will be responsible for understanding the importance of corrosion control, condition assessment, and maintenance on our high-pressure steel pipeline networks. This includes:Assessing the pipeline's conditionPreventing damage by third-party activitiesKeeping the pipeline safeRegularly surveying the pipeline...


  • Edinburgh, Edinburgh, United Kingdom Unitech Consultancy Full time

    Are you a seasoned Data Engineer looking for a new challenge? Do you want to join a leading consultancy that values innovation and collaboration? Look no further!About the RoleWe are seeking an experienced Data Engineer to join our data team, working on cutting-edge projects that drive business growth and improve data-driven decision-making. In this role,...

  • Data Architect Lead

    4 weeks ago


    Edinburgh, Edinburgh, United Kingdom NatWest Group Full time

    We are seeking a highly skilled Data Architect to lead the development of our data architecture. This is an exciting opportunity for an experienced professional to shape the technical direction of our data solutions and drive business outcomes.As a Data Architect, you will work closely with cross-functional teams to design and implement data-intensive...

  • Data Engineering Lead

    2 weeks ago


    Edinburgh, Edinburgh, United Kingdom Royal London Mutual Insurance Society Full time

    We are seeking a skilled Data Engineering Lead to join our team at Royal London Mutual Insurance Society.">The successful candidate will be responsible for leading cross-functional projects, mentoring junior team members, and promoting engineering best practices. This includes designing and developing data pipelines, collaborating with stakeholders, and...


  • Edinburgh, Edinburgh, United Kingdom ADLIB Full time

    We are seeking an experienced Cloud Data Specialist to lead crucial initiatives in Analytics, Data Science and Machine Learning.This role offers the chance to work hands-on with Databricks, Azure and AWS. As a leading UK-based financial services company, this opportunity is perfect for someone ready to mentor and steer cross-functional projects that impact...

  • Data Engineer Lead

    5 days ago


    Edinburgh, Edinburgh, United Kingdom Trustpilot Full time

    About the RoleAs a Data Engineer Lead, you will be accountable for optimizing existing data processing to minimize wastage (compute and spend) and improve data quality. This includes designing reliable, consistent, scalable data ingestion, transformation, and integration pipelines.You will drive data ownership and accountability across engineering teams and...


  • Edinburgh, Edinburgh, United Kingdom Build a Rocket Boy Full time

    **Key Responsibilities:Create and maintain complex animation graphs.Integrate new animations into the existing pipeline.Solve gameplay animation issues through thorough debugging.Evaluate and address potential compromises to animation quality due to technical limitations.**Benefits Package:**We offer a comprehensive benefits package, including unlimited...


  • Edinburgh, Edinburgh, United Kingdom SGN Full time

    **Career Opportunities in Gas Infrastructure**SNG is at the forefront of pioneering research and development in the journey toward a net-zero energy system. We offer plenty of opportunities for training, progression, and a career in the energy industry with our CVless approach to uncover your values, skills, and cognitive abilities.Industry-leading...