Data Engineering Lead

4 weeks ago


Salford, Salford, United Kingdom Moody's Full time

We are seeking a dynamic and experienced Data Engineering Lead to spearhead our efforts in transforming and optimizing our extensive data assets for use with Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) systems. This pivotal role involves extracting and transforming entity-level data, distributing large datasets across various platforms, and managing bulk data feeds in multiple formats. The successful candidate will lead a team of contractors and full-time engineers, collaborate with data scientists and analysts, and ensure the efficiency, scalability, and maintainability of our data pipelines. With a strong background in data engineering, proficiency in Python and SQL, and experience with diverse data formats and platforms, the ideal candidate will drive innovation and excellence in our data management processes.

Key Responsibilities:
  • Extract and transform entity-level data into formats suitable for LLMs and RAGs.
  • Make large datasets available across various distribution platforms, including SFTP, data marketplaces, and Databricks Delta Sharing.
  • Create and manage bulk data feeds in multiple formats such as delimited text, JSON, Parquet, Avro, etc.
  • Manage a team of contractors and build a team of full-time engineers as the project progresses towards completion.
  • Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
  • Ensure data pipelines are efficient, scalable, and maintainable.
Requirements:
  • 5-10 years of experience in data engineering or related fields.
  • Proficiency in Python and SQL.
  • Experience with various data formats including delimited text, JSON, Parquet, Avro, etc.
  • Familiarity with data distribution platforms such as SFTP, data marketplaces, and Databricks.
  • Strong understanding of data extraction, transformation, and loading (ETL) processes.
  • Proven experience in managing a team of contractors and building a team of full-time engineers.
  • Understanding of how to prepare data for machine learning models and retrieval-augmented generation systems.
  • Experience with big data technologies and tools.
  • Familiarity with cloud platforms such as AWS, Azure, or Google Cloud.

  • Data Engineering Lead

    3 weeks ago


    Salford, Salford, United Kingdom Moody's Investors Service Full time

    We are seeking a highly skilled Data Engineering Lead to spearhead our efforts in transforming and optimizing our extensive data assets for use with Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) systems.This pivotal role involves extracting and transforming entity-level data, distributing large datasets across various platforms, and...


  • Salford, Salford, United Kingdom ShortList Recruitment Limited Full time

    Job Description:We are seeking a highly skilled Data Architect to play a key role in our digital transformation journey. As a Data Architect and Technical Lead, you will be responsible for developing a comprehensive organisational data strategy aligned with business processes and goals.Key Responsibilities:Develop a data strategy that aligns with business...

  • Data Engineer

    4 weeks ago


    Salford, Salford, United Kingdom Moody's Investors Service Full time

    Role SummaryWe are seeking a highly skilled Data Engineer to join our team at Moody's Investors Service. As a key member of our data engineering team, you will play a pivotal role in transforming our data pipelines from capture data change through entity resolution to data mastering.Key ResponsibilitiesDesign and implement cutting-edge, event-based data...


  • Salford, Salford, United Kingdom BBC Group and Public Services Full time

    About the RoleWe are seeking a talented Senior AWS Engineer to join our tech community and drive our ambition to build an outstanding software engineering team, environment, and culture.As a key member of our Machine Learning Enablement Team, you will play a crucial role in building new capabilities that will unlock new horizons for the BBC Data Science...


  • Salford, Salford, United Kingdom Moody's Investors Service Full time

    At Moody's, we are revolutionizing the financial technology landscape with cutting-edge solutions. Our team is expanding to work on a data streaming pipeline that processes large company datasets.As a Senior Software Engineer - Data Pipeline Specialist, you will play a pivotal role in driving the quality assurance of our data pipeline. Your...


  • Salford, Salford, United Kingdom BBC Full time

    Job SummaryAs a Software Engineer, you will be responsible for designing and implementing cloud-based systems, as well as analyzing and interpreting large data sets. You will work closely with the development team to ensure seamless integration of cloud infrastructure and data engineering solutions. Key responsibilities include: • Developing and...

  • Data Architect

    4 weeks ago


    Salford, Salford, United Kingdom ShortList Recruitment Limited Full time £85,000

    Data ArchitectAt ShortList Recruitment Limited, we're seeking a highly skilled Data Architect to play a pivotal role in our digital transformation. This is an exceptional opportunity to lead the development of a comprehensive organisational data strategy, aligning with business processes and goals. Key responsibilities include designing and implementing...


  • Salford, Salford, United Kingdom BBC Full time

    OverviewThe BBC is a pioneer in the media industry, shaping the future through innovative technologies. As a Senior Software Engineer, you will be at the forefront of this journey, crafting tools and functions that drive transformation.About the RoleThis exciting opportunity is part of our Machine Learning Enablement Team, building new capabilities that...


  • Salford, Salford, United Kingdom Moody's Investors Service Full time

    Role: We're expanding our team at Moody's to work on a cutting-edge data streaming pipeline that processes large company datasets. Collaboration is key, and you'll work closely with our data engineering team to enhance test coverage. Your responsibilities extend to improving or creating new test frameworks and data utilities.We have a new opportunity for a...


  • Salford, Salford, United Kingdom https:jobs-redefined.cositemap Full time

    At Moody's, we're revolutionizing the financial technology landscape with cutting-edge solutions. Our team is expanding to work on a data streaming pipeline that processes large company datasets. As a Senior Software Development Engineer - Data Pipeline Specialist, you'll be responsible for improving or creating new test frameworks and data utilities.The...


  • Salford, Salford, United Kingdom Elevation Recruitment Group Full time

    Elevation Recruitment Group is partnering with a leading manufacturing business to recruit a Head of Manufacturing Engineering to join its growing organisation in the North West.The company is seeking a highly skilled and experienced Head of Manufacturing Engineering to lead a diverse team and oversee all aspects of manufacturing engineering, quality, and...


  • Salford, Salford, United Kingdom NHS Full time

    Northern Care Alliance NHS Foundation Trust: Data Centre Engineer OpportunityWe are seeking a skilled Data Centre Engineer to maintain and optimize our data centre's hardware, ensuring high availability and supporting day-to-day operations.In this role, you will be responsible for deploying, configuring, and maintaining data centre facilities across NCA...


  • Salford, Salford, United Kingdom Moody's Investors Service Full time

    We are seeking a dynamic and innovative Data Engineer to play a pivotal role in transforming our data pipelines. Our team at Moody's Investors Service unites the brightest minds to turn today's risks into tomorrow's opportunities.Innovative Data Engineering PipelinesDesign and implement cutting-edge, event-based data engineering pipelines using Spark, Kafka,...


  • Salford, Salford, United Kingdom Moody's Investors Service Full time

    At Moody's Investors Service, we're committed to harnessing the power of data to drive business growth. We're seeking a skilled Data Engineer to play a pivotal role in transforming our data pipelines from capture to data mastering.Innovate and Transform: Design and implement cutting-edge, event-based data engineering pipelines to ingest, enrich, and...

  • Data Engineering Lead

    4 weeks ago


    Salford, Salford, United Kingdom Moody's Investors Service Full time

    pWeareseekingahighlyskilledDataEngineeringLeadtospearheadoureffortsintransformingandoptimizingourextensivedataassetsforusewithLargeLanguageModels(LLMs)andRetrieval-AugmentedGeneration(RAG)systems./ppThispivotalroleinvolvesextractingandtransformingentity-leveldata,distributinglargedatasetsacrossvariousplatforms,andmanagingbulkdatafeedsinmultipleformats./pulli...


  • Salford, Salford, United Kingdom Bupa Full time

    Job OverviewWe are seeking a seasoned Data Analytics Team Lead to oversee our Quality Assurance function. The successful candidate will have experience in managing complex data, developing forecasts, and providing prescriptive and predictive analysis to minimize risk and maximize business opportunities.


  • Salford, Salford, United Kingdom Digital Waffle Full time

    Job Title: Data Cabling EngineerLocation: UKJob Type: ContractWe are seeking a skilled Data Cabling Engineer for an ongoing contract position. This role requires proficiency in data cabling.Install, terminate, and test data cabling systems in commercial settings.Collaborate with project teams to ensure project success.Requirements:Valid ECS or CSCS...


  • Salford, Salford, United Kingdom Digital Waffle Full time

    Job Title: Data Cabling EngineerLocation: UKJob Type: ContractWe are seeking a skilled Data Cabling Engineer for an ongoing contract position in Salford. This role requires proficiency in data cabling.Install, terminate, and test data cabling systems in commercial settings.Collaborate with project teams to ensure project success.Requirements:Valid ECS or...


  • Salford, Salford, United Kingdom HATS Group Full time

    Senior Software Engineer RoleWe are seeking an experienced Senior Software Engineer to join our team. The ideal candidate will have a strong background in data processing and backend development.Key responsibilities include:Designing and implementing high-performance data pipelinesCollaborating with cross-functional teams to ensure seamless...


  • Salford, Salford, United Kingdom Engineering Systems Design Ltd Full time

    Job DescriptionEngineering Systems Design Ltd is seeking a highly skilled Mechanical Building Services Engineer to join our team in Bolton. As a key member of our design team, you will be responsible for delivering high-quality engineering solutions for a wide range of building services projects worldwide.Key Responsibilities:Coordinate and design projects...