Data Ingestion Architect

1 day ago


London, Greater London, United Kingdom Core Consultants Full time

About the Company - We are working closely with one of our partners to help them grow their team and we are looking for an experienced Data Ingestion Architect to join their SME team. You will join the Innovation Lab of one of the world's leading technology companies that counts the who's who of the world's biggest companies, tech unicorns and new startups.

The team while small has directly contributed hundreds of millions in revenue by innovating with the use of groundbreaking technology that keeps them at the forefront of innovation. Core Consultants, in synergy with its affiliates KnowledgeWave and Xander, has pioneered a unique approach to AI consulting and engineering to deliver measurable outcomes to clients.

**Job Responsibilities:**

  • Design, build, and optimize backend systems using C# and .NET Core.
  • Engineer solutions to technical challenges related to data ingestion, transformation, and processing at scale.
  • Ensure the performance, scalability, and reliability of backend systems.

**Requirements:**

  • C# and .NET Core Framework for backend development.
  • Azure Functions, Event Hubs, Logic Apps experience.
  • Relational databases (e.g., SQL Server) and modern storage solutions.
  • CI/CD pipelines and DevOps practices.

**Pay Range:** $180,000 - $250,000 per year. Commitment to Diversity and Inclusivity: At Core Consultants, we strive to create an inclusive work environment where everyone feels valued and respected.



  • London, Greater London, United Kingdom ENGINEERINGUK Full time

    Lead the Charge in Data InnovationAre you passionate about leveraging data to drive business transformation? As a Data Platform and Ingestion Lead at EngineeringUK, you will oversee the acquisition, ingestion, and transformation of data to support our multi-billion-dollar Pet Nutrition division's digital needs.This role requires strategic vision, technical...


  • London, Greater London, United Kingdom Core Consultants Full time

    Key ResponsibilitiesDevelop, optimise, and maintain backend services and APIs using C#, .NET Core, and Azure.Engineer solutions to technical challenges related to data ingestion, transformation, and processing at scale.Ensure the performance, scalability, and reliability of backend systems.


  • London, Greater London, United Kingdom ComplyAdvantage Full time

    Job OverviewWe are seeking a highly skilled Senior Product Manager to lead our data ingestion platform development, leveraging machine learning and automation to extract relevant facts from structured and unstructured data.This is an exciting challenge for the right person to build the data ingestion machine that will help redefine what's possible when it...


  • London, Greater London, United Kingdom Core Consultants Full time

    Data Platform ArchitectCore Consultants is seeking a Data Platform Architect to develop and maintain our internal data ingestion platform. As a key member of our data engineering team, you will be responsible for designing and implementing scalable data pipelines that consume data from Kafka streams, leveraging Airflow for pipeline orchestration.The ideal...


  • London, Greater London, United Kingdom Tenth Revolution Group Full time

    Company OverviewA well-established Financial Services organisation in Central London is seeking a skilled Data Warehouse Architect to lead their large-scale integration programme. This exciting opportunity involves uplifting and redeveloping their existing Data Warehouse to serve the needs of both entities.The successful candidate will have extensive...


  • London, Greater London, United Kingdom FXC Intel Full time

    We are looking for a skilled Python Data Ingestion Specialist to work on our scrapers and contribute to the migration of our current infrastructure to an event-driven microservice architecture.Key Responsibilities:Maintaining and implementing new scrapers using our internal frameworkParticipating in the migration of our current Jenkins-based collection...


  • London, Greater London, United Kingdom LexisNexis Intellectual Property Solutions Full time

    We are looking for a seasoned Patent Data Solutions Architect to join our team at LexisNexis Intellectual Property Solutions. The successful candidate will design and implement efficient, scalable, and robust patent data ingestion pipelines using Databricks, Python, and PySpark. This role requires expertise in Databricks, Python, and PySpark, as well as...

  • Data Architect

    1 day ago


    London, Greater London, United Kingdom IBU Consulting Pvt Ltd Full time

    Job Description:We are seeking a highly skilled Data Architect to join our team at IBU Consulting Pvt Ltd. In this role, you will be responsible for designing and implementing scalable data pipelines using Apache Kafka.Key Responsibilities:Design and develop Kafka-based microservices using Spring BootBuild data pipelines for ingesting, processing, and...


  • London, Greater London, United Kingdom Distributed Full time

    Distributed, a software development company, is building the world's Elastic Workforce, reinventing work, and challenging assumptions about local teams. We help businesses deliver technical projects better than ever before through our platform and on-demand Elastic Teams.">About this roleWe're working with a key partner in the telecoms industry to build a...


  • London, Greater London, United Kingdom NatWest Group Full time

    We are seeking a skilled Data Marketplace Architect Lead to define the intentional architecture for our enterprise data marketplace and shared data platforms. The ideal candidate will have a background in defining business and application architectures and roadmaps for complex enterprises.About the RoleThis is a critical role in shaping the future of...


  • London, Greater London, United Kingdom ITV plc Full time

    Job DescriptionAt ITV plc, we are seeking an exceptional Data Architect with Databricks Expertise to lead our data engineering team. As a key member of our data organization, you will be responsible for developing and maintaining our data pipeline infrastructure using Symphony, our proprietary central data platform based on Databricks.About the RoleAs a Data...


  • London, Greater London, United Kingdom Data Idols Full time £80,000 - £100,000

    Data Solutions ArchitectAt Data Idols, we're seeking a skilled Data Solutions Architect to join our team. As a key member of our data architecture team, you will be responsible for designing and implementing data solutions that drive business decisions.The OpportunityYou will collaborate with our partners to develop future roadmaps for data tools and...


  • London, Greater London, United Kingdom Data Science Festival Full time

    Job Description:We are seeking a highly skilled Data Platform Strategist to lead the development and delivery of our data platform. As a key member of the Data Tech team, you will drive responsible usage of our newly built data platform, ensuring it evolves with cutting-edge technologies and meets the needs of practitioners and business partners.The...


  • London, Greater London, United Kingdom Data Idols Full time £80,000 - £100,000

    Data Solutions Architect OpportunityAt Data Idols, we are seeking a highly skilled Data Solutions Architect to provide design and architecture guidance across the company. This role requires expertise in driving the design of solutions that support the business in making data-driven decisions.The OpportunityAs a Data Solutions Architect, you will collaborate...


  • London, Greater London, United Kingdom 83zero Limited Full time

    About the RoleWe are seeking a highly skilled Senior Cloud Data Architect to join our team at 83zero Limited. The successful candidate will be responsible for driving the development of automated fund data ingestion portals and intuitive data management tools using cutting-edge cloud technologies.


  • London, Greater London, United Kingdom Pearson Full time

    About the Role:This is a fantastic opportunity for an experienced Data Engineer to join our team at Pearson. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining complex data pipelines to support various business applications.The ideal candidate will have a strong background in data transformation...


  • London, Greater London, United Kingdom Data Science Festival Full time

    Data Science Festival: Enterprise Data ArchitectWe are working with one of the largest entertainment organisations growing rapidly within their global operations. With innovation, creativity, and data at the heart of the company, we are looking for an Enterprise Data Architect to join the team.As an Enterprise Data Architect, you will be responsible for...


  • London, Greater London, United Kingdom Data Science Festival Full time

    Data Architect SpecialistData Science Festival is looking for a highly skilled Data Architect Specialist to lead the development of our data warehouse. This role involves designing and improving the data infrastructure, ensuring seamless integration with other departments.The successful candidate will have proven experience in data warehouse implementation,...


  • London, Greater London, United Kingdom Getinge Full time

    Job DescriptionWe are seeking an experienced Enterprise Data Solutions Architect to lead our team in designing and implementing data engineering solutions on Azure. This is a permanent position with a competitive salary of €80,000 - €110,000 per year, depending on experience.About the RoleIn this role, you will be responsible for shaping our data...


  • London, Greater London, United Kingdom Infosys Limited Full time

    Compensation: £80,000 - £120,000 per annum (including bonus)We are seeking an experienced Data Architect to lead the design and implementation of data strategies that align with our business goals. The ideal candidate will possess deep expertise in data architecture, governance, and management, with a proven track record of transforming complex data...