Large Scale Data Engineer

3 weeks ago


London, Greater London, United Kingdom Connexity Full time

We are a cutting-edge digital marketing company, Skimlinks, driving e-commerce success for top online retailers.

Our innovative approach combines big data with large-scale machine learning to create a fundamentally new approach to digital marketing.

We collect data on over 1 billion users per month and analyze hundreds of millions of documents daily.

As a Data Engineer on our London-based team, you will design and implement high-volume data collection systems, scheduling, enrichment, and automated analysis of large datasets.

You will work closely with our Product Managers and commercial teams to understand market needs and translate them into solutions.

Your responsibilities include crafting innovative solutions to complex technical problems, ensuring adherence to software development best practices, and sharing your knowledge across the business.

We value dedication, enthusiasm, and a love of innovation. If you're passionate about performance optimization and cost reduction, we want to hear from you

Key Responsibilities:

  • Designing and implementing data engineering systems across our data platform
  • Working with Product Managers and commercial teams to understand market needs
  • Crafting innovative solutions to complex technical problems
  • Ensuring adherence to software development best practices
  • Sharing knowledge across the business and mentoring others

Requirements:

  • An advanced degree in computer science or a related field
  • Solid programming skills in Python and SQL
  • Proven work experience in Google Cloud Platform or other clouds
  • Experience processing large datasets at scale
  • Familiarity with Terraform, DBT & Looker is a plus
  • A commercial mindset and passion for creating outstanding products

About Us:

We're a dynamic company committed to providing a culture that supports diversity, equity, and inclusion.

Our actions across Education, Recruitment, Retention, and Volunteering reflect our core values and remind us that we're all in this together to drive positive change in our industry.

What We Offer:

  • Competitive compensation package (£120,000 - £180,000 per year)
  • Healthcare insurance and cash plans
  • Pension scheme
  • Parental leave policies
  • Learning and Development Program
  • Flexible work schedules
  • Wellness resources
  • Equity in the company


  • London, Greater London, United Kingdom Oxford Knight Full time

    Data Engineer for Large-Scale Financial SystemsOxford Knight is one of the world's largest hedge funds, offering a challenging and rewarding opportunity for a data engineer to join their prestigious technology team. In this role, you will work closely with the Data Science team to deliver cutting-edge solutions to complex data challenges, driving business...


  • London, Greater London, United Kingdom Bloomberg Full time

    Bloomberg Data Engineer Job DescriptionWe are responsible for delivering data, news, and analytics through innovative technology, quickly and accurately, by combining data and context to paint a complete picture for our clients. Our team collects, analyzes, processes, and publishes the data that forms the backbone of our Bloomberg Terminal.As a Data...


  • London, Greater London, United Kingdom Spotify Full time

    Job DescriptionThis role is a unique opportunity to join the Speak team at Spotify, where we develop world-class speech technologies that power personalized generative voice products at scale.Responsibilities:Create large-scale speech and audio data pipelines using frameworks like Google Cloud Platform and Apache Beam.Develop machine learning projects that...


  • London, Greater London, United Kingdom Intelmatix Full time

    About UsWe are Intelmatix, a visionary AI company dedicated to unlocking business potential through intelligent solutions.Our MissionTo empower organizations by providing innovative AI-powered tools that drive growth and success.Job Title: Data Scientist / Machine Learning ScientistSalary Range: $100,000 - $160,000 per yearThis role involves working on...

  • Senior Data Engineer

    2 weeks ago


    London, Greater London, United Kingdom Kainos Full time

    Kainos is a leading provider of digital services, and we're seeking a highly skilled Senior Data Engineer to join our team.About the RoleWe are looking for an experienced Senior Data Engineer to design and develop large-scale data processing software. As a key member of our agile team, you will work closely with architects and lead engineers to ensure that...


  • London, Greater London, United Kingdom g2 Recruitment Full time

    Data Centre Project Manager Wanted!We are looking for an experienced electrical engineer to join our team in London and manage large-scale data centre projects from start to finish. As a Principal / Associate Electrical Engineer, you will have the opportunity to work with a leading client and contribute to the growth and success of our company.About the...


  • London, Greater London, United Kingdom undisclosed Full time

    About the RoleAs a member of our team, you will be responsible for driving the technical and architectural vision for Selection Monitoring's mission-critical control plane systems. This includes working with senior engineers to design and develop scalable, fault-tolerant, and highly available services that underpin our large scale data processing...

  • AI Research Engineer

    2 weeks ago


    London, Greater London, United Kingdom Microsoft Full time

    Microsoft AI is committed to training the world's most capable AI frontier models, pushing the boundaries of scale, performance, and product deployment. As a member of our Pre-Training team, you will be tackling some of the most challenging problems in deep learning at scale.About the RoleWe are looking for outstanding individuals who are excited about...


  • London, Greater London, United Kingdom Fractal Full time

    At Fractal, we are committed to pushing the boundaries of innovation and creativity. As a Principal Architect/Data Engineer with us, you will be part of our Technology team that delivers cutting-edge Data Engineering solutions to Fortune 500 clients worldwide.Job OverviewWe are seeking an extraordinary developer who can help us innovate, build, and maintain...


  • London, Greater London, United Kingdom undisclosed Full time

    Our Team OverviewAt undisclosed, we're working to scale intelligence to serve humanity by training and deploying frontier models for developers and enterprises building AI systems.We're building world-class infrastructure that's critical to our success, focusing on stability, scalability, and observability.Our team optimizes for a wide range of technical...


  • London, Greater London, United Kingdom Simple Machines Full time

    About Simple Machines">Simple Machines is a leading technology firm with global presence, known for creating innovative solutions at the intersection of data, AI, and software engineering.">Job Summary">We're seeking an experienced Data Engineer to join our team in developing large-scale machine learning platforms for global telecommunications...


  • London, Greater London, United Kingdom Blackfield Associates Full time

    Large Scale Construction Lead – Data Centre Projects (UK) - London basedWe are seeking an experienced Large Scale Construction Lead to join our client in London. The successful candidate will be responsible for leading the delivery of large-scale data centre projects across the UK.This role involves the management of client relationships and ensuring...


  • London, Greater London, United Kingdom Splunk Inc Full time

    About UsSplunk Inc is a leading provider of cloud-based monitoring and analytics solutions. We empower our customers to execute their vision by making machine data accessible, usable, and valuable to everyone.Our TechOps organization runs Splunk Cloud, blending SRE, Systems Engineering, and Service Engineering disciplines across functional global teams. We...


  • London, Greater London, United Kingdom Spotify Full time

    About the RoleAs a key member of our team, you will design and build large-scale data pipelines using data processing frameworks like Scio, BigQuery, Google Cloud Platform, and Apache Beam.You'll develop, deploy, and operate Java services that significantly impact millions of users. Your expertise will help power machine learning projects, making...


  • London, Greater London, United Kingdom The Twenty One Recruitment Group Ltd Full time

    We are seeking a highly skilled Data Engineer to join our team in Dundee.RATE OF PAY: £19 - £21 per hour DOEThis exciting opportunity involves working on multiple large-scale projects with a leading contractor.As a successful candidate, you will have extensive experience in data engineering and be able to apply your skills to drive business growth.About...


  • London, Greater London, United Kingdom Turner & Townsend Full time

    Deliver Ambitious ProjectsWe are seeking an experienced Project Director to lead our Data Centre team. As a member of our global professional services company, you will be responsible for delivering large-scale and complex data centre projects in the real estate sector. This includes developing and implementing project strategies, plans and large scale...


  • London, Greater London, United Kingdom Page Green Full time

    Job Title: Large Scale Mechanical Contract LeadSalary Range: £80,000 - £100,000 per annumDescriptionWe are seeking a seasoned Large Scale Mechanical Contract Lead to oversee the delivery of our data centre construction project. As a key member of our team, you will be responsible for ensuring the successful completion of the project within budget and...


  • London, Greater London, United Kingdom JMG Solutions LTD Full time

    About JMG Solutions LTDWe are a leading provider of mechanical engineering services, specializing in large-scale data center projects. Our team is passionate about delivering high-quality work and committed to excellence.Job OverviewThis role offers an exciting opportunity for a skilled Mechanical Design Engineer to join our expanding team in Amsterdam. As a...


  • London, Greater London, United Kingdom DeepMind Technologies Limited Full time

    Company OverviewDeepMind Technologies Limited is a pioneering leader in the field of artificial intelligence. Our team of scientists and engineers work together to advance the state of the art in AI, using our technologies for widespread public benefit and scientific discovery.Job SummaryWe are seeking an experienced Research Scientist to join our team and...


  • London, Greater London, United Kingdom Citigroup Inc. Full time

    Join Our Team:Are you passionate about developing innovative software solutions? Do you have experience with building and running large-scale platforms? We are looking for an experienced Software Engineering Lead to join our Generative AI team at Citigroup Inc. In this role, you will lead the design and development of high-quality, highly reliable software...