Data Infrastructure Engineer

1 week ago

London, Greater London, United Kingdom Spotify Full time £90,000 - £120,000 per year
The Platform team creates the technology that enables Spotify to learn quickly and scale easily, enabling rapid growth in our users and our business around the globe. Spanning many disciplines, we work to make the business work; creating the frameworks, capabilities and tools needed to welcome a billion customers. Join us and help to amplify productivity, quality and innovation across Spotify.
We are looking for a Data Infrastructure Engineer to join our team in the Data Collection Product Area. We develop the heart of Spotify's Event Delivery infrastructure, enabling hundreds of other teams to seamlessly collect more than a Trillion events per day and consume this data to empower Spotify's existing products as well as innovation of new products.
We are heavy users of Google Cloud Pub/Sub, GKE, Dataflow and many other GCP products and work closely with Google to improve their product offering. We also rely on internal backend and data platform products, built by other squads at Spotify. What You'll Do
  • Work on our infrastructure together with the squad, making it reliable and efficient while delivering value to data producers and consumers within Spotify.
  • Build large-scale Java and Apollo based backend systems and batch and real-time data pipelines with data processing frameworks like Scio and Apache Beam.
  • Take an active part in the operational responsibilities for our own infrastructure
  • Work in an autonomous, multi-functional agile team and collaborate with other squads in our product area to continuously iterate and deliver on new product objectives.
Who You Are
  • You have experience working with backend and data engineering in Java and Scala and have an understanding of that problem space and tooling ecosystem.
  • You are curious about solving technical challenges and operating business-critical, huge scale distributed systems and cloud solutions.
  • You have a good understanding of quality, system design, data structures, and algorithms.
  • You appreciate agile software processes, data-driven development, reliability, and responsible experimentation.
  • You use standard methodologies in continuous integration and delivery
  • You work well independently and collaboratively, and are open to giving and receiving feedback in order to learn as an individual and as a team.
Where You'll Be
  • This role is based in London.
  • We offer you the flexibility to work where you work best There will be some in person meetings, but still allows for flexibility to work from home.
Spotify is an equal opportunity employer. You are welcome at Spotify for who you are, no matter where you come from, what you look like, or what's playing in your headphones. Our platform is for everyone, and so is our workplace. The more voices we have represented and amplified in our business, the more we will all thrive, contribute, and be forward-thinking So bring us your personal experience, your perspectives, and your background. It's in our differences that we will find the power to keep revolutionizing the way the world listens.
At Spotify, we are passionate about inclusivity and making sure our entire recruitment process is accessible to everyone. We have ways to request reasonable accommodations during the interview process and help assist in what you need. If you need accommodations at any stage of the application or interview process, please let us know - we're here to support you in any way we can.
Spotify transformed music listening forever when we launched in 2008. Our mission is to unlock the potential of human creativity by giving a million creative artists the opportunity to live off their art and billions of fans the chance to enjoy and be passionate about these creators. Everything we do is driven by our love for music and podcasting. Today, we are the world's most popular audio streaming subscription service. We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

  • Data Engineer

    6 hours ago

    London, Greater London, United Kingdom Data Idols Full time

    Data EngineerSalary: £80,00 - £85,000Location: Hybrid - London - 1 day per weekWe are currently looking for a Data Engineer to join our client's forward-thinking, collaborative, and technology-driven team. In this role, you'll take the lead in shaping and delivering modern cloud data solutions, working closely with a highly skilled Data & BI function....

  • Senior Data Infrastructure Engineer

    2 weeks ago

    London, Greater London, United Kingdom Fanalysis Full time £60,000 - £120,000 per year

    Senior Data Infrastructure Engineer at Fanalysis - powered by passionWe're building the go-to app for real football fans - a central home where trusted and passionate supporters can share their voices, insights, and emotions with clarity, cutting through punditry and the noise of fragmented social mediaFounded by Michael McIntyre and Gary Neville, we're...

  • Senior Data Infrastructure Engineer

    1 week ago

    London, Greater London, United Kingdom Fanalysis Full time £80,000 - £120,000 per year

    Senior Data Infrastructure Engineer at Fanalysis - powered by passionWe're building the go-to app for real football fans - a central home where trusted and passionate supporters can share their voices, insights, and emotions with clarity, cutting through punditry and the noise of fragmented social mediaFounded by Michael McIntyre and Gary Neville, we're...

  • Senior Data Engineer

    4 days ago

    London, Greater London, United Kingdom Data Idols Full time £70,000 - £75,000 per year

    Senior Data EngineerSalary: £70,00 - £75,000Location: Hybrid - London - 1 day per weekWe are currently looking for a Senior Data Engineer to join our client's forward-thinking, collaborative, and technology-driven team. In this role, you'll take the lead in shaping and delivering modern cloud data solutions, working closely with a highly skilled Data & BI...

  • Director/Head of Platform Engineering

    6 days ago

    London, Greater London, United Kingdom Northern Data Full time £100,000 - £120,000 per year

    Job DescriptionWe're searching for an experienced and visionary Director/Head of Platform Engineering to lead the architecture, development, and scalability of our core platform services across Northern Data Group. You will play a pivotal role in evolving our engineering landscape — driving platform reliability, scalability, and automation across cloud...

  • Senior Systems Engineer

    7 days ago

    London, Greater London, United Kingdom VAST Data Full time £80,000 - £120,000 per year

    *Description*VAST Data is looking to hire a Senior Systems EngineerThis is a great opportunity to be part of one of the fastest-growing infrastructure companies in history, an organization that is in the center of the hurricane being created by the revolution in artificial intelligence."VAST's data management vision is the future of the market."- ForbesVAST...

  • Data Engineer Contractor

    6 days ago

    London, Greater London, United Kingdom Data Intellect Full time £60,000 - £100,000 per year

    Company Description We are looking for a highly motivated Data Engineer to join our dynamic team working with a tier 1 multinational investment bank. This role is ideal for someone who thrives in fast-paced environments, enjoys working on both BAU and project-based initiatives, and has a strong background in Python ideally within the FX domain. Please note,...

  • Director/Head of Software Engineering

    6 days ago

    London, Greater London, United Kingdom Northern Data Full time £120,000 - £250,000 per year

    Job DescriptionNorthern Data Group is a global leader in high-performance computing (HPC) and Generative AI infrastructure. With brands including Taiga Cloud and Ardent Data Centers, we provide sovereign, clean-energy-powered access to some of the world's most advanced GPU clusters. Our mission is to power innovation by enabling enterprises, researchers, and...

  • Senior Data Architect

    2 weeks ago

    London, Greater London, United Kingdom LEIT DATA Full time £60,000 - £120,000 per year

    Work With UsWhether you are looking for your next career move in data or looking to become an associate working alongside a leading consultancy, then look no further. At LEIT DATA we are passionate about data and have created a culture which fosters innovation, personal development and career growth opportunities.We believe that every colleague plays an...

  • Sales Engineer- 26398

    1 week ago

    London, Greater London, United Kingdom VAST Data Full time £60,000 - £120,000 per year

    *Description*This is a great opportunity to be part of one of the fastest-growing infrastructure companies in history, an organization that is in the centre of the hurricane being created by the revolution in artificial intelligence."VAST's data management vision is the future of the market."- ForbesVAST Data is the data platform company for the AI era. We...