Petabyte-Scale Data Infrastructure Optimization Engineer

2 weeks ago


London, Greater London, United Kingdom Xonai Full time
About Xonai

We are a team of passionate engineers dedicated to creating cutting-edge petabyte-scale data infrastructure optimization platforms. Our innovative solution combines hardware acceleration with performance metering to deliver real-time actionable insights for reducing data center costs.

About the Role

This position requires collaboration with our founding team to expand the integration of our custom compiler with query processing internals and maximize data processing throughput of leading open-source software for Big Data analytics.

Your contributions to our core IP will directly impact data processing infrastructure, transforming tens of petabytes every day where Xonai is being deployed.

  1. Implement extensible optimizations for data processing algorithms mainly in Java but also C++.
  2. Develop code generation targeting a custom DSL for individual SQL operations.
  3. Establish rigorous benchmarking standards to assess the impact of performance-sensitive changes.
  4. Prioritize implementation of requirements that benefit customer applications.
  5. Foster greenfield development on data processing at the intersection of Big Data and compilers.

Requirements:

  • 5+ years of experience in performance engineering and operating large codebases.
  • Strong experience with statically-typed compiled languages (C++, Java, Scala).
  • Experience with low-level Java interfacing C++ for performance-sensitive code.
  • Knowledge of low-level libraries, CPU performance (x86), compression engines, and memory allocators.
  • Strong grasp of computer science fundamentals such as algorithms and data structures.
  • Critical thinking and ability to work independently without direct supervision.
  • Experience with the internals of large-scale data processing and query performance optimization.


  • London, Greater London, United Kingdom LinuxRecruit Full time

    **About Our Organisation:** We're a research-led organisation dedicated to advancing scientific knowledge and improving human lives.**Job Title:** Petabyte Scale Engineer**Salary:** £90,000 - £125,000 per annum, depending on experience.**Location:** Central LondonWe're looking for an experienced Petabyte Scale Engineer to join our High Performance...


  • London, Greater London, United Kingdom LinuxRecruit Full time

    Are you ready to take your career to the next level as a Mid Level HPC Infrastructure Engineer at LinuxRecruit? We're looking for a highly skilled professional to join our team in central London and contribute to our mission of advancing scientific research and understanding.In this role, you'll have the opportunity to work on a wide range of projects, from...


  • London, Greater London, United Kingdom Xonai Full time

    Xonai OverviewWe are a fully remote company committed to building a best-in-class petabyte-scale data infrastructure optimization platform.Job DescriptionThis Senior Software Engineer role involves collaborating with the founding team to expand the integration of our custom compiler with query processing internals and maximize data processing throughput of...


  • London, Greater London, United Kingdom Hunter Bond Full time

    Hunter Bond: A Leading Tech FirmAre you a skilled Linux Engineer looking for a challenging opportunity? We are seeking an experienced professional to join our High-Performance, Ultra Low-Latency Systems Engineering team. The successful candidate will have the chance to work on cutting-edge technology and make their mark on a growing organization.This is a...


  • London, Greater London, United Kingdom Xonai Full time

    About XonaiWe are a team of passionate engineers dedicated to building innovative data infrastructure optimization solutions. Our platform combines hardware acceleration with real-time performance metering, enabling actionable insights for reducing data center costs.Role OverviewAs a Senior Software Engineer for this role, you will collaborate with our...


  • London, Greater London, United Kingdom Microsoft Full time

    Join us as a Large Scale Data Specialist at Microsoft AI, where you will be part of a dynamic team building the world's most advanced multimodal dataset.As a key member of the AI Data team, you will be responsible for designing and developing data pipelines that ingest enormous amounts of multi-modal training data. You will work closely with the pretraining...


  • London, Greater London, United Kingdom Xonai Full time

    About Xonai's Data InfrastructureWe are developing a cutting-edge petabyte-scale data infrastructure optimization platform that combines hardware acceleration with performance metering to deliver real-time actionable insights for reducing data center costs.About the JobThis Senior Software Developer role requires collaboration with our founding team to...


  • London, Greater London, United Kingdom Hunter Bond Full time

    Hunter Bond, an award-winning tech firm, is looking for a talented Linux Engineer/HPC Engineer to work in their High-Performance, Ultra Low-Latency Systems Engineering team. The salary for this position is up to £300,000 in the first year.This is a unique opportunity for passionate Linux infrastructure enthusiasts to work on the latest technologies and make...

  • Cloud Data Architect

    1 month ago


    London, Greater London, United Kingdom Ogury Ltd Full time

    About the RoleThis is an exciting opportunity to shape the future of Ogury's data platform, make data available to all teams and enable them to take well-informed data-driven decisions.The team worked hard in the past months to streamline and optimize our data load and transformation pipelines using Redshift, DBT, Airflow, and CI tools (Jenkins). The next...


  • London, Greater London, United Kingdom Data Science Festival Full time

    Job SummaryWe are seeking a seasoned Chief Data Infrastructure Specialist to join our team at the Data Science Festival. This role involves designing, building, and maintaining robust data infrastructure and ETL processes.About the RoleThe successful candidate will report directly to the Head of Data Engineering and play a pivotal role in shaping our data...


  • London, Greater London, United Kingdom Northern Data Group Full time

    OverviewNorthern Data Group is a cutting-edge company that's changing the face of High-Performance Computing. With a strong focus on innovation and sustainability, we're shaping the future of data centers worldwide.Job SummaryWe're seeking a highly skilled Senior Data Engineer to join our team. As a key member of our Data Team, you will play a crucial role...


  • London, Greater London, United Kingdom Provide Full time

    **Job Title:** Senior Data Engineer**Location:** Remote**Salary:** £75,000 - £80,000 + 10% bonus (estimated annual salary: £83,300)**Company Overview**We are a well-established Software Engineering business providing solutions for the Ecommerce industry.This role is an excellent opportunity to join our team of experienced professionals and contribute to...


  • London, Greater London, United Kingdom monday, Israel Full time

    monday.com is seeking a talented Data Infrastructure Engineer to join our DBRE team in Israel. As a key member of our team, you will play a critical role in designing, implementing, and maintaining our database infrastructure to ensure high performance and reliability.About the RoleIn this role, you will be responsible for connecting our platform to our...


  • London, Greater London, United Kingdom Woven Full time

    Woven is a mobility technology subsidiary of Toyota Motor Corporation, dedicated to bringing greater freedom, safety, and happiness to people and society.We are committed to creating a modern work environment that supports our employees and their loved ones. Our company culture weaves modern Silicon Valley innovation and time-tested Japanese quality...


  • London, Greater London, United Kingdom Data Science Festival Full time

    Cloud Data Solutions Engineer PositionWe are currently looking for an experienced Cloud Data Solutions Engineer to join our forward-thinking team at the Data Science Festival in London. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining robust cloud-based data infrastructure.The ideal candidate will...


  • London, Greater London, United Kingdom Humand Talent Full time

    Spearhead Data Innovation as a Senior Data Infrastructure EngineerWe are seeking a seasoned Senior Data Infrastructure Engineer to spearhead data and analytics initiatives, fostering innovation and growth.If you thrive in building scalable data infrastructure and collaborating with cutting-edge technologies, this could be your next challenge.About the...


  • London, Greater London, United Kingdom Hamilton Barnes 🌳 Full time

    Data Center Operations Manager Job SummaryHamilton Barnes is seeking a seasoned Data Center Operations Manager to join our global operations team. The ideal candidate will have a proven track record of managing large-scale data center operations teams and a strong background in HPC clusters.As a key member of our team, you will be responsible for overseeing...


  • London, Greater London, United Kingdom Data Science Festival Full time

    Senior Data Platform EngineerWe are seeking a Senior Data Platform Engineer to join our team at Data Science Festival, a prestigious digital-first organization. As a key member of our data landscape, you will contribute to shaping our data infrastructure and work alongside a talented team to build, optimize, and secure scalable data solutions.This role...


  • London, Greater London, United Kingdom Data Idols Full time

    About the RoleData Idols is a leading organisation in the field of data-driven decision-making. We are currently seeking a Senior Data Platform Engineer to join our team and contribute to shaping the data landscape. In this role, you will work alongside a talented, collaborative team to build, optimise, and secure scalable data infrastructure.Key...


  • London, Greater London, United Kingdom CV-Library Full time

    Job SummaryWe are seeking an experienced DevOps Engineer to join our team and manage, optimize, and scale Elasticsearch clusters. This is a fantastic opportunity to work with a leading technology organisation and contribute to the success of our systems.Key RequirementsCollaborate with cross-functional teams to implement data-driven solutions and enhance...