Principal Data Engineer

3 weeks ago


Brighton UK, East Sussex, United Kingdom 15gifts Full time

We are looking for an experienced Principal Data Engineer with a passion for designing and building high-quality data pipelines to power cutting-edge genAI products.

The successful candidate will join our multi-skilled product teams and participate in our agile process. You will also be supported by our dynamic data team and benefit from talking data with our other data engineers, data scientists, and ML and analytics engineers.


The person we’re looking for

The ideal person would have a strong background and expertise in real-time data engineering and cloud technologies, and be able to apply this expertise to business problems to generate value.

We currently work in an AWS, Snowflake, dbt, Looker, Python, Kinesis and Airflow stack and are building out our real-time data streaming capabilities. You should be very comfortable with these (or similar).

As an individual contributor, you will be confident in taking a project brief and drawing out requirements, designing and building consensus around architectural plans, including tests, and comfortable exercising your organisation-wide influence and impact to lead plan execution and bring others along with you.


You’ll be responsible for

  • Be our primary data engineering subject matter expert.
  • Shaping our data engineering roadmap.
  • Designing and building consensus around data architecture plans.
  • Collaborating with cross-functional teams to develop and implement robust, scalable solutions.
  • Translating use cases, pain points and success criteria into technical requirements.
  • Designing, building, maintaining and upgrading data pipelines and self-service tooling to provide clean, efficient results.
  • Writing automated tests to validate requirements.
  • Promoting data governance through documentation, observability and controls.
  • Using version control and performing code reviews.
  • Promoting the adoption of tools and best practices across the team.


Skills and experience

Essential:

  • Significant commercial experience in a senior Data Engineering role.
  • Great Python skills.
  • Strong experience with tracking technologies such as Snowplow/Rudderstack/Segment.
  • Previous experience with real-time data streaming platforms such as Kafka/Confluent/Google Cloud Pub/Sub.
  • Experience handling and validating real-time data.
  • Experience with stream processing frameworks such as Faust/Flink/Kafka Streams or similar.
  • Proficient with ELT pipelines and the full data lifecycle including managing data pipelines over time and evolving them to meet new business requirements.
  • Building organisation-wide influence to make positive impacts at scale.
  • Earning a position of recognised authority inside an organisation, and perhaps externally as well.
  • Experience mentoring team members and colleagues.


Diversity is incredibly important to us. Research shows how people from marginalised groups are less likely to apply for a job unless they meet every requirement. However, these accountabilities are a guide and, if you feel like this role could be for you and you don’t meet every criteria, please do apply. We’d love to hear from you.


Why choose us

Our Culture

Our success is underpinned by our cultural values. These values are not something we stick up on a wall – they don’t need to be. They are behaviours that we recognise and celebrate in each other. They are what we live by every day.

Our Cultural Values

  • Positive vibes
  • Take the initiative
  • Seek feedback
  • Stay ahead
  • Team 15gifts


Benefits include

  • Employee Assistance Programme (confidential counselling)
  • Medicash healthcare scheme (reclaim costs for dental, physiotherapy, osteopathy and optical care)
  • easitBrighton travel scheme (discounted public transport options)
  • Cycle to work scheme
  • Life Insurance scheme
  • 25 days holiday + bank holidays + your birthday off (rising to 28 after 3 consecutive years with the business & 30 after 5 years)
  • Contributory pension scheme


Other extras in the office

  • On site changing rooms, showers and internal bike storage
  • Breakfast, fresh fruit, snacks, beers
  • Yoga and other fitness activities
  • Regular social events, including Friday drinks


  • Data Architect

    3 weeks ago


    Brighton, UK, East Sussex, United Kingdom Eden Smith Group Full time

    Data ArchitectHybrid/ West SussexSalary up to £90,000 + bonus & generous benefits packageAn exciting opportunity has arisen to join a large, forward thinking utilities company renown for its working culture and environmental consciousness.Working as part of a well-established data team the new Data Analytics & AI Architect will be given autonomy and an...


  • Surrey, UK, South East England, United Kingdom IC Resources Full time

    A great opportunity for a Principal Optical Engineer to join a very promising start-up who are taking optical technologies to higher speeds. This Principal Optical Engineer would be expected to lead in the development of fibre optical systems for the business and will have great career progression opportunities as the team grows. Skills necessary: Experience...


  • Buckinghamshire, UK, South East England, United Kingdom Innovate Full time

    Role: Principal Electronic Design EngineerJob: Full-timeWorking: Hybrid (2 days on site)Salary: CompetitiveOur UK-based defence client are seeking a Principal Electronic Design Engineer to join their expanding team and work on various defence packages.They specialise in providing support services to the defence, marine and space sectors, offering both...


  • Brighton, UK, East Sussex, United Kingdom Legal & General Full time

    Legal & General is a leading UK financial services group and major global investor. We’ve been safeguarding people’s financial futures since 1836, aiming to build a better society for the long term by investing our customers’ money in things that make life better for everyone and create value for our shareholders.Our Group Functions provide the...

  • Data Manager

    3 weeks ago


    Surrey, UK, South East England, United Kingdom Devonshire Hayes Recruitment Full time

    The Data Manager will work for and alongside staff of all levels across the School, including the leadership team and Governors, to assist in providing strategic and effective management of all data and reporting systems.• The main job purpose is to• ensure the efficient input, management and co-ordination of all school data in the School Data Management...

  • Data Engineer

    3 weeks ago


    Hampshire, UK, South East England, United Kingdom Intec Select Full time

    Data Analytics Engineer – Financial Services – SQL / Python / Power BI – HampshireOverview:An Exciting opportunity has arisen with one of the UK’s largest Life Insurance brokers for a Data Analytics Engineer to join the growing team. Reporting to the Data Platform Manager, you will play a critical role in designing, building, and maintaining the...


  • Oxfordshire, UK, South East England, United Kingdom Vector Resourcing Full time

    Our client is looking for a Head of Data Engineering to come on board and continue their development of their data platform product. They are looking for someone that can have a primary focus on the strategic running of the existing team but also someone that isn't so far removed from the technical aspects of the team that they can get hands on with the...

  • Sales Manager

    3 weeks ago


    Brighton, UK, East Sussex, United Kingdom Informa Markets Full time

    Informa OverviewInforma is a renowned academic publishing, business intelligence, knowledge, and events company, offering unique content and connectivity worldwide. It's a London Stock Exchange-listed firm and a FTSE 100 member.Informa MarketsInforma Markets creates platforms for industries to trade, innovate, and grow. With over 450 international B2B...

  • Sales Manager

    1 week ago


    Brighton, UK, East Sussex, United Kingdom Informa Markets Full time

    Informa OverviewInforma is a renowned academic publishing, business intelligence, knowledge, and events company, offering unique content and connectivity worldwide. It's a London Stock Exchange-listed firm and a FTSE 100 member.Informa MarketsInforma Markets creates platforms for industries to trade, innovate, and grow. With over 450 international B2B...


  • Brighton, UK, East Sussex, United Kingdom Informa Markets Full time

    Informa Markets, a division within Informa, creates global platforms for industries. We organise over 500 large-scale branded and transaction-oriented events in 14 specialist markets. These are typically not-to-be-missed annual events where buyers and sellers build relationships, see and show products and do business.We also provide year-round online...


  • Oxfordshire, UK, South East England, United Kingdom Walsh Employment Full time

    Our client specialises in using advanced algorithms and AI to manage and maximise the value of energy storage. By optimising the timing of battery charging and discharging based on real-time market conditions, customers can participate more effectively in multiple energy markets, enhancing the efficiency and profitability of renewable energy resources. We...


  • West Berkshire, UK, South East England, United Kingdom Harnham Full time

    Senior Data EngineerBerkshireOnce a month in the officeUp to £80,000 depending on experience Harnham are partnering with a company who has been providing software solutions for nearly 20 years. They are a technology company who operates in the property, legal and financial services industries. They are looking for a Senior Data Engineer to help scale up the...


  • Hampshire, UK, South East England, United Kingdom Stott and May Full time

    Data Centre Shift EngineerWe are seeking an experienced Data Centre Shift Engineer, This is a fantastic opportunity to work in a dynamic environment where you'll play a key role in maintaining the electrical and mechanical systems of DC facilities.CONTINENTAL SHIFT PATTERNKey Duties & Responsibilities:Perform small lighting installations, fault-finding,...


  • Brighton, UK, East Sussex, United Kingdom Hays Full time

    Your new company My client are a leading Financial Services brand, with a long history of providing lending, wealth management and banking services to B2B and B2C customers alike. British-based, the group consists of multiple businesses and this role will be responsible for the digital marketing activities of 4 B2B brands. The Online Marketing Executive role...


  • Eastbourne, UK, East Sussex, United Kingdom AxisOps Full time

    We're on the lookout for a talented Machine Learning (ML) Engineer to join our software development consultancy in Eastbourne. The ideal person will have considerable experience developing, deploying and maintaining machine learning models. As an ML Engineer at AxisOps, you will be instrumental in bringing our ML/AI workload in-house. You will enhance...


  • Oxfordshire, UK, South East England, United Kingdom Mane Contract Services Full time

    As a Composite Design Engineer, you will:Work collaboratively with Principal / Senior Engineers and Program Managers to define deliverables and project scope to ensure all requirements are met.Proactively address faults, manufacturing queries / feedback, NCR’s and other related departmental tasks.Take ownership of key aspects of the Vehicle Design Vison,...


  • Brighton, South East, East Sussex, United Kingdom ERIKS Full time

    Role: Reliability Services EngineerLocation: Hybrid/Home (South Coast)ABOUT THE ROLE -Perform daily condition monitoring surveys across multiple customer locations nationallyPerform analysis of vibration data and provide detailed reportsMinimum Cat I Vibration Analysis trained & certifiedPreferred Cat II Vibration Analysis trained & certified

  • Data Scientist

    1 week ago


    Oxfordshire, UK, South East England, United Kingdom Ivy Farm Technologies Full time

    Ivy Farm - Data Scientist (Statistics and Machine Learning)At Ivy Farm our mission is to create the world’s best guilt free and sustainable meat, it’s cultivated meat, just like real meat, only made differently - and we’re super excited by it.Were a humble community of 40+ technical and scientific crew; a team where you can make a true difference to...

  • Principal Scientist

    1 month ago


    Hampshire, UK, South East England, United Kingdom Cogito Full time

    Scope: Research and Development (R&D) is the centre of all design, material and process development leading to the creation of new product and process opportunities for our clients business. Development of existing or future products is conducted based on in-house capabilities as well as interfacing with outside suppliers and service providers, academic...


  • East Sussex, UK, South East England, United Kingdom iO Associates - UKEU Full time

    Join this leading Engineering and Infrastructure consultancy as a Principal Civil Engineer - Shape the Future of Water Infrastructure!Are you a passionate Civil Engineer with a desire to make a lasting impact? Do you thrive on working with leading water clients on some of the most iconic projects in the UK? If so, my client wants you to join their team as a...