Senior Data Engineer

4 weeks ago

London, Greater London, United Kingdom Smarkets Full time

Role Summary

We are seeking an experienced Senior Data Engineer to join our team at Smarkets. As a Senior Data Engineer, you will be responsible for developing and maintaining our data ETL pipelines, ensuring our data lake is in a healthy state, and providing access to data or managing certain business entities relevant to Data.

About the Team

The Data Team at Smarkets is responsible for taking the wealth of data that we generate and using it to drive insights which improve the business. Our team works in an organised way using Agile methodologies and tools such as Jira and regular standups. We are a diverse team with a strong work ethic and plenty of hunger to win.

Responsibilities

  1. Develop and maintain our data ETL pipelines, some of which are real-time. The pipelines are fundamental to helping teams and stakeholders understand and drive business direction.
  2. Ensure our data lake is kept in a healthy state, particularly our data warehouses: Redshift and Bigquery.
  3. Develop and maintain Flask services and Postgres databases within the Data team to provide access to data or manage certain business entities relevant to Data.
  4. Assist the different teams in the company with reporting, especially when it comes to automated reporting pipelines.
  5. Do data exploration and train & deploy ML models used to perform different kinds of user segmentation, detect operational anomalies or estimate important business quantities.

Requirements

  1. 2+ years of experience
  2. Understanding of developing ETL pipelines using Python frameworks such as luigi or airflow.
  3. Experience with the development of Python-based REST APIs / services and their integration with databases (e.g. Postgres).
  4. Familiarity with the key tools of the Python data science stack, e.g. Pandas, Numpy and scikit-learn.
  5. Some experience with training and deploying ML models.

About Smarkets

Smarkets is a betting exchange for sports and political trading that has handled over £29 billion in volume since 2010. Our company mission is to fix the betting industry with the best products and best prices. We are upending the sports betting industry by growing a transparent platform that offers the best value for bettors, with the fairest odds, best technology and a superior customer experience.

What We Offer

We offer a competitive salary package and benefits, along with a dynamic and collaborative work environment. Your work with us will make an impact and your voice will be heard. We are a member of a cycle-to-work scheme and offer a £1000 yearly education budget that can be used on courses, conferences, books or training. We also provide 25 days paid holiday + bank holidays to enjoy, flexible working, and 20 days a year of global working.

Next Steps

We aim to have a simple and speedy hiring process. If you are interested in this role, please submit your CV for review. If selected, you will be invited to complete a HackerRank exercise, followed by a technical interview and in-office interview.

  • Senior Data Engineer

    3 weeks ago

    London, Greater London, United Kingdom Data Idols Full time £75,000 - £95,000

    Data Engineering Role at Data IdolsJoin Data Idols, a renowned retail brand in the UK, as a Senior Data Engineer and contribute to the delivery of data transformation during an exciting period of growth. The ideal candidate will have extensive experience in building and maintaining data pipelines and collaborating with cross-functional data teams.About the...

  • Senior Data Engineer

    4 weeks ago

    London, Greater London, United Kingdom Data Idols Full time

    About the RoleData Idols is seeking a highly skilled Senior Data Engineer to join their team. As a key member of the data team, you will be responsible for designing and implementing data pipelines and data warehousing solutions using Azure and Spark.The OpportunityThis is an exciting opportunity for a talented Data Engineer to play a key role in driving...

  • Senior Data Engineering Specialist

    3 weeks ago

    London, Greater London, United Kingdom Data Science Festival Full time

    Senior Data EngineerAt Data Science Festival, we are seeking an experienced Senior Data Engineer to join our team. As a key member of our data function, you will be responsible for building and maintaining high-quality data solutions to support our data-driven decision-making processes.Key responsibilities include:Designing and implementing data pipelines...

  • Senior Data Scientist, Data Engineering Expert

    3 weeks ago

    London, Greater London, United Kingdom Data Science Festival Full time

    Senior Data EngineerAs a Senior Data Engineer at Data Science Festival, you will play a key role in shaping the company's data transformation strategy. Your expertise in building and maintaining data pipelines will be invaluable in driving high standards across the data function. You will build reliable and high-quality data solutions, supporting the team in...

  • Senior Data Architect

    5 days ago

    London, Greater London, United Kingdom Data Idols Full time

    Senior Data EngineerThe OpportunityWe are seeking a Senior Data Engineer to join our team at Data Idols, a leading retail brand in the UK. As a Senior Data Engineer, you will play a key role in driving high standards across the data function and building reliable and high-quality data solutions.Key ResponsibilitiesDesign and develop data pipelines using...

  • Senior Data Engineer

    1 month ago

    London, Greater London, United Kingdom Data Idols Full time £400 - £500

    Data EngineerData Idols is working with a national software company that helps the public sector build better data solutions. They are looking for a Full-stack Data Engineer contractor to assist in modernising data pipelines, data standards and data reports for an initial three months.As a Full-stack Engineer, you will be responsible for improving data...

  • Senior Data Warehouse Engineer

    7 days ago

    London, Greater London, United Kingdom Data Science Festival Full time

    Data Science Festival is a leading entertainment organisation with a global presence, renowned for its innovative approach to data-driven decision making.Key ResponsibilitiesAs a Senior Data Warehouse Engineer, you will play a pivotal role in designing and implementing the company's data warehouse strategy.This involves working closely with the Data...

  • Senior Data Analysis Engineer

    4 weeks ago

    London, Greater London, United Kingdom Northern Data Group Full time

    Job Title: Senior Data Analysis EngineerDescription:At Northern Data Group, we are seeking a highly skilled Senior Data Analysis Engineer to join our team. As a key member of our Data Team, you will play a crucial role in designing, building, and maintaining our data infrastructure. Your focus will be on ensuring the reliability, scalability, and efficiency...

  • Data Systems Engineer

    3 weeks ago

    London, Greater London, United Kingdom Data Privacy Full time

    About the Role:We are seeking a skilled Data Systems Engineer to join our team at Houseful.Key Responsibilities:Design and implement data warehousing solutions using AWS technologies.Collaborate with senior engineers to ensure data accuracy and implement validation checks.Develop and maintain ETL/ELT pipelines, ensuring alignment with business...

  • Data Engineer

    7 days ago

    London, Greater London, United Kingdom Data Privacy Full time

    About UsHouseful is a leading property technology company known for its innovative approach to the property market. With brands like Zoopla, Alto, Hometrack, Calcasa, Mojo, and Prime location, we leverage software, data, and insights to drive progress in the industry.Company OverviewWe're committed to helping everyone make informed decisions about their...

  • Cloud Data Engineering Manager

    16 hours ago

    London, Greater London, United Kingdom Data Idols Full time £80,000 - £90,000

    Data Engineering OpportunityData Idols is seeking a skilled Senior Data Platform Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, implementing, and maintaining a robust data platform using Azure Services.This is an exciting opportunity to work with cutting-edge cloud-based technologies and collaborate...

  • Senior Data Engineer Lead

    6 days ago

    London, Greater London, United Kingdom Data Idols Full time

    The OpportunityWe are looking for a skilled Data Engineering Manager who has extensive experience in managing teams, implementing data strategy, and working with Azure. As a hands-off role, you will have the autonomy to lead the team and drive results.Your key responsibilities include:Implementing data strategy to drive business valueManaging and mentoring...

  • Senior Data Scientist

    1 month ago

    London, Greater London, United Kingdom Tampa Gardens Senior Living Full time

    The Senior Machine Learning Engineer role at Tampa Gardens Senior Living involves designing and building a data pipeline, deploying and tuning AI models for customer churn prediction and on-screen recovery. The engineer will provide machine learning expertise to product managers, optimally shaping products to meet merchant needs and scalability. They will...

  • Senior Data Engineer

    7 days ago

    London, Greater London, United Kingdom Data Science Festival Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Data Science Festival. As a key member of our data engineering team, you will play a crucial role in driving high standards across the data function.The OpportunityIn this exciting role, you will have the opportunity to work on building and maintaining reliable and...

  • Data Engineer for Digital Transformation

    7 days ago

    London, Greater London, United Kingdom Data Idols Full time

    Senior Data Platform EngineerWe are seeking a highly skilled Data Engineer to join our team at Data Idols. As a key member of our data platforms group, you will play a vital role in shaping the data landscape and contribute to data-driven decision-making.The OpportunityIn this exciting role, you will be responsible for designing, implementing, and...

  • Data Engineer

    3 weeks ago

    London, Greater London, United Kingdom Data Idols Full time £400 - £500

    Role OverviewData Idols is seeking a skilled Data Engineer to assist in modernising data pipelines, data standards and data reports for a national software company.Key ResponsibilitiesImprove data structures, pipelines and reportingCollaborate with the CTO to review reports and implement necessary changes or improvementsWhat You'll GainUp to £500 a...

  • Senior Cloud Data Engineer

    3 weeks ago

    London, Greater London, United Kingdom Applied Data Science Partners Full time

    About the Role:Applied Data Science Partners is seeking a skilled Senior Software Engineer to join our close-knit team in London. As a Software Engineer, you will be responsible for the successful delivery of projects, developing and maintaining architectures, and ensuring they meet business requirements.Key Responsibilities:Develop, construct, test, and...

  • Senior Data Engineering Lead

    3 weeks ago

    London, Greater London, United Kingdom Data Science Festival Full time

    We are seeking a highly skilled Data Engineering Manager to support the delivery of data transformation during an exciting time at Data Science Festival.As a key member of the Data Engineering team, you will work closely with cross-functional teams to implement data strategy and deliver value across the organization.The ideal candidate will have extensive...

  • Data Engineer Leader

    16 hours ago

    London, Greater London, United Kingdom Data Idols Full time £80,000 - £90,000

    Job OverviewData Idols is a pioneering retailer transforming into a data-driven organisation. As a Senior Data Platform Engineer, you will shape the data landscape by designing, implementing, and maintaining a robust data platform using Azure Services.We offer a competitive salary of £80,000 - £90,000 + bonus, along with 20% discount across all products,...

  • Senior Cloud Data Architect

    16 hours ago

    London, Greater London, United Kingdom Data Idols Full time £80,000 - £90,000

    About the RoleAs a Senior Data Platform Engineer at Data Idols, you will play a pivotal role in shaping the company's data landscape. With a focus on designing, implementing, and maintaining a robust data platform using Azure Services, you will work closely with cross-functional teams to deliver high-quality data solutions.This is an exciting opportunity to...