Data Engineer
3 weeks ago
About Smarkets
Smarkets is a pioneering betting exchange for sports and political trading, boasting an impressive volume of over £29 billion since 2010. Our mission is to revolutionize the betting industry with innovative products and prices. We prioritize transparency, offering the best value to bettors through fair odds, cutting-edge technology, and an exceptional customer experience.
The Data Team
As a key member of the Data Team, you will play a pivotal role in shaping the future of our betting trading technology landscape. The team's responsibilities span three areas:
- Data Engineering: develop and maintain ETL pipelines, services, and APIs, as well as data-related infrastructure like Redshift or BigQuery.
- Data Science and Machine Learning: explore data, train and deploy ML models to extract new insights from data.
- Analytics and Reporting: create data models and dashboards, automate reporting pipelines for various teams, stakeholders, and third-parties.
Responsibilities
Your key responsibilities as a Senior Data Engineer will include:
- Developing and maintaining our Data ETL pipelines, which are fundamental to helping teams and stakeholders understand and drive business direction.
- Ensuring our data lake is in a healthy state, particularly our data warehouses: Redshift and Bigquery.
- Developing and maintaining Flask services and Postgres databases within the Data team to provide access to data or manage certain business entities.
- Assisting different teams in the company with reporting, especially automated reporting pipelines.
- Conducting data exploration and training & deploying ML models used for user segmentation, detecting operational anomalies or estimating important business quantities.
Requirements
To be successful in this role, you will need:
- 2+ years of experience
- Understanding of developing ETL pipelines using Python frameworks such as luigi or airflow.
- Experience with the development of Python-based REST APIs/services and their integration with databases (e.g. Postgres).
- Familiarity with the key tools of the Python data science stack, e.g. Pandas, Numpy and scikit-learn.
- Some experience with training and deploying ML models.
- Enjoy writing elegant, well-tested, and maintainable code.
- Team player that enjoys contributing to the success of the team in a proactive and friendly environment.
- Bachelor's in Computer Science, Math or equivalent field, or possess relevant experience.
Our Culture
We value:
- Push to win
- Make others better
- Give a shit
- Be a pro
- Bring the energy
Benefits
We offer a competitive salary package and benefits, along with a dynamic and collaborative work environment. Your work with us will make an impact, and your voice will be heard. We have designed our benefits offering around Health, Wealth, Lifestyle, and Development, including stock options, pension scheme, health insurance, fresh fruit and snacks, and more.
-
Data Engineer
1 month ago
London, Greater London, United Kingdom Data Privacy Full timeSolution Architect for Data Engineering and Data WarehousingAt Databricks, we're on a mission to simplify data science and analytics for our customers. As a Solution Architect, you'll work closely with clients to demonstrate how our Data Intelligence Platform can address complex data challenges.Key ResponsibilitiesDesign and implement data engineering...
-
Data Engineer
3 weeks ago
London, Greater London, United Kingdom Data Idols Full time £400 - £500Role OverviewData Idols is seeking a skilled Data Engineer to assist in modernising data pipelines, data standards and data reports for a national software company.Key ResponsibilitiesImprove data structures, pipelines and reportingCollaborate with the CTO to review reports and implement necessary changes or improvementsWhat You'll GainUp to £500 a...
-
Senior Data Engineer
1 month ago
London, Greater London, United Kingdom Data Idols Full time £400 - £500Data EngineerData Idols is working with a national software company that helps the public sector build better data solutions. They are looking for a Full-stack Data Engineer contractor to assist in modernising data pipelines, data standards and data reports for an initial three months.As a Full-stack Engineer, you will be responsible for improving data...
-
Data Engineer Specialist
1 month ago
London, Greater London, United Kingdom Data Idols Full timeData Engineer Role OverviewData Idols is working with a national software company that helps the public sector build better data solutions. They are looking for a Full-stack Data Engineer contractor to join them for an initial three months to assist in modernising data pipelines, data standards and data reports.As a Full-stack Engineer, you will be...
-
Senior Data Engineer
1 month ago
London, Greater London, United Kingdom Data Idols Full time £75,000 - £95,000Senior Data EngineerJoin Data Idols as a Senior Data Engineer and support the delivery of data transformation during an exciting time. You will collaborate with the wider data teams to build and maintain reliable and high-quality data solutions. Strong experience in Python is required. You will play a key role in driving high standards across the data...
-
Senior Data Engineer
1 month ago
London, Greater London, United Kingdom Data Idols Full timeUnlock Your Potential as a Senior Data EngineerJoin Data Idols, a renowned retail brand, as a Senior Data Engineer and contribute to the delivery of data transformation during an exciting period of growth. Collaborate with the wider data teams to build and maintain data pipelines that drive high standards across the data function.The OpportunityAs a Senior...
-
Data Engineering Manager
2 weeks ago
London, Greater London, United Kingdom Data Idols Full time £90,000 - £95,000The OpportunityData Idols is seeking a Data Engineering Manager to support the delivery of data transformation during an exciting time within the company. This individual will work with the teams to implement data strategy and deliver value throughout the company.The ideal candidate will have extensive experience in managing teams, stakeholder management,...
-
Data Engineer
4 days ago
London, Greater London, United Kingdom Data Privacy Full timeAbout UsHouseful is a leading property technology company known for its innovative approach to the property market. With brands like Zoopla, Alto, Hometrack, Calcasa, Mojo, and Prime location, we leverage software, data, and insights to drive progress in the industry.Company OverviewWe're committed to helping everyone make informed decisions about their...
-
Data Systems Engineer
2 weeks ago
London, Greater London, United Kingdom Data Privacy Full timeAbout the Role:We are seeking a skilled Data Systems Engineer to join our team at Houseful.Key Responsibilities:Design and implement data warehousing solutions using AWS technologies.Collaborate with senior engineers to ensure data accuracy and implement validation checks.Develop and maintain ETL/ELT pipelines, ensuring alignment with business...
-
Senior Data Engineer
2 weeks ago
London, Greater London, United Kingdom Data Idols Full time £75,000 - £95,000Data Engineering Role at Data IdolsJoin Data Idols, a renowned retail brand in the UK, as a Senior Data Engineer and contribute to the delivery of data transformation during an exciting period of growth. The ideal candidate will have extensive experience in building and maintaining data pipelines and collaborating with cross-functional data teams.About the...
-
Staff Data Engineer
1 month ago
London, Greater London, United Kingdom Data Idols Full timeUnlock the Power of Data with Our TeamWe are seeking a highly skilled Staff Data Engineer to join our team at Data Idols. As a key member of our data function, you will play a crucial role in driving high standards across our data operations.As a Staff Data Engineer, you will be responsible for building and maintaining data pipelines, collaborating with our...
-
Senior Data Engineer
3 weeks ago
London, Greater London, United Kingdom Data Idols Full timeAbout the RoleData Idols is seeking a highly skilled Senior Data Engineer to join their team. As a key member of the data team, you will be responsible for designing and implementing data pipelines and data warehousing solutions using Azure and Spark.The OpportunityThis is an exciting opportunity for a talented Data Engineer to play a key role in driving...
-
Data Engineer
3 weeks ago
London, Greater London, United Kingdom NTT DATA Full timeJob Summary We are seeking an experienced Data Engineer to join our Anti-Financial Crime Technology team at NTT DATA. The ideal candidate will have a strong background in big data related technologies, including Hadoop and Elastic Search. Key Responsibilities: Analyzing large datasets and designing scalable data ingestion workflows Working closely with team...
-
Data Engineer
1 month ago
London, Greater London, United Kingdom Data Privacy Full timeHouseful is a leading property technology company that aims to empower individuals with data-driven insights. As a Data Engineer, you will play a crucial role in building and maintaining our data infrastructure, ensuring seamless data flow and accuracy.Key Responsibilities:Design and implement ETL/ELT pipelines using AWS technologies to extract, transform,...
-
Data Engineer
3 weeks ago
London, Greater London, United Kingdom Data Idols Full timeJob Opportunity:The company Data Idols is seeking a skilled Full-stack Data Engineer to assist in modernising data pipelines, data standards and data reports for a national software company that helps the public sector build better data solutions.The Opportunity:As a Full-stack Engineer, you will be responsible for improving data structures, pipelines and...
-
Data Engineering Manager
3 days ago
London, Greater London, United Kingdom Data Idols Full timeJob OverviewData Idols is seeking an experienced Data Engineering Manager to support the delivery of data transformation during an exciting time within the company.You will work with the teams to implement data strategy and deliver value throughout the company, leveraging your technical expertise and stakeholder management skills.
-
Chief Data Engineering Lead
1 week ago
London, Greater London, United Kingdom Data Idols Full timeData Idols is looking for a Chief Data Engineering Lead to support the delivery of data transformation.As a key member of the team, you will collaborate with the wider data teams and drive high standards across the data function. The role involves building pipelines to deliver insights enabling the company to be more data driven in their decision making.Key...
-
Senior Data Engineer Lead
3 days ago
London, Greater London, United Kingdom Data Idols Full timeThe OpportunityWe are looking for a skilled Data Engineering Manager who has extensive experience in managing teams, implementing data strategy, and working with Azure. As a hands-off role, you will have the autonomy to lead the team and drive results.Your key responsibilities include:Implementing data strategy to drive business valueManaging and mentoring...
-
Data Engineer for Digital Transformation
4 days ago
London, Greater London, United Kingdom Data Idols Full timeSenior Data Platform EngineerWe are seeking a highly skilled Data Engineer to join our team at Data Idols. As a key member of our data platforms group, you will play a vital role in shaping the data landscape and contribute to data-driven decision-making.The OpportunityIn this exciting role, you will be responsible for designing, implementing, and...
-
Data Engineering Manager
4 days ago
London, Greater London, United Kingdom Data Science Festival Full timeData Engineering Manager Role OverviewAt the forefront of our company's innovative landscape, we seek a seasoned Data Engineering Manager to spearhead data transformation initiatives. With an exciting tenure at one of the UK's most renowned retail brands, this pivotal role requires expertise in implementing data strategy and delivering value across the...