Data Engineer

2 weeks ago


London, United Kingdom Ada Meher Full time

Data Engineer (AWS/Python)
Fintech
£80,000 DOE
Remote with some days in the London office
Shares, Flexible hours, Collaborative culture, Training budget
We need a Data Engineer to **build production-level big data batch pipelines on AWS.**You’ll be working with Python and AWS in a highly collaborate, intelligent team, reporting into the Head of Data.
You’ll be pivotal in curating data ensuring the highest quality of delivery to their customers, both improving and upgrading the dataset on the platform.
Helping to build these data pipeline, using distributed architecture, will make up your core responsibilities.
- **What makes this job special**Their team is a mixture of data engineering and data science individuals, so expect your work to have a clear impact on the business, as we work closely with our product team.
You’d be joining the business where your input in helping shape their future tech would be invaluable.**Responsibilities** - Owning the full scope of assigned development projects and gather requirements
- Design solutions, build, develop and deliver completed functionality to production
- Design & implementation of the task scheduling (Airflow), distributed computation system (Python, Celery, EMR) and data lakes / data warehouses (S3, PostgreSQL)

**Essential** - Industry experience of production-level big data batch pipelines on AWS.
- Industry experience of developing on a Linux platform
- Experience of industry-standard development methodologies such as source code control, unit testing and continuous integration
- Computer science or other STEM degree is a big bonus

**Company?**A leading Fintech, providing advanced data/analytics to capital market players, working with well-known banks, brokers and hedge funds. This is in the form of granular Level 3, T+1 order book data and advanced analytics.
They are currently scaling, continually adding financial datasets to their platform.
We understand that job adverts only give a snapshot of the role, so we know you will have plenty of questions.
To apply, please attach an up-to-date copy of your CV and we the full job description, location, salary, benefits on our initial briefing call.
You can also contact me at /


  • Data Engineer

    7 days ago


    London, United Kingdom Data Idols Full time

    **Data Engineer** Data Idols are excited to be working with one of the top 100 companies in the world to recruit a Data Engineer! A company which owns multiple brands and who are investing heavily into 'all things data' to revolutionise their extraordinary team. **Skills and Experience**: - Experience with Azure - Experience with SQL - Experience with...

  • Data Engineer

    5 days ago


    London, United Kingdom Data Idols Full time

    **Data Engineer** Data Idols are proud to be working with a leading technology and engineering consultancy who have been running for decades globally. They work with a variety of clients across different industries on their biggest challenges. Would you like to work alongsidethis company, where you get the chance to work across a wide range of tools, tech,...

  • Data Engineer

    2 weeks ago


    City of London, United Kingdom Data Idols Full time

    **Senior Data Engineer** Data Idols are proud to be working with an iconic UK brand to assist them in hiring a Senior Data Engineer as they undertake a digital and data-driven journey that will transform the business. Data is at the heart of the organisation and forms a key partof their future plans. **The Opportunity** As a Senior Data Engineer you will be...

  • Senior Engineer, Data Engineering

    Found in: Jooble UK C2 - 4 days ago


    London, United Kingdom Data Idols Full time

    Senior Data Engineer Location: London (Hybrid) Data Idols are working with one of the fast-growing companies in the logistics sector that are making the world a greener place. They are looking for a Senior Data Engineer to join their team within the Data Space. As a Senior Data Engineer, you will work alongside different data teams to design,...


  • London, United Kingdom Data Idols Full time

    Senior Data Engineer Location: London (Hybrid) Data Idols are working with one of the fast-growing companies in the logistics sector that are making the world a greener place. They are looking for a Senior Data Engineer to join their team within the Data Space. As a Senior Data Engineer, you will work alongside different data teams to design,...


  • London, United Kingdom Data Idols Full time

    **Senior Data Engineer** Data Idols are excited to be working with a well-funded startup who are moving into their scale-up phase. We are working to recruit the first Data Engineer, you will be involved in architecting and building their greenfield data platform. In this excitingand dynamic role, you will be involved from the very beginning, selecting the...


  • London, United Kingdom Data Idols Full time

    **Data Engineering Manager** Data Idols are proud to be working with an iconic UK brand to assist them in hiring a Data Engineering Manager as they undertake a digital and data-driven journey that will transform the business. Data is at the heart of the organisation and forms a keypart of their future plans. **The Opportunity** As a Data Engineering...


  • London, United Kingdom Data Idols Full time

    **Senior Data Engineer** Data Idols are working with a very exciting FinTech who are looking for a Senior Data Engineer to join their Data Team. This role will initially be remote but as restrictions ease the role will be based in their central London office. **THE ROLE** Within this role as a Senior Data Engineer you will be working to help build a...


  • London, United Kingdom Data Idols Full time

    **Senior Data Engineer** If you're a Senior Data Engineer seeking a meaningful new contract opportunity, look no further. We are working with a fast-growing digital HealthTech company, saving the NHS millions per year, and are radically transforming the delivery of health servicesto make healthcare work for patients, doctors and other healthcare...


  • London, United Kingdom Abs Data Full time

    Lead Data Engineer Do you enjoy creating valuable insights with data? Do you want to play a key role in transforming our firm into an agile organization? Being agile will make us more responsive, more adaptable, and ultimately more innovative. We’re looking for a Data Engineer to: ~ transform data into valuable insights that inform business...


  • London, United Kingdom Data Idols Full time

    Senior Data Engineer Location: London, 3/2 days in the office per week Data Idols are currently working with a company that focus on the european marketplace for transport who are looking to make the future greener! Within this role as a Senior Data Engineer, you will be monitoring, designing and implementing a datawarehouse, whilst working with...

  • Senior Engineer, Data Engineering

    Found in: Jooble UK C2 - 3 weeks ago


    London, United Kingdom Data Idols Full time

    Senior Data Engineer Location: London, 3/2 days in the office per week Data Idols are currently working with a company that focus on the european marketplace for transport who are looking to make the future greener! Within this role as a Senior Data Engineer, you will be monitoring, designing and implementing a datawarehouse, whilst working with...


  • London, United Kingdom Data Idols Full time

    **Senior Data Engineer** Data Idols are proud to be working with a leading technology and engineering consultancy who have been running for decades globally. They work with a variety of clients across different industries on their biggest challenges. Would you like to work alongsidethis company, where you get the chance to work across a wide range of tools,...

  • Data Engineer

    3 days ago


    City of London, United Kingdom Data Idols Full time

    **Data Engineer - Biotechnology** Data Idols are working with an exciting and innovative biotechnology startup who are working to assist biopharma teams to find better medicines and drugs quicker and more efficiently. **The Opportunity** This is an opportunity for a Data Engineer to join a small team and have a big impact. As a Data Engineer you will...

  • Lead Data Engineer

    2 weeks ago


    City of London, United Kingdom Data Idols Full time

    **Lead Data Engineer** Data Idols are proud to be working with an iconic UK brand to assist them in hiring a Lead Data Engineer as they undertake a digital and data-driven journey that will transform the business. Data is at the heart of the organisation and forms a key part oftheir future plans. **Skills and Experience**: - Awareness and understanding of...


  • London, United Kingdom Abs Data Full time

    Regulatory Reporting, Big Data Software Engineer We’re looking for software engineers to: provide technology solutions that will solve business problems and strengthen our position as digital leaders in financial services work with our Regulatory Reporting team to translate business and external regulatory needs using Behavior Driven Development...

  • Data Engineer

    3 weeks ago


    London, United Kingdom Open Data Science Conferenc Full time

    You have prior experience as a data engineer, software engineer, or data architect. You are experienced in designing and production of solutions for complex problems. You thrive in a fast-paced, start-up environment. You seek to continuously improve processes and find the most optimal way to solve problems. You can work remotely and independently,...

  • Data Engineer

    3 weeks ago


    London, United Kingdom Abs Data Full time

    Data Engineer/Analyst Risk & Margin We’re looking for a software engineer to: provide technology solutions that will solve business problems in the Risk and Margin space work with risk managers to translate business needs using Behavior Driven Development (BDD) into functional requirements. Key to success will be the ability to understand the data...


  • London, United Kingdom Open Data Science Conferenc Full time

    You have prior experience as a data engineer, software engineer, or data architect. You can work remotely and independently, taking ownership of your work. You have proven English language communication skills that enable you to collaborate in a remote-first company with a diverse international workforce. Experience with Java11+ for ingesting,...

  • Lead Data Engineer

    2 days ago


    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Lead Data Engineer - Residential Property Company Location: London (flexible working available) **Salary**: Competitive We are a leading residential property company looking to hire a Lead Data Engineer to join our growing data-focused team. You will be responsible for leading a team of data engineers and playing a key role in the development and...