Lead Data Engineer

3 days ago

London, UK, United Kingdom First Derivative Full time

Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems?



Lead Data Engineer - London



First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether you're in the early stages of your career, looking for a new direction, or wanting to continue in a position of leadership.


Joining the world’s largest Capital Markets dedicated consultancy, you will have the opportunity to gain exposure to a range of mission-critical projects, tech stacks, clients and a company that prides itself on career development, variety, and flexibility.


We have opportunities for Mid-Senior Software Engineers who will work shoulder to shoulder with Tier 1 investment banks, including Morgan Stanley, UBS, Citigroup, JP Morgan and Credit Suisse to name a few.


What will you do?


The project entails the development of a robust Risk Data Platform built on Snowflake, leveraging AWS as the cloud infrastructure.


The platform will support multiple risk applications, incorporating tailored risk matrices for individual desks to ensure comprehensive and granular risk management. The integration will include a high-performance risk engine powered by Murex, facilitating advanced risk computations and analysis.


The scope covers the design, implementation, and testing of the platform to meet the specified requirements, ensuring scalability, security, and efficient data handling across all risk operations.




What experience will you need?



Essential Requirements:


  • Experience in risk analytics, including market risk or credit risk.
  • Familiarity with risk technology and calculations, including VaR, Stress Testing, Sensitivities, and P&L Vectors.
  • Strong software development skills in Python or another common programming language (e.g., Java or Scala), with a focus on best practices: low-level design documentation, clean and well-documented code, and thorough testing.
  • Expertise in Apache Airflow, with demonstrated experience designing, implementing, and managing workflows, DAGs, and tasks. A deep understanding of Airflow's architecture, best practices, and troubleshooting capabilities is mandatory.
  • Proficiency in deploying and managing Cloud Database Services, with a preference for Snowflake.
  • Advanced skills in SQL and Python for data manipulation and analysis.
  • Experience implementing cloud-based solutions using modern cloud technologies (preferably AWS).
  • Familiarity with modern SDLC tooling, including Git, Bamboo, Jira, or similar.
  • Proven ability to implement and enforce data quality standards and practices.


Preferred Qualifications (Nice to Have):

  • Good base of derivatives knowledge, pricing, risk management of structured products, options and more exotic derivatives.
  • Knowledge of additional data processing libraries and tools to enhance data engineering workflows.
  • Expertise in real-time data processing frameworks such as Apache Flink or Kafka Streams.
  • Experience building event-driven and/or streaming data services.


Soft Skills:

  • Strong analytical and problem-solving skills, with the ability to troubleshoot and resolve complex data-related issues effectively.
  • Excellent communication skills, with the ability to collaborate and share knowledge within a team environment.
  • Proactive, self-starter attitude with an entrepreneurial approach.
  • Ability to escalate and follow up on issues promptly and efficiently.



What's in it for you?


You will embark upon a career with life-long learning at its core, facilitating rapid professional and personal development and the opportunity to design your own career path.



Benefits:


  • Hybrid and Flexible Working
  • Extensive Private Healthcare Package
  • Private Pension
  • Employee Assistance Programme
  • Enhanced Maternity/ Paternity policies
  • Group Life Protection Benefit
  • Employee Referral Bonus Scheme
  • Access to a range of skills and certifications such as GCP, AWS, Azure and more


Additional Perks:


  • FD Internal Network and Sports & Social Calendar, who host monthly and quarterly socials at each office.
  • Aspiring LeadershipProgramme – a programme which provides a structured and practical pathway to fast-track talented individuals into leadership roles.
  • STEP-up Awards - employee led awards designed to acknowledge excellence in four areas that are quintessential to us.
  • TechSmiths Guild – helping employees get to grips with everything cloud computing and data storage (which are integral to the future of business and risk management).
  • STRIVE Initiative and IMPACT Programme – development programmes put in place to support women in tech and financial services.
  • Investment Club - employees learn the basics of investment and trading via workshops and competitions, mirroring real-life scenarios.
  • Food Club – the opportunity to try out new cuisines together as a team
  • Sports Club – a bit of healthy competition Getting involved in 5k fun runs, JPM challenge and SCB challenge.

  • Lead Data Engineer

    3 months ago

    London,, UK, United Kingdom Cornwallis Elt Full time

    Lead Data Engineer – Python, SQL, dbt, AWS, Dremio, Data Mesh, ETL, Data Pipelines, Data Warehousing, DWH, S3, Glue, Data Lake, Automation, LondonA Lead Data Engineer is sought after by a leading workplace pensions provider, to run their expanding data engineering team in their London City office. The team have recently built out a next-gen data lake...

  • Lead Data Engineer

    2 months ago

    London,, UK, United Kingdom Mastek Full time

    Lead Data EngineerPermanent OpportunityLocation: London, UK – 2 days travel to officeOverview: We are seeking a highly skilled Lead Data Engineer to join our team for a critical project with NHS England. The project involves migrating Privacy Enhancement Technology (PET) from the existing Privitar system to IQVIA across multiple data platforms. The ideal...

  • Lead Data Engineer

    3 weeks ago

    London,, UK, United Kingdom JSS Search Full time

    JSS are partnering with a globally renowned, luxury brand who are looking for a Lead Data Engineer to join their growing and ambitious Data team. Reporting into the Head of Data and initially leading a small team of Data Engineers.My client is looking for a Data Engineering Lead with a breadth of experience to lead a group of data engineers in designing,...

  • Lead Data Engineer

    1 month ago

    London,, UK, United Kingdom Maclean Moore Full time

    Lead Data Engineer | Permanent | London | Hybrid | Financial ServicesI am partnered with a client of mine within the Financial Services Sector who are looking for an experienced Lead Data Engineer to manage their data infrastructure and lead their engineering team. This role requires expertise in designing, building, and maintaining scalable data pipelines...

  • Lead Data Engineer

    3 weeks ago

    London,, UK, United Kingdom Noir Full time

    Lead Data Engineer – Investment Banking – London/ Hybrid(Data Engineer, SQL Data Engineer, Java, Python, Spark, Scala, SQL, OO programming, Snowflake, Databricks, Data Fabric, design patterns, SOLID principles, ETL, Unit testing, NUnit, MSTest, Junit, Microservices Architecture, Continuous Integration, Azure DevOps, AWS, Jenkins, Agile, Data Engineer,...

  • Lead Data Engineer

    3 weeks ago

    London,, UK, United Kingdom Curated Full time

    Lead Data Engineer London - Hybrid 3 days pw in office.Gaming Tech Scale UpWe’re working with a dynamic and fast-growing global digital marketing technology specialising in innovative tech solutions within the iGaming sector. Having organically reached profitability, they're considering to grow consciously. In 2024 they made a number of key hires,...

  • Lead Data Engineer

    3 weeks ago

    London, UK, UK, United Kingdom Harnham Full time

    Lead Data EngineerLondon2 days a week in OfficeTHE COMPANYThis company is a well-known and highly regarded cosmetics company who are globally recognised as a luxury brand. Founded over 2 decades ago this company has been expanding and improving ever since. With the large number data they have accumulated they are looking to bring in a Lead Data Engineer to...

  • Lead Data Engineer

    2 months ago

    London, UK, UK, United Kingdom Harnham Full time

    Lead Data Engineer London - Hybrid (3 days per week in office) Up to £90,000 + BenefitsOVERVIEWWe are partnering with a prominent investment company within the infrastructure sector, seeking a skilled Senior Data Engineer to help establish a data strategy and support long-term data-driven growth. With recent consulting insights highlighting the need for a...

  • Lead Data Engineer

    3 weeks ago

    London,, UK, United Kingdom Core Consultants Full time

    Role Profile: Senior Data Engineering Lead – Internal Data Ingestion PlatformRole OverviewThe Senior Data Engineering Lead will spearhead the design, implementation, and technical oversight of an advanced internal data ingestion platform, enabling scalable and efficient ingestion of diverse datasets. The role involves leading a team of data engineers,...

  • Lead Data Engineer

    3 weeks ago

    London, UK, UK, United Kingdom iO Associates - UKEU Full time

    Lead Data Engineer - Up to £75,000 + Competitive benefits package - North West Office location - Flexible hybrid workingiO Associates is recruiting an experienced Lead Data Engineer on behalf of an exciting business in the eCommerce industry. This is a great time to join a growing Data team in a business that is undergoing significant digital transformation...

  • Lead Data Engineer

    3 weeks ago

    London,, UK, United Kingdom Understanding Recruitment Full time

    Lead Data Engineer - Up to £100k - HealthTech Fantastic new opportunity for an experienced Data Engineer to join a venture backed HealthTech startup.What You'll Be Doing: Architecting robust, secure data infrastructure from the ground upDesigning scalable data pipelines that can handle sensitive, complex informationCollaborating with multidisciplinary...

  • Lead Data Engineer

    3 days ago

    London,, UK, United Kingdom Finatal Full time

    Job Title: Lead Data EngineerContract: Initial 3 MonthsLocation: London (Hybrid)EM003Company Overview:Join a dynamic, Private Equity-backed IT Services Business experiencing rapid growth and innovation. We are embarking on a greenfield data project and seeking a hands-on Data Engineer to build and deliver a proof of concept for a cutting-edge data solution,...

  • Lead Data Engineer

    2 weeks ago

    London,, UK, United Kingdom Durlston Partners Full time

    Data Engineering Lead – Digital Assets | LondonAbout The CompanyJoin a leading global hedge fund with a dedicated digital assets division, committed to creating secure and efficient infrastructure for institutional-grade blockchain and cryptocurrency investments.About The RoleThey are seeking a Data Engineering Lead to spearhead the development of...

  • Senior/Lead Data Engineer

    3 weeks ago

    London,, UK, United Kingdom Dalton Full time

    Senior/Lead Data Engineer, Location: Hybrid London (2-3 days/week)About Dalton: Dalton is on a mission to make the world’s drug design more efficient. We are building the AI ecosystem for drug design and solving real-world problems that transform the efficiency of the pharmaceutical industry. Our mission is to harness cutting-edge technology and turn it...

  • Controls Engineer

    1 month ago

    London,, UK, United Kingdom Vantage Data Centers Full time

    About Vantage Data CentersVantage Data Centers is a leading wholesale data center provider in North America with campuses in six strategic markets: Silicon Valley; Northern Virginia; Phoenix, Arizona; Quincy, Washington; Montreal and Quebec City, Canada. Founded in 2010, Vantage has an unceasing commitment to provide major hyperscale, cloud and enterprise...

  • Data Engineer

    3 weeks ago

    London,, UK, United Kingdom TRIA Full time

    Data Engineer / GCP / Digital£500 - £550 (Outside IR35)London – Hybrid 6 Month ContractMy client is a global ecommerce retailer based in London who are looking for a Data Engineer to join their dynamic data team to design, build and maintain their data pipelines in a cloud native environment. You’ll be working with the team on a data tool surrounding...

  • Lead Data Scientist

    2 months ago

    London,, UK, United Kingdom Harnham Full time

    LEAD DATA SCIENTIST - Data Science/MLREMOTE - 1 day per month in UxbridgeUp to £100,000 + car allowance + bonusCOMPANY:We are working with a market leading Telecommunications company with an established Data Science and AI team to bring a Lead Data Scientist into the team.They already have a strong established DS/ML team but are looking to grow this.They...

  • Senior Data Engineer

    1 month ago

    London,, UK, United Kingdom Dragonfly People Full time

    Senior/Lead Data EngineerA Senior/Lead Data Engineer is required by a rapidly growing Fintech based in London. The Senior/Lead Data Engineer will have extensive knowledge of modern technologies. This would ideally suit a Data Engineer with a passion for driving excellence and experience in a platform engineering or data engineering team. The role is 90%...

  • Data Engineer

    3 weeks ago

    London,, UK, United Kingdom Thyme Full time

    Data Science Engineer – AI-Powered Tech Startup - HybridJoin a trailblazing AI startup pushing boundaries in applied computer vision and real-time data processing. Recognized for innovation and backed by leading VC funds, they are building a next-generation solution that merges advanced tracking technology with exclusive, world-class content.As they scale,...

  • Data Engineer

    3 weeks ago

    London,, UK, United Kingdom Found By Few Full time

    Data Engineer - up to £60k (Plus 20% Bonus) - London (Office 3x days) We have partnered with a high growth start up who specialise within the finance sector. Their Product has gone from strength to strength in recent years with only a Lean team. Now recognised as one of the best in their area, this is a fantastic opportunity for a Data Engineer to come on...