Lead Data Engineer

2 months ago


London, UK, United Kingdom Macquarie Group Full time
The commodities and global markets data analytics team within technology is building a leading data and analytics platform. We partner and build batch and real-time analytics solutions for traders, quants, desk analysts and central data teams across the business.

At Macquarie, our advantage is bringing together diverse people and empowering them to shape all kinds of possibilities. We are a global financial services group operating in 34 markets and with 55 years of unbroken profitability. You'll be part of a friendly and supportive team where everyone - no matter what role - contributes ideas and drives outcomes.

What role will you play?

Press space or enter keys to toggle section visibility

As a Lead Data Engineer you will be working with traders, quants, desk analysts and central data teams to provide data and analytics solutions across our Commodities and Global Markets business lines. You'll be managing a team of data engineers in London providing the technical direction and leading the development of data analytics capabilities such as the data catalog, data science workbench, visualisation tools, and real-time analytics. You will be working with our public-cloud based data lake, data pipelines for internal operational and external fundamental and alternative market data. An interest in maturing our development practises across our agile-based team, looking to help us on our journey to continually improve the robustness of our solutions, and the speed with which we can respond to our business's needs are fundamental to the role.

What you offer

Press space or enter keys to toggle section visibility

  • Experience with AWS cloud
  • Experience programming, debugging and running production systems in Python
  • Exposure to open-source technologies such as Presto/Trino and Airflow
  • Passionate about the use and adoption of these capabilities, focused on user experience and ensuring our business see real value from the technical deliveries.
  • In this rapidly evolving area, you will need a learning mindset, can-do attitude, and effective communication with a diverse set of stakeholders


We love hearing from anyone inspired to build a better future with us, if you're excited about the role or working at Macquarie we encourage you to apply.

About Technology

Press space or enter keys to toggle section visibility

Technology enables every aspect of our business, for our people, our customers and our communities. Bring your unique perspective and join a global team who is passionate about accelerating the digital enterprise, connecting people and data, building platforms and applications and designing tomorrow's technology solutions.

Benefits

Press space or enter keys to toggle section visibility

Macquarie employees can access a wide range of benefits which, depending on eligibility criteria, include:
  • Hybrid and flexible working arrangements
  • One wellbeing leave day per year and minimum 25 days of annual leave
  • Primary carers are eligible for minimum 20 weeks paid leave and minimum 6 weeks for secondary carer
  • Paid volunteer leave and donation matching
  • Range of benefits to support your physical, psychological and financial wellbeing
  • Employee Assistance Program, a robust behavioral health network with counseling and coaching services
  • Recognition and service awards


Our commitment to diversity, equity and inclusion

Press space or enter keys to toggle section visibility

We are committed to providing a working environment that embraces diversity, equity and inclusion. As an inclusive employer, Macquarie does not discriminate on the grounds of age, disability, sex, sexual orientation, gender identity or expression, marriage, civil partnership, pregnancy, maternity, race (including color and ethnic or national origins), religion or belief.


  • Lead Data Engineer

    3 days ago


    London,, UK, United Kingdom Mastek Full time

    Lead Data EngineerPermanent OpportunityLocation: London, UK – 2 days travel to officeOverview: We are seeking a highly skilled Lead Data Engineer to join our team for a critical project with NHS England. The project involves migrating Privacy Enhancement Technology (PET) from the existing Privitar system to IQVIA across multiple data platforms. The ideal...

  • Lead Data Engineer

    3 days ago


    London,, UK, United Kingdom Understanding Recruitment Full time

    Data Engineer | West London (Hybrid Working)First 3 months Full Time then 2/3x per week there on in officeUp to £100,000 per annum doeI am looking for a Lead Data Engineer to join a cutting-edge tech team that are revolutionising the real estate industry through cloud tech!You will be joining an innovative and collaborative team based in Chiswick (West...

  • Lead Data Engineer

    3 days ago


    London,, UK, United Kingdom Innova Recruitment Full time

    We're working with an innovative client at the forefront of global trade, helping them find a passionate Lead Data Engineer to drive data innovation and strategy within their organisation. This is your opportunity to lead a team and build impactful data solutions in a cloud-based SaaS environment.The role requires a data engineering leader who can scale...

  • Lead Data Engineer

    3 weeks ago


    London,, UK, United Kingdom Collabera Digital Full time

    We are looking for a Lead Azure Data Engineer to join an existing team building a new strategic big data platform for our client.Minimum 10 years of experience with Azure Data Factory, Databricks, Data Mesh.The new platform will be an Azure based data lake with APIs and events to allow consumption of data by analytics teams and will replace the existing...

  • Lead Data engineer

    1 month ago


    London,, UK, United Kingdom Coforge Full time

    Role : Lead Data engineerJob Type : Full TimeJob Location : LondonMandatory Skills : SQL, Snowflakes, DBT (Data Build Tool) Job Description:-• Good knowledge of SQL programming.• Strong knowledge of Snowflake Cloud Data warehouse. Snowflake Functions and Procedures.• Good knowledge of Python, DBT.• In-depth understanding of Data Warehouse, ETL...

  • Lead Data Engineer

    3 days ago


    London,, UK, United Kingdom MarkJames Search Full time

    We are looking for a Lead Data Engineer to take charge of designing and implementing complex data flows across operational systems, analytics, and BI systems. As the lead, you will plan and drive the development of data solutions, ensuring a perfect balance between functional and non-functional requirements. This role also involves monitoring compliance with...


  • London, UK, UK, United Kingdom Datatech Analytics Full time

    Data Engineering Lead – AWS & SnowflakeHybrid working: 3 days in TW6, Middlesex offices & 2 days homer/remoteSalary: Negotiable to £70,000 DOE plus 40 % bonus potentialJob Reference: J12869Full UK working rights required/no sponsorship availableTHE ROLELooking for a challenge in one of the world’s largest airfreight logistics organisation and a FTSE 100...

  • Lead Design Manager

    2 months ago


    London,, UK, United Kingdom Colt Data Centre Services Full time

    Mission:We are seeking an agile Engineering Location Lead for the UK to support our Delivery Team at Colt DCS. The role will deliver technical excellence and leadership across the UK projects to ensure on time and on budget delivery. You will lead and manage a multi-disciplinary technical and design management team in the UK delivering multiple Hyperscale...

  • Data Engineer

    4 weeks ago


    London,, UK, United Kingdom IWSR Full time

    Data Engineer – Price Data TeamRemuneration: Competitive salary plus bonusLocation: London, SE1, with an established hybrid working policyProducts: The world’s leading data source for the beverage alcohol industryThis is an exciting opportunity for a Data Engineer to work within our Price Data team and collaborate with the Research teams globally. IWSR...

  • Lead Data Engineer

    4 weeks ago


    London, UK, United Kingdom Cornwallis Elt Full time

    Lead Data Engineer – Python, SQL, dbt, AWS, Dremio, Data Mesh, ETL, Data Pipelines, Data Warehousing, DWH, S3, Glue, Data Lake, Automation, London A Lead Data Engineer is sought after by a leading workplace pensions provider, to run their expanding data engineering team in their London City office. The team have recently built out a next-gen data lake...

  • Data Engineer

    1 month ago


    London,, UK, United Kingdom Collabera Digital Full time

    We are looking for a Senior Azure Data Engineer to join an existing team building a new strategic big data platform for our client.Minimum 5 years of experience with Azure Data Factory, Databricks, Data Mesh.The new platform will be an Azure based data lake with APIs and events to allow consumption of data by analytics teams and will replace the existing...


  • London, UK, United Kingdom Bloomberg Full time

    Bloomberg runs on data. As the Data Management & Analytics team within Engineering, we support Bloomberg's needs around managing data efficiently with a vision to ensure that the Right Data is identified and available in the Right Place to the Right People in the Right Form and at the Right Time. We have embarked on a journey to understand data needs...

  • Data Engineer

    3 weeks ago


    London,, UK, United Kingdom Higher - AI recruitment Full time

    OVO Group is a leading energy technology company determined to create a world with clean, affordable energy for everyone. Since launching in 2009, they have welcomed over a million members, planted a million trees, and set their sights on helping save the planet. They are on a mission to change energy for the better, including driving progress towards the...

  • Data Engineer

    4 weeks ago


    London,, UK, United Kingdom Higher - AI recruitment Full time

    OVO Group is a leading energy technology company determined to create a world with clean, affordable energy for everyone. Since launching in 2009, they have welcomed over a million members, planted a million trees, and set their sights on helping save the planet. They are on a mission to change energy for the better, including driving progress towards the...

  • Azure Data Engineer

    4 weeks ago


    London,, UK, United Kingdom Formula Recruitment Full time

    Azure Data EngineerSalary: up to £65,000Technology: Azure Synapse, Spark, Microsoft Fabric, Azure Data Factory and PowerBILocation: Hybrid - 1 day a month in the London office.I am partnered with a leading Microsoft Consultancy who are seeking an Azure Data Engineer to join their expanding team. You will be key in the design and optimisation of their data...


  • London,, UK, United Kingdom Harnham Full time

    Head of Data EngineeringLocation: 3 days a week in Central LondonSalary: Up to £110,000Overview:Our client is seeking a Head of Data Engineering to lead their data engineering team and shape the organization’s data infrastructure. You will design and implement scalable data architecture, drive data governance, and ensure seamless data integration....

  • Lead Data Architect

    4 months ago


    London,, UK, United Kingdom Zazu-Digital Full time

    Are you ready to make an impact in one of the UK's most dynamic and transformative public sector organisations? We are recruiting for the role of Lead Data Architect within the in-house digital product and services department of a groundbreaking public sector entity that's reshaping the way public services are delivered.As the Lead Data Architect,...


  • London,, UK, United Kingdom Collabera Digital Full time

    Job Description: Design, develop, and maintain scalable and secure Python-based applications and services.Collaborate closely with cross-functional teams to define, design, and deliver new features.Implement robust, scalable, and high-performance services.Optimize and refactor existing code to improve performance and maintainability.Develop and maintain data...

  • Data Engineer

    3 weeks ago


    London,, UK, United Kingdom Arcus Search Full time

    Arcus Search are proud to support a global Insurance Broker, on searching for an experienced autonomous and proactive Data Engineer with extensive Azure Data Factory (ADF), Data Lakehouse and DataBricks experience.This is a pivotal role in developing and enhancing key data platforms, continually enhancing these. This will be achieved through collaborating...

  • Data Quality Lead

    1 month ago


    London, UK, UK, United Kingdom Harnham Full time

    LEAD DATA QUALITY ANALYSTUP TO £80,000LONDON A retail client is looking for a Data Quality Lead to join their growing data team and spearhead the implementation of Data Quality Tools and processes across the business. Key Responsibilities:Develop technology solutions: Lead the development of systems to identify, measure, categorize, prioritize, and...