Senior Python Software Engineer AWS Data Mesh Finance London

1 month ago


London, United Kingdom Joseph Harry Ltd Full time
Job Description

Senior Python Data Engineer (Architecture Programmer Developer Python Java Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Iceberg PySpark MWAA Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset Manager Financial Services FX Fixed Income Equities Commodities Derivatives Hedge Fund) required by my asset management client in London.

You MUST have the following:

  • Advanced ability as a Senior Python Data Engineer/Data Architect
  • AWS (EC2, ECS, EKS, Glue)
  • Excellent Python ability
  • PySpark
  • MWAA/Airflow/Dagster
  • At least one of the following:
    • Apache Iceberg
    • DBT
    • Dremio
    • Snowflake

The following is DESIRABLE, not essential:

  • Experience with data mesh architectures

Role: Senior Python Data Engineer (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Iceberg PySpark MWAA Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset Manager Financial Services FX Fixed Income Equities Commodities Derivatives Hedge Fund) required by my asset management client in London. You will join a number of teams that are responsible for the core engineering of a large amount of financial trading data. The data is currently ingested into, and stored in, an AWS data lake. This is being migrated to a data mesh architecture though. You will work within a team of 4-5 engineers that will contribute towards this migration, working with AWS Glue, Athena, Python, Java, Iceberg, DBT, Arrow and Dremio.

They have a very flexible hybrid working set up of 1-2 days/month in the office.

Salary: £90k - £125k + 15% Guaranteed Bonus + 10% Pension



  • London, United Kingdom Joseph Harry Ltd Full time

    Job Description Senior Java Data Engineer (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Iceberg PySpark MWAA Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front...


  • London, United Kingdom Joseph Harry Ltd Full time

    Job Description Senior Python Software Engineer (Senior Architecture Programmer Developer Python Java Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office...


  • London, United Kingdom Joseph Harry Ltd Full time

    Job Description Senior DevOps Engineer (AWS Python Amazon Web Services DevOps Kafka Glue Athena Apache Iceberg API Gateway Apigee Cribl Confluence Kafka Developer Software Engineer Programmer Technical Python JavaScript Front Office Trading Finance Asset Manager Investment Manager Banking) required by our asset management client in London. You MUST have the...

  • Lead Data Engineer

    1 month ago


    London, United Kingdom Cornwallis Elt Ltd Full time

    Job Description Lead Data Engineer - Python, SQL, dbt, AWS, Dremio, Data Mesh, ETL, Data Pipelines, Data Warehousing, DWH, S3, Glue, Data Lake, Automation, London A Lead Data Engineer is sought after by a leading workplace pensions provider, to run their expanding data engineering team in their London City office. The team have recently built out a next-gen...

  • Lead Data Engineer

    2 months ago


    London, UK, United Kingdom Cornwallis Elt Full time

    Lead Data Engineer – Python, SQL, dbt, AWS, Dremio, Data Mesh, ETL, Data Pipelines, Data Warehousing, DWH, S3, Glue, Data Lake, Automation, London A Lead Data Engineer is sought after by a leading workplace pensions provider, to run their expanding data engineering team in their London City office. The team have recently built out a next-gen data lake...

  • Lead Data Engineer

    3 months ago


    London, United Kingdom Cornwallis Elt Full time

    Lead Data Engineer – Python, SQL, dbt, AWS, Dremio, Data Mesh, ETL, Data Pipelines, Data Warehousing, DWH, S3, Glue, Data Lake, Automation, London A Lead Data Engineer is sought after by a leading workplace pensions provider, to run their expanding data engineering team in their London City office. The team have recently built out a next-gen data lake...


  • London, Greater London, United Kingdom undisclosed Full time

    Senior Python Data Engineer for Financial Trading DataWe are seeking a highly skilled Senior Python Data Engineer to join our team in London. As a Senior Python Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Python and AWS.The ideal candidate will have advanced ability as a Senior...


  • London, United Kingdom Joseph Harry Ltd Full time

    Job Description Senior Data DevOps Engineer (AWS Python Amazon Web Services Data DevOps SRE Site Reliability Engineer Developer Software Engineer Programmer Technical Lead Front Office ECS Lambda Kafka Airflow Spark PySpark Dremio Ignite DBT Iceberg Arrow Glue Athena Docker Terraform OpenShift Kubernetes KOPS Artifactory Trading Finance Java Asset Manager...


  • London, United Kingdom Joseph Harry Ltd Full time

    Job Description Senior DevOps Engineer (AWS Python Amazon Web Services DevOps SRE Site Reliability Engineer Developer Software Engineer Programmer Technical Python Terraform Docker JavaScript Front Office ECS Lambda EC2 S3 RDS Redshift CloudFormation SQS Kubernetes Trading Finance Asset Manager Investment Manager Banking) required by our asset management...


  • London, United Kingdom Mesh-AI Full time

    London **About Mesh-AI** We’re a transformation consultancy and we exist to reimagine how enterprises operate, making data and AI their competitive advantage. We turn enterprises into data-driven and AI enabled organisations, unleashing business growth and accelerating outcomes. We have big ambitions for the future. Since we launched October 2021,...


  • London, Greater London, United Kingdom Joseph Harry Ltd Full time

    Python Developer (Software Engineer Programmer Developer Python Fixed Income JavaScript Node Fixed Income Credit Rates Bonds ABS Vue Angular React Agile AWS GCP Buy Side Asset Manager Investment Management Performance Risk Attribution TypeScript Node Finance Front Office Trading Financial Services) required by our asset management client in London.Key...


  • London, United Kingdom Joseph Harry Ltd Full time

    Job Description Python Developer (Software Engineer Programmer Developer Python Fixed Income JavaScript Node Fixed Income Credit Rates Bonds ABS Vue Angular React Agile AWS GCP Buy Side Asset Manager Investment Management Performance Risk Attribution TypeScript Node Finance Front Office Trading Financial Services) required by our asset management client in...


  • London, United Kingdom Cornwallis Elt Full time

    Lead Data Engineer – Python, SQL, dbt, AWS, Dremio, Data Mesh, ETL, Data Pipelines, Data Warehousing, DWH, S3, Glue, Data Lake, Automation, London A Lead Data Engineer is sought after by a leading workplace pensions provider, to run their expanding data engineering team in their London City office. The team have recently built out a next-gen data lake...


  • London, United Kingdom Cornwallis Elt Full time

    Lead Data Engineer – Python, SQL, dbt, AWS, Dremio, Data Mesh, ETL, Data Pipelines, Data Warehousing, DWH, S3, Glue, Data Lake, Automation, London A Lead Data Engineer is sought after by a leading workplace pensions provider, to run their expanding data engineering team in their London City office. The team have recently built out a next-gen data lake...

  • Senior Data Architect

    4 weeks ago


    London, Greater London, United Kingdom Joseph Harry Ltd Full time

    Key Responsibilities:As a Senior Data Architect at Joseph Harry Ltd, you will be responsible for designing and implementing advanced data analytics and engineering solutions for our finance and trading clients. You will work closely with our development team to develop and deploy scalable data architectures using AWS cloud services, such as EC2, ECS, and...


  • London, United Kingdom Joseph Harry Ltd Full time

    Job Description Python Data Engineer (Software Engineer Programmer Developer Data Engineer Python PySpark Spark Glue Athena Iceberg Airflow Dagster DBT Java Agile AWS GCP Buy Side Asset Manager Investment Management Finance Front Office Trading Financial Services Pandas Numpy Scipy Banking) required by our asset management client in London. You MUST have the...


  • London, Greater London, United Kingdom caia - Jobboard Full time

    Caia - Jobboard is seeking a Senior Data Engineer to join our team. The ideal candidate will have expert-level experience in Java, Spark, and Python.This role is a 6-Month Contract opportunity with a leading London-based investment bank offering hybrid working.You will be responsible for designing and building foundation components that underpin our data...


  • City of London, United Kingdom Cornwallis Elt Full time

    Lead Data Engineer – Python, SQL, dbt, AWS, Dremio, Data Mesh, ETL, Data Pipelines, Data Warehousing, DWH, S3, Glue, Data Lake, Automation, London A Lead Data Engineer is sought after by a leading workplace pensions provider, to run their expanding data engineering team in their London City office. The team have recently built out a next-gen data lake...

  • Data Scientist

    1 month ago


    London, United Kingdom Mesh-AI Limited Full time

    We’re a transformation consultancy and we exist to reimagine how enterprises operate, making data and AI their competitive advantage. We turn enterprises into data-driven and AI enabled organisations, unleashing business growth and accelerating outcomes. Since we launched October 2021, we’ve grown to over 100 people and are working with some of the...

  • Data Scientist

    1 month ago


    London, United Kingdom Mesh-AI Limited Full time

    We’re a transformation consultancy and we exist to reimagine how enterprises operate, making data and AI their competitive advantage. We turn enterprises into data-driven and AI enabled organisations, unleashing business growth and accelerating outcomes. Since we launched October 2021, we’ve grown to over 100 people and are working with some of the...