Data Engineer

4 days ago

Canary Wharf, Greater London, United Kingdom Low Carbon Contracts Company Ltd Full time
About the Role

We are seeking a highly skilled Data Engineer to join our team at the Low Carbon Contracts Company Ltd. As a key member of our data team, you will play a critical role in designing and implementing data platforms that support our mission to advance a flexible energy future.

Key Responsibilities
  • Design and build ETL/ELT pipelines to ensure data accuracy and usability
  • Work with various data sources, including APIs, web scraping, and third-party services, to ingest and transform data sets
  • Develop and maintain data pipelines to ensure efficient data synchronisation and flow between platforms and systems
  • Explore ways to enhance data quality and reliability, and drive better data governance through the creation and embedding of principles and processes
  • Set service level indicators and monitor execution of data workflows, and configure alerts to ensure data integrity
Requirements
  • At least 2 years of experience in designing data engineering solutions, with a strong background in data analytics and modelling
  • Hands-on experience with the Azure Data ecosystem, including Azure Databricks, Data Factory, Data Lake, and Synapse
  • Strong competence in Python, with experience in PySpark and SQL
  • Experience in building and maintaining data pipelines, with a focus on data quality and reliability
What We Offer

As a Data Engineer at the Low Carbon Contracts Company Ltd, you will have the opportunity to work on a wide range of projects that support our mission to advance a flexible energy future. You will be part of a dynamic and supportive team, and will have access to a range of benefits, including:

  • 25 days' annual leave and bank holidays
  • Recognition schemes allowing colleagues to say thanks
  • Company contribution to your pension scheme
  • Family friendly policies, including enhanced company maternity/paternity and shared parental benefits
  • Employee assistance programme for free, confidential support for your professional or personal life
About Us

The Low Carbon Contracts Company Ltd exists to help decarbonise the generation of electricity and make it more affordable for the future. Our work is central to the delivery of the Government's objective to achieve Net Zero target by 2050. We manage the Contracts for Difference (CfDs) scheme, which are agreements we have made with renewable generators to provide investors with confidence when investing in low carbon technology. We also manage money flows across energy suppliers to fund the CfD portfolio, settle the capacity market, and develop new schemes.

Please note that your diversity data will remain anonymised to us, and will only be used to help us understand whether we are effectively connecting with underrepresented groups and realising our diversity aims.

  • Data Engineer

    4 weeks ago

    Canary Wharf, Greater London, United Kingdom microTECH Global Ltd Full time

    Job Title: Data EngineerLocation: 100% Remote from anywhere in EuropeType: ContractDuration: 6 MonthsRate: 30EUR/hourResponsibilities:Design, implement, test, deploy, and maintain highly scalable data management systems and solutions, ensuring proper complianceDesign and build stable, reliable and effective data processing pipelines across the Data Lake and...

  • Senior Data Engineer

    1 week ago

    Canary Wharf, Greater London, United Kingdom TalentTrade Recruitment Limited Full time

    About the Role:TalentTrade Recruitment Limited is seeking a highly skilled Data/ETL Engineer to join our team. As a leading consultancy, we are embarking on a digital transformation for a financial services end client, and we require a professional with extensive experience in Ab Initio, Bash, Python, PSQL, and Oracle.Key Responsibilities:Design, develop,...

  • Senior Data Engineer

    1 week ago

    Canary Wharf, Greater London, United Kingdom TalentTrade Recruitment Limited Full time

    About the Role:TalentTrade Recruitment Limited is seeking a highly skilled Data/ETL Engineer to join our team. As a leading consultancy, we are embarking on a digital transformation for a financial services end client, and we require a professional with extensive experience in Ab Initio, Bash, Python, PSQL, and Oracle.Key Responsibilities:Design, develop,...

  • Data Integration Specialist

    3 days ago

    Canary Wharf, Greater London, United Kingdom TalentTrade Recruitment Limited Full time

    Data/ETL EngineerWe are seeking a highly skilled Data/ETL Engineer to join our team at TalentTrade Recruitment Limited. The successful candidate will have extensive experience in Ab Initio, Bash, Python, PSQL, and Oracle, with a strong background in data integration, transformation, and loading processes.Key Responsibilities:Design, develop, and maintain ETL...

  • Data Integration Specialist

    3 days ago

    Canary Wharf, Greater London, United Kingdom TalentTrade Recruitment Limited Full time

    Data/ETL EngineerWe are seeking a highly skilled Data/ETL Engineer to join our team at TalentTrade Recruitment Limited. The successful candidate will have extensive experience in Ab Initio, Bash, Python, PSQL, and Oracle, with a strong background in data integration, transformation, and loading processes.Key Responsibilities:Design, develop, and maintain ETL...

  • CPRD FTC Data Scientist

    1 month ago

    Canary Wharf, Greater London, United Kingdom The Medicines And Healthcare Products Regulatory Agency Full time

    The MHRA is transforming. Through enabling innovation, making the right judgements of the benefits and risks of medical products and forging the right partnerships in the UK and internationally, it aims to deliver world class regulation and improved outcomes for UK patients.We are currently looking for a Data Scientist to join our Clinical Practice Research...

  • Lead Infrastructure Engineer

    4 weeks ago

    Canary Wharf, Greater London, United Kingdom Purview Services Full time

    Lead Infrastructure Engineer Location: Remote UK Contract Duration: 12 months Initial Contract Engagement Type: Inside IR35 We are excited to present an opportunity for a Lead Infrastructure Engineer to join our team at Purview Services. This role is integral to a long-term initiative within a prominent financial institution in the UK, focusing on data...

  • Azure DevOps Engineer

    4 days ago

    Canary Wharf, Greater London, United Kingdom Amber Labs Full time

    About the RoleWe are seeking an experienced Azure DevOps Engineer to join our dynamic and innovative team at Amber Labs. As a DevOps Engineer, you will be responsible for designing, implementing, and maintaining our continuous integration and deployment pipelines using Microsoft Azure DevOps.Key ResponsibilitiesDesign and implement continuous integration and...

  • Azure DevOps Engineer

    4 days ago

    Canary Wharf, Greater London, United Kingdom Amber Labs Full time

    About the RoleWe are seeking an experienced Azure DevOps Engineer to join our dynamic and innovative team at Amber Labs. As a DevOps Engineer, you will be responsible for designing, implementing, and maintaining our continuous integration and deployment pipelines using Microsoft Azure DevOps.Key ResponsibilitiesDesign and implement continuous integration and...

  • Postdoctoral Research Assistant in Data-driven Models for Reactive Flows

    7 days ago

    Canary Wharf, Greater London, United Kingdom Queen Mary University of London Full time

    About the RoleThe primary objective of this project is to develop a reduced-order surrogate model for predicting the ammonia direct injection spray characteristics using a hybrid machine learning approach. This project is a collaborative effort with Kyushu University, Japan, under the supervision of Dr. Amin Paykani at Queen Mary University of London, as...

  • Postdoctoral Research Assistant in Data-driven Models for Reactive Flows

    6 days ago

    Canary Wharf, Greater London, United Kingdom Queen Mary University of London Full time

    About the RoleThe primary objective of this project is to develop a reduced-order surrogate model for predicting the ammonia direct injection spray characteristics using a hybrid machine learning approach. This project is a collaborative effort with Kyushu University, Japan, under the supervision of Dr. Amin Paykani at Queen Mary University of London, as...

  • HVAC Systems Engineer

    4 weeks ago

    Canary Wharf, Greater London, United Kingdom Velocity Recruitment Full time £40,000 - £45,000

    Position: HVAC Systems EngineerWork Schedule: Monday - Friday (8 AM - 5 PM)Velocity Recruitment is seeking a skilled HVAC Systems Engineer to join our expanding team. Our organization specializes in providing comprehensive building services to various commercial and public sector clients.As a key member of our team, you will be responsible for ensuring that...

  • Postdoctoral Research Assistant

    4 days ago

    Canary Wharf, Greater London, United Kingdom Queen Mary University of London Full time

    About the RoleWe are seeking a highly skilled Postdoctoral Research Assistant to join our team in the School of Mathematical Sciences at Queen Mary University of London. The successful candidate will work closely with Dr. Omer Bobrowski on the EPSRC-funded project "Universality in Topological Data Analysis". The project aims to study the probabilistic...

  • Postdoctoral Research Assistant

    4 days ago

    Canary Wharf, Greater London, United Kingdom Queen Mary University of London Full time

    About the RoleWe are seeking a highly skilled Postdoctoral Research Assistant to join our team in the School of Mathematical Sciences at Queen Mary University of London. The successful candidate will work closely with Dr. Omer Bobrowski on the EPSRC-funded project "Universality in Topological Data Analysis". The project aims to study the probabilistic...

  • Software Engineer

    2 weeks ago

    Canary Wharf, Greater London, United Kingdom Qualserv Consulting Limited Full time

    This is a fantastic opportunity for skilled developers to work on a variety of exciting systems development projects on-site at a large global financial services institution.The role will involve the following:Interpreting business requirements and developing software solutionsDesigning and implementing C#.NET applicationsTesting and debugging applications...

  • Software Engineer

    1 week ago

    Canary Wharf, Greater London, United Kingdom Qualserv Consulting Limited Full time

    This is a fantastic opportunity for skilled developers to work on a variety of exciting systems development projects on-site at a large global financial services institution.The role will involve the following:Interpreting business requirements and developing software solutionsDesigning and implementing C#.NET applicationsTesting and debugging applications...

  • Front-End Software Engineer

    4 weeks ago

    Canary Wharf, Greater London, United Kingdom Purview Services Full time

    Position Overview We are seeking a Front-End Software Engineer for a 6-month initial contract with the potential for extension. This role offers a hybrid working model. About the Role Our esteemed client, a leader in the banking sector, is looking for a skilled developer to join their team. The ideal candidate will possess: Proficiency in API integration...

  • Architect Lead

    2 weeks ago

    Canary Wharf, Greater London, United Kingdom Third Nexus Group Limited Full time

    Job Description**Architect Lead - Software Engineering Expert**We are seeking an experienced Architect Lead to join our team at Third Nexus Group Limited. As a key member of our architecture team, you will be responsible for leading the architectural design and development of complex software systems.Key ResponsibilitiesLead the architectural design and...

  • Architect Lead

    1 week ago

    Canary Wharf, Greater London, United Kingdom Third Nexus Group Limited Full time

    Job Description**Architect Lead - Software Engineering Expert**We are seeking an experienced Architect Lead to join our team at Third Nexus Group Limited. As a key member of our architecture team, you will be responsible for leading the architectural design and development of complex software systems.Key ResponsibilitiesLead the architectural design and...

  • Data-Driven Modeling of Reactive Flows

    3 weeks ago

    Canary Wharf, Greater London, United Kingdom Queen Mary University of London Full time

    Shape the Future of Combustion with Machine LearningWe are seeking a highly motivated Postdoctoral Research Assistant to contribute to a groundbreaking project at the forefront of machine learning and turbulent combustion modeling. This exciting opportunity will see you develop innovative reduced-order surrogate models for predicting ammonia spray...