Senior Engineer, Data Engineering

1 month ago

United Kingdom Octopus Energy Full time

Do you love data engineering? Do you also have experience analysing and getting value from financial data? Our Gross Margin team is responsible for producing key financial outputs to report on the profitability of the business and the different products we offer to customers.
By running this regularly, we can break down the progression of historical and forecasted financial reporting by meter configuration (e.g. smart vs dumb meters), agreement type (e.g. fixed vs variable customers), billing status, cost types (e.g. wholesale and distribution) and consumption type (estimated vs actual).
Due to the growing scale of our customer base, the complexity of the UK electricity and gas markets, and the shift towards tracking consumption at a half-hourly level using smart meter data, we are therefore looking for someone to take on this great opportunity to combine data engineering and financial analytics to deliver business critical need.
Ensuring the Gross Margin team gets the financial outputs they need on a weekly/monthly basis to support accounting and audit requirements;
Finding, troubleshooting and solving problems leading to shifting trends or irregularities in the gross margin numbers caused by changes in Kraken (our customer management and billing system), industry or coding logic;
Designing and implementing easy-to-use processes that allow for flexible adjustments to the GM output for spontaneous accounting requirements;
Setting up dashboards to automate reporting, track data integrity and monitor variances against industry and Kraken;
Improving the pipeline architecture and integrating automated tests to make it faster and more resilient to upstream data changes;
Strong aptitude with SQL and Python;
Keen eye for detail to find root causes in the pipeline leading to shifts in output numbers;
Ability to quickly understand new domain areas and visualise data effectively;
Team player excited at the idea of ownership across lots of different projects and tools;
Passion for driving towards Net Zero;
Our Data Stack:
This is the tool suite we currently use and will help you learn in this role:
SQL-based pipelines built with dbt on Databricks
Analysis via Python jupyter notebooks
Streamlit and Python for dashboardingAirflow DAGs with Python for ETL
Notion for data documentation
Our Data Stack:
This is the tool suite we currently use and will help you learn in this role:
SQL-based pipelines built with dbt on Databricks
Analysis via Python jupyter notebooks
Streamlit and Python for dashboarding
Airflow DAGs with Python for ETLNotion for data documentation
On a call with one of our recruiters it's something we always cover as we genuinely want to match your experience with the correct salary. Where people work with autonomy, alongside a wide range of amazing co-owners, on projects that break new ground. We won best company to work for in 2022, on Glassdoor we were voted 50 best places to work in 2022 and our Group CEO, Greg has recorded a podcast about our culture and how we empower our people. We’ve also been placed in the top 10 companies for senior leadership and most recently The Sunday Times, Best Places To Work 2023
Visit our UK perks hub - Octopus Employee Benefits
#

  • Senior Engineer, Data Engineering

    4 weeks ago

    United Kingdom Data Science Talent Full time

    Data Engineering in Animal Health 80% remote £60-70k basic salary plus 10% bonus If you’re as much of an animal lover as you are a data engineer, you won’t find a better opportunity to use your skills for good. In this newly created role you’ll be setting up the data infrastructure that will help this thriving veterinary care company to...

  • Senior Data Engineer

    1 month ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients. This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Data Engineer

    4 weeks ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients. This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Data Engineer

    4 weeks ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients.This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Data Engineer

    1 month ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients. This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Data Engineer

    4 weeks ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients.This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Data Engineer

    1 month ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients. This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Data Engineer

    1 month ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients.This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Data Engineer

    3 weeks ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients. This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Process Engineering

    1 month ago

    United Kingdom The Chemical Engineer Full time

    Our client develops, engineers, fabricates, supplies, and installs discreet process equipment items and complete process systems for applications within chemical /process engineering. The company’s reputation is well established and founded on its commitment to product innovation, customer service and engineering excellence. On the job training would be...

  • Senior Engineer, Data Engineering

    4 weeks ago

    United Kingdom La Fosse Full time

    Senior Data Engineer - 6 month FTC London (Hybrid Role) £Senior Data Engineer Opportunity An exciting opportunity has arisen for a Senior Data Engineer to join a dynamic team dedicated to shaping effortless, digital-first customer experiences. This role is pivotal in driving value for customers through modelling, sourcing, and data transformation. The...

  • Senior Engineer, Data Engineering

    4 weeks ago

    United Kingdom La Fosse Full time

    Senior Data Engineer - 6 month FTC London (Hybrid Role) £Senior Data Engineer Opportunity An exciting opportunity has arisen for a Senior Data Engineer to join a dynamic team dedicated to shaping effortless, digital-first customer experiences. This role is pivotal in driving value for customers through modelling, sourcing, and data transformation. The...

  • Senior Engineer, Data Engineering

    6 days ago

    United Kingdom Clearwater People Solutions Ltd Full time

    Our client, a well-known and market-leading Financial Services company, is currently recruiting for a Senior Data Engineer to join their Data engineering team. The Senior Data Engineer will be responsible for designing, developing, and maintaining data pipelines and workflows to support the organisation's data processing needs and facilitate BI reporting and...

  • Senior Data Engineer

    2 weeks ago

    united kingdom JR United Kingdom Remote Work Freelance Full time

    Senior Data EngineerUp to £90,000 + BonusFully Remote in UKOVERVIEWMajor FTSE100 retail giant hiring for x2 Senior Data Engineers, to lead small teams of Data Engineers on key projects, directly line managing them and providing technical leadership and guidance to the team. You will be joining a well-established Data function with huge customer data to work...

  • Senior Engineer, Data Engineering

    1 week ago

    United Kingdom La Fosse Full time

    Senior Data Engineer 6 month fixed term contract – 2 x a week in London £We're seeking a talented Senior Data Engineer to join the data engineering team on a 6-month fixed-term contract, with the potential to extend but within a different department in the company. As a Senior Data Engineer, you'll play a pivotal role in maturing the data warehouse....

  • Senior Data Engineer

    5 days ago

    United Kingdom Clearwater People Solutions Ltd Full time

    Our client, a well-known and market-leading Financial Services company, is currently recruiting for a Senior Data Engineer to join their Data engineering team. The Senior Data Engineer will be responsible for designing, developing, and maintaining data pipelines and workflows to support the organisation's data processing needs and facilitate BI...

  • Senior Data Engineer

    6 days ago

    United Kingdom Clearwater People Solutions Ltd Full time

    Our client, a well-known and market-leading Financial Services company, is currently recruiting for a Senior Data Engineer to join their Data engineering team. The Senior Data Engineer will be responsible for designing, developing, and maintaining data pipelines and workflows to support the organisation's data processing needs and facilitate BI...

  • Senior Engineer, Data Engineering

    2 weeks ago

    United Kingdom Xcede Full time

    SENIOR DATA ENGINEER (EU Remote Opportunity) Xcede are delighted to be working with a very exciting Web3 / Blockchain organisation with a remote working culture. Their company makes life easier for organisations in the Web3 space by providing managed services across a range of operational tasks and responsibilities in one space. As a Senior Data Engineer...

  • Senior Engineer, Data Engineering

    2 weeks ago

    United Kingdom Xcede Full time

    SENIOR DATA ENGINEER (EU Remote Opportunity) Xcede are delighted to be working with a very exciting Web3 / Blockchain organisation with a remote working culture. Their company makes life easier for organisations in the Web3 space by providing managed services across a range of operational tasks and responsibilities in one space. As a Senior Data Engineer...

  • Senior Data Engineer

    5 days ago

    United Kingdom Clearwater People Solutions Ltd Full time

    Our client, a well-known and market-leading Financial Services company, is currently recruiting for a Senior Data Engineer to join their Data engineering team. The Senior Data Engineer will be responsible for designing, developing, and maintaining data pipelines and workflows to support the organisation's data processing needs and facilitate BI reporting and...