Data Engineer for Energy Data Onboarding
2 weeks ago
We are delighted to announce an exciting opportunity in our Market Data IT team at RWE Supply & Trading.
As a Senior Software Developer, you will be integral in providing, onboarding, and automating data that drives our trading decisions.
In this role, you will work with a range of technologies, including APIs, web scraping, FTP, and SFTP, and apply your expertise in C#, .Net, and Python.
This position is perfect for someone with strong skills in handling multi-account environments and a passion for developing efficient ways to access data to drive meaningful outcomes.
About the Role
- You will take ownership of technical designs for use cases relating to Data Onboarding, ensuring robustness, performance, and maintainability.
- You will leverage extensive knowledge of energy data providers to determine the most efficient methods for data onboarding.
- You will build processes and automated workflows that support data transformation as well as tools for handling various data types.
- You will create Standard Frameworks with which data from different vendors and sources can be onboarded easily, quickly, and in a more self-service driven manner.
- You will design and develop scalable back-end services and APIs using both C#, .Net 8, and Python.
- You will implement extraction and transformation logic within .Net environments.
- You will utilize Python for data processing, automation, and specific application logic as needed.
About the Company
RWE Supply & Trading is a leading company in the energy sector, and we are committed to excellence in all aspects of our business.
What We Offer
- A competitive salary: €80,000 - €110,000 per annum, depending on experience.
- An annual discretionary bonus.
- The opportunity to work in a large agile team on projects that matter.
- A diverse and inclusive company culture.
Requirements
- Proven experience in full stack development with strong capabilities in both C#, .Net (preferably .Net 8), and Python.
- Experience in ETL environments to design, implement, and maintain optimal data pipeline infrastructure including parsing, cleansing, and wrangling of diverse and large datasets.
- Practical experience with CI/CD pipelines, using tools such as Azure DevOps, GitLab, or similar platforms.
- Strong skills in development and scripting languages like Python.
- Experience working with energy data providers to onboard data to internal platforms and APIs.
-
Senior AWS Data Engineer
1 month ago
London, Greater London, United Kingdom RWE AG Full timeAbout the RoleWe are seeking a highly skilled AWS Data Engineer to join our Market Data IT team at RWE Supply & Trading GmbH. As a key member of our dynamic Data team, you will play a crucial role in providing, onboarding, and automating data that drives our trading decisions.Your Key ResponsibilitiesDesign and implement technical solutions for data...
-
Data Engineer
3 weeks ago
London, Greater London, United Kingdom Data Idols Full time £400 - £500Role OverviewData Idols is seeking a skilled Data Engineer to assist in modernising data pipelines, data standards and data reports for a national software company.Key ResponsibilitiesImprove data structures, pipelines and reportingCollaborate with the CTO to review reports and implement necessary changes or improvementsWhat You'll GainUp to £500 a...
-
Data Engineer
1 week ago
London, Greater London, United Kingdom Data Privacy Full timeAbout UsHouseful is a leading property technology company known for its innovative approach to the property market. With brands like Zoopla, Alto, Hometrack, Calcasa, Mojo, and Prime location, we leverage software, data, and insights to drive progress in the industry.Company OverviewWe're committed to helping everyone make informed decisions about their...
-
Data Engineer Specialist
1 month ago
London, Greater London, United Kingdom Data Idols Full timeData Engineer Role OverviewData Idols is working with a national software company that helps the public sector build better data solutions. They are looking for a Full-stack Data Engineer contractor to join them for an initial three months to assist in modernising data pipelines, data standards and data reports.As a Full-stack Engineer, you will be...
-
Data Engineering Manager
3 weeks ago
London, Greater London, United Kingdom Data Idols Full time £90,000 - £95,000The OpportunityData Idols is seeking a Data Engineering Manager to support the delivery of data transformation during an exciting time within the company. This individual will work with the teams to implement data strategy and deliver value throughout the company.The ideal candidate will have extensive experience in managing teams, stakeholder management,...
-
Data Engineer
4 weeks ago
London, Greater London, United Kingdom NTT DATA Full timeJob Summary We are seeking an experienced Data Engineer to join our Anti-Financial Crime Technology team at NTT DATA. The ideal candidate will have a strong background in big data related technologies, including Hadoop and Elastic Search. Key Responsibilities: Analyzing large datasets and designing scalable data ingestion workflows Working closely with team...
-
Data Systems Engineer
3 weeks ago
London, Greater London, United Kingdom Data Privacy Full timeAbout the Role:We are seeking a skilled Data Systems Engineer to join our team at Houseful.Key Responsibilities:Design and implement data warehousing solutions using AWS technologies.Collaborate with senior engineers to ensure data accuracy and implement validation checks.Develop and maintain ETL/ELT pipelines, ensuring alignment with business...
-
Senior Data Engineer
3 weeks ago
London, Greater London, United Kingdom Data Idols Full time £75,000 - £95,000Data Engineering Role at Data IdolsJoin Data Idols, a renowned retail brand in the UK, as a Senior Data Engineer and contribute to the delivery of data transformation during an exciting period of growth. The ideal candidate will have extensive experience in building and maintaining data pipelines and collaborating with cross-functional data teams.About the...
-
Data Engineer
4 weeks ago
London, Greater London, United Kingdom Data Idols Full timeJob Opportunity:The company Data Idols is seeking a skilled Full-stack Data Engineer to assist in modernising data pipelines, data standards and data reports for a national software company that helps the public sector build better data solutions.The Opportunity:As a Full-stack Engineer, you will be responsible for improving data structures, pipelines and...
-
Senior Data Engineer
4 weeks ago
London, Greater London, United Kingdom Data Idols Full timeAbout the RoleData Idols is seeking a highly skilled Senior Data Engineer to join their team. As a key member of the data team, you will be responsible for designing and implementing data pipelines and data warehousing solutions using Azure and Spark.The OpportunityThis is an exciting opportunity for a talented Data Engineer to play a key role in driving...
-
Data Engineering Manager
7 days ago
London, Greater London, United Kingdom Data Idols Full timeJob OverviewData Idols is seeking an experienced Data Engineering Manager to support the delivery of data transformation during an exciting time within the company.You will work with the teams to implement data strategy and deliver value throughout the company, leveraging your technical expertise and stakeholder management skills.
-
Chief Data Engineering Lead
2 weeks ago
London, Greater London, United Kingdom Data Idols Full timeData Idols is looking for a Chief Data Engineering Lead to support the delivery of data transformation.As a key member of the team, you will collaborate with the wider data teams and drive high standards across the data function. The role involves building pipelines to deliver insights enabling the company to be more data driven in their decision making.Key...
-
Data Engineer Leader
1 day ago
London, Greater London, United Kingdom Data Idols Full time £80,000 - £90,000Job OverviewData Idols is a pioneering retailer transforming into a data-driven organisation. As a Senior Data Platform Engineer, you will shape the data landscape by designing, implementing, and maintaining a robust data platform using Azure Services.We offer a competitive salary of £80,000 - £90,000 + bonus, along with 20% discount across all products,...
-
Data Engineer for Digital Transformation
7 days ago
London, Greater London, United Kingdom Data Idols Full timeSenior Data Platform EngineerWe are seeking a highly skilled Data Engineer to join our team at Data Idols. As a key member of our data platforms group, you will play a vital role in shaping the data landscape and contribute to data-driven decision-making.The OpportunityIn this exciting role, you will be responsible for designing, implementing, and...
-
Cloud Data Engineering Manager
1 day ago
London, Greater London, United Kingdom Data Idols Full time £80,000 - £90,000Data Engineering OpportunityData Idols is seeking a skilled Senior Data Platform Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, implementing, and maintaining a robust data platform using Azure Services.This is an exciting opportunity to work with cutting-edge cloud-based technologies and collaborate...
-
Senior Data Consultant: Strategic Data Advisor
4 weeks ago
London, Greater London, United Kingdom NTT DATA Full timeData Strategy and Governance Role About the Job We are seeking a highly skilled and experienced Senior Data Consultant to join our dynamic team at NTT DATA. This role will focus on providing strategic data consulting and advisory services to our clients, helping them to develop and implement effective data strategies, governance frameworks, and operating...
-
Senior Data Engineer Lead
7 days ago
London, Greater London, United Kingdom Data Idols Full timeThe OpportunityWe are looking for a skilled Data Engineering Manager who has extensive experience in managing teams, implementing data strategy, and working with Azure. As a hands-off role, you will have the autonomy to lead the team and drive results.Your key responsibilities include:Implementing data strategy to drive business valueManaging and mentoring...
-
Data Engineer for Energy Transition
1 week ago
London, Greater London, United Kingdom Modo Energy Limited Full timeAbout Modo Energy LimitedWe are on a mission to build the information architecture for the energy transition, aiming to be the go-to destination for information on the global journey to net zero.Our platform provides open access to an array of content on the energy transition, and we're looking for individuals who share our passion for product-building,...
-
Data Strategist
7 days ago
London, Greater London, United Kingdom Data Idols Full timeAbout YouTo succeed as our Data Engineering Manager, you will need to possess:Strong stakeholder management skills, with the ability to communicate effectively with cross-functional teamsExperience implementing data strategy, with a proven track record of driving business outcomesStrong experience managing Data Engineering teams, with a focus on talent...
-
Senior Data Scientist, Data Engineering Expert
3 weeks ago
London, Greater London, United Kingdom Data Science Festival Full timeSenior Data EngineerAs a Senior Data Engineer at Data Science Festival, you will play a key role in shaping the company's data transformation strategy. Your expertise in building and maintaining data pipelines will be invaluable in driving high standards across the data function. You will build reliable and high-quality data solutions, supporting the team in...