Data Engineer

1 month ago


London, Greater London, United Kingdom oilandgas Full time
Main Purpose:

We are seeking a skilled software engineer to collaborate with our trading teams and research analysts in a fast-paced commercial environment. This role offers the opportunity to work with cutting-edge cloud and software technology stacks, building end-to-end software platforms and stacks in a modern and innovation-driven business.

The successful candidate will be responsible for leading and building applications and software, as well as building core infrastructure and common services for use across our applications. They will also be responsible for building cloud-native big data platforms and analytics solutions, as well as maintaining time-critical data integration pipelines.

Key Responsibilities:

  1. Design and develop software components, frameworks, and microservices
  2. Build and maintain cloud-native big data platforms and analytics solutions
  3. Develop and implement time-critical data integration pipelines (ETL/ELT)
  4. Apply domain-driven design and software engineering best practices
  5. Collaborate with cross-functional teams to deliver software solutions
Abilities, Experience and Qualifications:
  1. 5+ years of experience with Python and/or Java-based languages
  2. Strong understanding of SQL and relational databases
  3. Experience with object-oriented design and distributed systems
  4. AWS experience (e.g. S3, Redshift, Glue, Lambda)
  5. Bachelor's degree or equivalent experience in computer science or related field
Competencies:
  1. Excellent communication and collaboration skills
  2. Ability to work under pressure and prioritize tasks effectively
  3. Strong problem-solving skills and ability to apply software solutions to complex business issues
Key Relationships and Department Overview:

The Data Science and Engineering team is responsible for researching, developing, and providing sophisticated analytics and data services and applications to the trading business and other commercial operations at Trafigura.


  • Data Engineer

    1 month ago


    London, Greater London, United Kingdom Data Privacy Full time

    Solution Architect for Data Engineering and Data WarehousingAt Databricks, we're on a mission to simplify data science and analytics for our customers. As a Solution Architect, you'll work closely with clients to demonstrate how our Data Intelligence Platform can address complex data challenges.Key ResponsibilitiesDesign and implement data engineering...

  • Data Engineer

    3 weeks ago


    London, Greater London, United Kingdom Data Idols Full time £400 - £500

    Role OverviewData Idols is seeking a skilled Data Engineer to assist in modernising data pipelines, data standards and data reports for a national software company.Key ResponsibilitiesImprove data structures, pipelines and reportingCollaborate with the CTO to review reports and implement necessary changes or improvementsWhat You'll GainUp to £500 a...

  • Senior Data Engineer

    1 month ago


    London, Greater London, United Kingdom Data Idols Full time £400 - £500

    Data EngineerData Idols is working with a national software company that helps the public sector build better data solutions. They are looking for a Full-stack Data Engineer contractor to assist in modernising data pipelines, data standards and data reports for an initial three months.As a Full-stack Engineer, you will be responsible for improving data...


  • London, Greater London, United Kingdom Data Idols Full time

    Data Engineer Role OverviewData Idols is working with a national software company that helps the public sector build better data solutions. They are looking for a Full-stack Data Engineer contractor to join them for an initial three months to assist in modernising data pipelines, data standards and data reports.As a Full-stack Engineer, you will be...

  • Senior Data Engineer

    1 month ago


    London, Greater London, United Kingdom Data Idols Full time £75,000 - £95,000

    Senior Data EngineerJoin Data Idols as a Senior Data Engineer and support the delivery of data transformation during an exciting time. You will collaborate with the wider data teams to build and maintain reliable and high-quality data solutions. Strong experience in Python is required. You will play a key role in driving high standards across the data...

  • Senior Data Engineer

    1 month ago


    London, Greater London, United Kingdom Data Idols Full time

    Unlock Your Potential as a Senior Data EngineerJoin Data Idols, a renowned retail brand, as a Senior Data Engineer and contribute to the delivery of data transformation during an exciting period of growth. Collaborate with the wider data teams to build and maintain data pipelines that drive high standards across the data function.The OpportunityAs a Senior...


  • London, Greater London, United Kingdom Data Idols Full time £90,000 - £95,000

    The OpportunityData Idols is seeking a Data Engineering Manager to support the delivery of data transformation during an exciting time within the company. This individual will work with the teams to implement data strategy and deliver value throughout the company.The ideal candidate will have extensive experience in managing teams, stakeholder management,...

  • Data Engineer

    3 days ago


    London, Greater London, United Kingdom Data Privacy Full time

    About UsHouseful is a leading property technology company known for its innovative approach to the property market. With brands like Zoopla, Alto, Hometrack, Calcasa, Mojo, and Prime location, we leverage software, data, and insights to drive progress in the industry.Company OverviewWe're committed to helping everyone make informed decisions about their...

  • Data Systems Engineer

    2 weeks ago


    London, Greater London, United Kingdom Data Privacy Full time

    About the Role:We are seeking a skilled Data Systems Engineer to join our team at Houseful.Key Responsibilities:Design and implement data warehousing solutions using AWS technologies.Collaborate with senior engineers to ensure data accuracy and implement validation checks.Develop and maintain ETL/ELT pipelines, ensuring alignment with business...

  • Senior Data Engineer

    2 weeks ago


    London, Greater London, United Kingdom Data Idols Full time £75,000 - £95,000

    Data Engineering Role at Data IdolsJoin Data Idols, a renowned retail brand in the UK, as a Senior Data Engineer and contribute to the delivery of data transformation during an exciting period of growth. The ideal candidate will have extensive experience in building and maintaining data pipelines and collaborating with cross-functional data teams.About the...

  • Staff Data Engineer

    1 month ago


    London, Greater London, United Kingdom Data Idols Full time

    Unlock the Power of Data with Our TeamWe are seeking a highly skilled Staff Data Engineer to join our team at Data Idols. As a key member of our data function, you will play a crucial role in driving high standards across our data operations.As a Staff Data Engineer, you will be responsible for building and maintaining data pipelines, collaborating with our...

  • Senior Data Engineer

    3 weeks ago


    London, Greater London, United Kingdom Data Idols Full time

    About the RoleData Idols is seeking a highly skilled Senior Data Engineer to join their team. As a key member of the data team, you will be responsible for designing and implementing data pipelines and data warehousing solutions using Azure and Spark.The OpportunityThis is an exciting opportunity for a talented Data Engineer to play a key role in driving...

  • Data Engineer

    3 weeks ago


    London, Greater London, United Kingdom NTT DATA Full time

    Job Summary We are seeking an experienced Data Engineer to join our Anti-Financial Crime Technology team at NTT DATA. The ideal candidate will have a strong background in big data related technologies, including Hadoop and Elastic Search. Key Responsibilities: Analyzing large datasets and designing scalable data ingestion workflows Working closely with team...

  • Data Engineer

    1 month ago


    London, Greater London, United Kingdom Data Privacy Full time

    Houseful is a leading property technology company that aims to empower individuals with data-driven insights. As a Data Engineer, you will play a crucial role in building and maintaining our data infrastructure, ensuring seamless data flow and accuracy.Key Responsibilities:Design and implement ETL/ELT pipelines using AWS technologies to extract, transform,...

  • Data Engineer

    3 weeks ago


    London, Greater London, United Kingdom Data Idols Full time

    Job Opportunity:The company Data Idols is seeking a skilled Full-stack Data Engineer to assist in modernising data pipelines, data standards and data reports for a national software company that helps the public sector build better data solutions.The Opportunity:As a Full-stack Engineer, you will be responsible for improving data structures, pipelines and...


  • London, Greater London, United Kingdom Data Idols Full time

    Job OverviewData Idols is seeking an experienced Data Engineering Manager to support the delivery of data transformation during an exciting time within the company.You will work with the teams to implement data strategy and deliver value throughout the company, leveraging your technical expertise and stakeholder management skills.


  • London, Greater London, United Kingdom Data Idols Full time

    Data Idols is looking for a Chief Data Engineering Lead to support the delivery of data transformation.As a key member of the team, you will collaborate with the wider data teams and drive high standards across the data function. The role involves building pipelines to deliver insights enabling the company to be more data driven in their decision making.Key...


  • London, Greater London, United Kingdom Data Idols Full time

    The OpportunityWe are looking for a skilled Data Engineering Manager who has extensive experience in managing teams, implementing data strategy, and working with Azure. As a hands-off role, you will have the autonomy to lead the team and drive results.Your key responsibilities include:Implementing data strategy to drive business valueManaging and mentoring...


  • London, Greater London, United Kingdom Data Idols Full time

    Senior Data Platform EngineerWe are seeking a highly skilled Data Engineer to join our team at Data Idols. As a key member of our data platforms group, you will play a vital role in shaping the data landscape and contribute to data-driven decision-making.The OpportunityIn this exciting role, you will be responsible for designing, implementing, and...


  • London, Greater London, United Kingdom Data Science Festival Full time

    Data Engineering Manager Role OverviewAt the forefront of our company's innovative landscape, we seek a seasoned Data Engineering Manager to spearhead data transformation initiatives. With an exciting tenure at one of the UK's most renowned retail brands, this pivotal role requires expertise in implementing data strategy and delivering value across the...