Data Engineer

6 days ago


London, Greater London, United Kingdom Open Data Science Conferenc Full time
  • You have prior experience as a data engineer, software engineer, or data architect.
  • You are experienced in designing and production of solutions for complex problems.
  • You thrive in a fast-paced, start-up environment.
  • You seek to continuously improve processes and find the most optimal way to solve problems.
  • You can work remotely and independently, taking ownership of your work.
  • You have proven English language communication skills that enable you to collaborate in a remote-first company with a diverse international workforce.

Technical Requirements

  • Experience with Java11+ for ingesting, manipulating, and loading data.
  • Knowledge or light usage of Python.
  • Expert understanding of relational databases and a good understanding of NoSQL databases.
  • Prior work on real-time systems such as WebSockets, stock tickers, or videogames
  • Practical experience in AWS cloud services.
  • Expertise in using Unix / Linux at the command line to perform software development and maintenance.
  • Experience in real-time/streaming data ETL.
  • Proven experience in version control, CI/CD, unit test, integration test, functional test, and writing documentation.
  • Practical experience of modern software engineering techniques and best practices.
  • Knowledge of Big Data/streaming data frameworks, with practical experience in architectural design and data warehousing solutions.
  • Expertise in using SQL to query, standardise, extract, and load data.

Advantageous

  • Experience in DevOps.
  • Good understanding of data governance and security.
  • Experience with AWS technologies such as Fargate, API Gateway, or Lambda.
  • Experience in the trading/fintech industry.
  • Experience with web scraping.

What we offer

  • An opportunity to be part of a disruptive Scaleup that is challenging the status quo on commodity trading data and analytics.
  • Enjoyable, fast-paced, and challenging environment, working alongside a great and dedicated bunch of "A" player colleagues.
  • Remote working with occasional travel into a Madrid hub.
  • Attractive company stock option plan.
  • Training and education budget.

Sparta Commodities is proud to be an equal-opportunity employer and promotes diversity within its workforce. As an international business, we are determined that suitably qualified persons will never receive less favorable treatment on the grounds of gender, age, disability, religion, belief, sexual orientation, marital status, race, veteran status or any other basis covered by appropriate law

Here at the Open Data Science Conference we gather the attendees, presenters, and companies that are working on shaping the present and future of AI and data science. ODSC hosts one of the largest gatherings of professional data scientists with major conferences in the USA, Europe, and Asia.

#J-18808-Ljbffr
  • Data Engineer

    6 days ago


    London, Greater London, United Kingdom Data Idols Full time

    Data Engineer Are you a mid-level Data Engineer skilled in Azure technologies, seeking an new 'feel-good' permanent opportunity? Data Idols are proud to be supporting a HealthTech client, who use remote-first technology focusing on engagingpatients across their healthcare journey while saving hospitals time, effort, and money This opportunity provides remote...


  • London, Greater London, United Kingdom Data Idols Full time £85,000

    Job Description Senior Data Engineer Location: London (Hybrid) Data Idols are working with an exciting scale-up revolutionising delivery logistics and moving items across the UK with efficiency and ease all whilst cutting emissions. Trusted by millions of customers already they are expanding their data team to manage increased volumes of data and demand. As...


  • London, Greater London, United Kingdom Data Idols Full time

    Senior Data EngineerIncrease your chances of reaching the interview stage by reading the complete job description and applying promptly.Salary: up to £85,000Location: London (Hybrid)Data Idols are working with an exciting scale-up revolutionising delivery logistics and moving items across the UK with efficiency and ease all whilst cutting emissions. Trusted...

  • NS - Data Engineer

    6 days ago


    London, Greater London, United Kingdom Abs Data Full time

    Job title: NS – Data Engineer Company: BAE Systems Job description : Location(s): [[mfield3]] BAE Systems Digital Intelligence is home to 4,500 digital, cyber and intelligence experts. We work collaboratively across 10 countries to collect, connect and understand complex data, so that governments, nation states, armed forces and commercial businesses...


  • London, Greater London, United Kingdom ON Data Staffing Full time

    Our client, a Data & AI firm in London is actively seeking a Senior Data Engineer to play a pivotal role in delivering innovative big data solutions to their end clients. This client-facing role requires a unique blend of technical prowess in Databricks/Snowflake and exceptional communication skills to understand and address clients' diverse data...


  • London, Greater London, United Kingdom Data Science Festival Full time £85,000

    Senior Data Engineer Location: London (Hybrid) Data Idols are working with an exciting scale-up revolutionising delivery logistics and moving items across the UK with efficiency and ease all whilst cutting emissions. Trusted by millions of customers already they are expanding their data team to manage increased volumes of data and demand. As a Senior Data...


  • London, Greater London, United Kingdom Data Science Festival Full time £70,000 - £85,000

    Senior Data Engineer Location: London, 3/2 days in the office per week Data Idols are currently working with a company that focus on the european marketplace for transport who are looking to make the future greener Within this role as a Senior Data Engineer, you will be monitoring, designing and implementing a datawarehouse, whilst working with different...


  • London, Greater London, United Kingdom Data Science Festival Full time £85,000

    Senior Data Engineer Salary: up to £85,000 Location: London (Hybrid) Data Idols are working with an exciting scale-up revolutionising delivery logistics and moving items across the UK with efficiency and ease all whilst cutting emissions. Trusted by millions of customers already they are expanding their data team to manage increased volumes of data and...

  • Data Engineer

    6 days ago


    London, Greater London, United Kingdom DATA MART Consulting GmbH Full time

    Your Role: Apollo is establishing a set of truly innovative data services to propel the business to the next level. We are capturing, transforming, and analysing a vast variety of data through a modern data platform to produce fabulously rich insight for our business. You are the enthusiastic, skilful, and creative Data Engineer we need to make this...


  • London, Greater London, United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Data Engnieering professional to join our client, a growing consultancy, as a Data Engineering Manager.As Data Engineering Manager, you will play a pivotal role in driving the success of our client's Data Engineering practice through your expertise in presales, strong technical acumen, consulting skills, and effective...

  • Lead Data Engineer

    6 days ago


    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Lead Data Engineer - Residential Property CompanyLocation: London (flexible working available)Salary: CompetitiveWe are a leading residential property company looking to hire a Lead Data Engineer to join our growing data-focused team. You will be responsible for leading a team of data engineers and playing a key role in the development and maintenance of our...

  • Lead Data Engineer

    6 days ago


    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Lead Data Engineer Location: LondonSalary: £100,000 + BenefitsExciting Opportunity in LondonDo you want to work in the media sector for a top company? We are currently seeking a skilled Lead Data Engineer ready for a new challenge and eager to grow in their career.About the CompanyThis innovative media company is data-driven and is seeking a Lead Data...

  • Lead Data Engineer

    6 days ago


    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    LEAD DATA ENGINEERLONDON, CURRENTLY FLEXIBLE / REMOTE / HOMEWORKINGUP TO £100,000 + BENEFITSAs a Lead Data Engineer, you will be inheriting a Snowflake data platform for a successful Ecommerce company that has disrupted the market with their product line. You will be leading a junior squad so will remain hands-on to further develop the platform and team...

  • Aws Data Engineer

    6 days ago


    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    AWS Data Engineer£ a day, Inside IR35.Hybrid role, 2 days a week on-site. London office.6-Month Contract, potential to keep rollingFantastic opportunity to join an oil and gas company is an expanding team. You will join the business as an AWS Data Engineer playing a major role in a migration project that is ongoing, helping push it through to completion....

  • gcp data engineer

    6 days ago


    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    GCP DATA ENGINEER, 6-MONTH CONTRACT LONDON (FULLY REMOTE) £600-£700 PER DAY This position as a GCP Engineer allows you to work within a dynamic Telecoms company located in the heart of London. You will be developing a new GCP data environment and migrating data into the new environment. THE COMPANY This Telecoms company has been very well established...

  • Gcp Data Engineer

    6 days ago


    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    GCP Data Engineer£ a day, Inside IR35.Hybrid role, 2 days a week on-site. London office.6-Month Contract, potential to keep rollingFantastic opportunity to join an energy company is an expanding team. You will join the business as a GCP Data Engineer playing a major role in a migration project that is about to kick-off. This migration is from their legacy...

  • gcp data engineer

    6 days ago


    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    GCP DATA ENGINEER, 6-MONTH CONTRACT LONDON (FULLY REMOTE) £600-£700 PER DAY This position as a GCP Engineer allows you to work within a dynamic Telecoms company located in the heart of London. You will be developing a new GCP data environment and migrating data into the new environment. THE COMPANY This Telecoms company has been very well established...


  • London, Greater London, United Kingdom Open Data Science Conferenc Full time

    You have prior experience as a data engineer, software engineer, or data architect. You can work remotely and independently, taking ownership of your work. You have proven English language communication skills that enable you to collaborate in a remote-first company with a diverse international workforce. Experience with Java11+ for ingesting,...

  • Data Developer

    6 days ago


    London, Greater London, United Kingdom Data Intellect Full time

    Welcome to Data Intellect . Providing technical leadership on client projects Leading technical teams to deliver projects on time and on budget Developing, testing, supporting and maintaining all code for client applications Analysing data and creating reports for clients, incorporating all findings Mentorship, training and potentially management of...


  • London, Greater London, United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer.As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...