Data Engineer

2 weeks ago

United Kingdom Terminal Industries Full time

About Us:

Terminal builds software that digitizes, indexes, and automates the yard, leveraging best-in-class machine learning. Our platform will provide warehouse operators with the intelligence needed to optimize their usage of trucks, trailers, chassis, containers and personnel. These are the fundamental operating assets of commerce - and represent the last great frontier of untapped data. In the process, Terminal will address many industry-wide pain points, including compliance, manual processes, equipment location, phantom costs, and labor inefficiencies. Ultimately, Terminal will become the central nervous system for the yard, seamlessly connecting all data sources to support an extensive range of essential functions.

Overview:

We are looking for a data engineer to join our team. The role will work closely with senior data scientists and engineers in the company in building systems that collect, manage and convert large amounts of raw information into usable information. The ideal candidate should have prior experience as a data engineer or similar role, and possess strong technical skills and passion for data-driven solutions.

Responsibilities:

  • Implement, maintain, and monitor organisation data storage solutions

  • Collect and collate large amounts of data from multiple sources

  • Construct and maintain efficient data pipeline to facilitate data flow, processing and integration across various system

  • Design, develop, and maintain robust data pipelines for ingesting, processing, and storing large-scale image, videos and metadata.

  • Ensure data quality and accurate data metrics are delivered which results in timely business analytics

  • Effectively work with data scientists and contribute to data-driven projects

  • Support the creation and maintenance of a Terminal R&D “Data Function” department

Requirements:

  • Bachelor’s degree in Computer Science, Statistics, or related field

  • 3+ years of experience in data engineer or similar role

  • Strong proficiency in python programming language

  • Proficiency in managing database management system and familiar with both data-lakes and data-warehousing solutions

  • Experience with ETL tools and processes

  • Experience with big data technologies such as Hadoop, Spark or Kafka

  • Experience with machine learning and deep learning for computer vision is a plus

  • Experience with cloud platforms such as Amazon Web Services (AWS)

  • Experience with database design, schema optimization, query optimization, and database administration tasks

  • Experience in logistics industry is a plus

What We Offer:

Joining the Terminal team means being part of a dynamic, innovative environment where your work directly impacts the future of logistics and the global supply chain. You will work closely with a team of experts passionate about operational excellence and technological innovation. We offer competitive salaries, a comprehensive benefits package, and opportunities for professional growth.

#J-18808-Ljbffr

  • Senior Engineer, Data Engineering

    4 weeks ago

    United Kingdom Data Science Talent Full time

    Data Engineering in Animal Health 80% remote £60-70k basic salary plus 10% bonus If you’re as much of an animal lover as you are a data engineer, you won’t find a better opportunity to use your skills for good. In this newly created role you’ll be setting up the data infrastructure that will help this thriving veterinary care company to...

  • Lead Data Engineer-Data Management

    1 month ago

    United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer. As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...

  • Lead Data Engineer-Data Management

    1 month ago

    United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer. As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...

  • Data Integration Engineer

    1 month ago

    United Kingdom Abs Data Full time

    Big Data Integration Engineer Saint-Gobain Position description Are you someone who is passionate about data and transformation? At Saint-Gobain Digital, we are looking for a Big Data Integration Engineer to work remotely to create customer and business value as part of a digital transformation. This Data Engineer will be a part of our enthusiastic...

  • Senior Data Engineer

    4 weeks ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients.This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Data Engineer

    1 month ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients. This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Data Engineer

    1 month ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients.This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Data Engineer

    3 weeks ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients. This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Data Engineer

    4 weeks ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients.This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Data Engineer

    1 month ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients. This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Data Engineer

    1 month ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients. This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Data Engineer

    4 weeks ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients. This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Process Engineering

    1 month ago

    United Kingdom The Chemical Engineer Full time

    Our client develops, engineers, fabricates, supplies, and installs discreet process equipment items and complete process systems for applications within chemical /process engineering. The company’s reputation is well established and founded on its commitment to product innovation, customer service and engineering excellence. On the job training would be...

  • Lead Data Engineer

    4 weeks ago

    United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer.As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...

  • Lead Data Engineer

    1 month ago

    United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer.As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...

  • Lead Data Engineer

    3 weeks ago

    United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer. As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...

  • Lead Data Engineer

    4 weeks ago

    United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer.As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...

  • Lead Data Engineer

    1 month ago

    United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer. As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...

  • Lead Data Engineer

    1 month ago

    United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer. As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...

  • Proposals Process Engineer

    1 month ago

    United Kingdom The Chemical Engineer Full time

    West of London /M4 Process Systems £27-£42K PA Our client develops, engineers, fabricates, supplies, and installs discreet process equipment items and complete process systems for applications within chemical /process engineering. The company’s reputation is well established and founded on its commitment to product innovation, customer service and...