Big Data Specialist

7 days ago

London, Greater London, United Kingdom twentyAI Full time

**About twentyAI**

twentyAI is a leading technology partner to a major player in the energy industry, specializing in refining, trading, and distributing crude oil and petroleum products. Our client is a key player in enhancing energy security for the UK and Europe.

**The Opportunity**

We are seeking a highly skilled Data Engineer to join our team and assist with business-as-usual (BAU) tasks and communicate data insights to front office teams. Our client has initiated a multi-year Digitalisation Program to transform how data is managed and utilized within the business. The vision is to deliver the next generation of big data infrastructure supported by cloud technologies.

**Key Responsibilities**

• Develop, construct, test, and maintain data pipelines to support business operations

• Assist users of the big data platform in navigating the platform, ingesting new data, and troubleshooting issues

• Solve complex data integration problems using optimal ETL and ELT patterns, frameworks, query techniques, and sourcing from structured and unstructured data sources

• Cleanse, preprocess, and deliver data for prescriptive and predictive modeling

• Perform data quality testing and monitoring

• Collaborate with data scientists to build scalable AI and ML models

• Develop data visualization and business intelligence dashboards

• Optimize pipelines, dashboards, frameworks, and systems to facilitate easier development of data artifacts

• Take ownership of assigned projects, including understanding and gathering requirements, designing solutions, building, and maintaining completed industrialized solutions

**Requirements**

• Experience in the oil/gas and commodities industries

• Proven experience in writing data pipelines (ETL and ELT)

• Strong hands-on experience with Python and Python-related data tools such as Pandas

• Good hands-on experience with PySpark or similarly distributed data processing tools

• Strong hands-on experience with SQL (TSQL, ANSI SQL, Spark SQL, etc.)

• Experience with structured, semi-structured, and unstructured data

• Strong understanding of data and ability to dive into datasets, understand the structure, and explain data concepts to stakeholders

• Experience in developing and supporting analytical models/tools

  • Big Data Specialist

    7 days ago

    London, Greater London, United Kingdom Saragossa Full time £150,000

    About the RoleWe are seeking a highly skilled Pensions Developer to join our team at Saragossa, a global Multistrat Hedge Fund. As a key member of our Risk Engineering Team, you will play a critical role in designing, developing, and implementing Big Data and real-time applications.Key ResponsibilitiesDesign and develop risk platforms to support our business...

  • Big Data Specialist

    6 days ago

    London, Greater London, United Kingdom Capgemini Full time

    About the RoleAs a Databricks Data Engineer with an Azure focus, you will be an integral part of our team dedicated to building scalable and secure data platforms. You will leverage your expertise in Databricks, Apache Spark, and Azure to design, develop, and implement data warehouses, data lakehouses, and AI/ML models that fuel our data-driven...

  • Big Data Specialist

    7 days ago

    London, Greater London, United Kingdom Capgemini Full time

    About the RoleAs a Databricks Data Engineer with an Azure focus, you will be an integral part of our team dedicated to building scalable and secure data platforms. You will leverage your expertise in Databricks, Apache Spark, and Azure to design, develop, and implement data warehouses, data lakehouses, and AI/ML models that fuel our data-driven...

  • Big Data Engineer

    6 hours ago

    London, Greater London, United Kingdom Information Tech Consultants Full time

    Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and implementing large-scale data processing systems.Key Responsibilities:Design and develop scalable data processing systems using Hadoop, Spark, and NoSQL databases.Develop and implement data...

  • Big Data Engineer

    4 hours ago

    London, Greater London, United Kingdom Information Tech Consultants Full time

    Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and implementing large-scale data processing systems.Key Responsibilities:Design and develop scalable data processing systems using Hadoop, Spark, and NoSQL databases.Develop and implement data...

  • Big Data Analyst

    1 month ago

    London, Greater London, United Kingdom Nexus Jobs Limited Full time

    Job Description Big Data Scientist - Docklands LondonOur Client an international organisation is looking to recruit a Big Data Expert with 2 to 5 years expertise as a Big Data Scientist.You will have Natural Language Processing (NLP) knowledge and experience and understand and analyse large data sets to discover new insights.Working in a multi-disciplinary...

  • Big Data Architect

    7 days ago

    London, Greater London, United Kingdom InterEx Group Full time

    Job DescriptionFor this role, you will be responsible for providing the framework that appropriately replicates the Big Data needs of a company utilizing data.Key Responsibilities:Design and implement Big Data and Data Analytics solutions that meet customer requirements.Develop high-quality, engaging customer presentations and communicate effectively at the...

  • Big Data Architect

    7 days ago

    London, Greater London, United Kingdom Hunter Bond Full time

    About the RoleWe are seeking a highly skilled and experienced Big Data Architect to join our team at Hunter Bond. As a key member of our organization, you will be responsible for providing technical leadership in architecting and designing end-to-end solutions for our data lake initiatives.Key ResponsibilitiesProvide technical leadership in architecting and...

  • Big Data Analyst

    7 days ago

    London, Greater London, United Kingdom InPost UK Full time

    About InPost UKInPost UK is a leading out-of-home business that is revolutionizing the delivery universe. We are a fast-paced and global company that is committed to providing innovative solutions for e-commerce delivery.Job SummaryWe are seeking a highly skilled Data Insights Specialist to join our team. As a Data Insights Specialist, you will be...

  • Big Data Architect

    5 days ago

    London, Greater London, United Kingdom Hunter Bond Full time

    Job Title: Big Data LeadCompany: Hunter BondJob Type: Full-timeLocation: Remote (London office)About the Role:We are seeking a highly skilled Big Data Architect to lead our data engineering team in designing and implementing end-to-end solutions for our datalake initiatives. As a key member of our team, you will be responsible for providing technical...

  • Big Data Architect

    5 days ago

    London, Greater London, United Kingdom Hunter Bond Full time

    Job Title: Big Data LeadCompany: Hunter BondJob Type: Full-timeLocation: Remote (London office)About the Role:We are seeking a highly skilled Big Data Architect to lead our data engineering team in designing and implementing end-to-end solutions for our datalake initiatives. As a key member of our team, you will be responsible for providing technical...

  • Big Data Architect

    4 days ago

    London, Greater London, United Kingdom Hunter Bond Full time

    About Hunter BondHunter Bond is a leading provider of innovative data solutions, and we're seeking a talented Big Data Architect to join our team in London. As a key member of our engineering team, you'll play a crucial role in designing and implementing end-to-end data solutions that drive business growth and improvement.Job SummaryWe're looking for a...

  • Big Data Architect

    4 days ago

    London, Greater London, United Kingdom Hunter Bond Full time

    About Hunter BondHunter Bond is a leading provider of innovative data solutions, and we're seeking a talented Big Data Architect to join our team in London. As a key member of our engineering team, you'll play a crucial role in designing and implementing end-to-end data solutions that drive business growth and improvement.Job SummaryWe're looking for a...

  • Big Data Solutions Architect

    1 week ago

    London, Greater London, United Kingdom Amazon Full time

    Job Title: Big Data Solutions ArchitectAbout the Role:We are seeking a highly skilled Big Data Solutions Architect to join our team at Amazon. As a key member of our team, you will be responsible for designing and implementing scalable, secure, and highly available big data solutions for our customers.Key Responsibilities:Collaborate with cross-functional...

  • Big Data Solutions Architect

    6 days ago

    London, Greater London, United Kingdom Amazon Full time

    Job Title: Big Data Solutions ArchitectAbout the Role:We are seeking a highly skilled Big Data Solutions Architect to join our team at Amazon. As a key member of our team, you will be responsible for designing and implementing scalable, secure, and highly available big data solutions for our customers.Key Responsibilities:Collaborate with cross-functional...

  • Senior Cloud Data Architect

    7 days ago

    London, Greater London, United Kingdom Pioneer Search Full time

    Pioneer Search is seeking a highly skilled GCP Data Architect to join our team as a Technical Lead. As a key member of our engineering and architecture function, you will play a crucial role in designing and implementing a robust GCP Data Architecture for our big data environment.About the Role:Work within a GCP environment to deliver technical solutions and...

  • Big Data Architect

    4 days ago

    London, Greater London, United Kingdom Hunter Bond Full time

    Job Title: Big Data LeadAbout the Role:Hunter Bond is seeking a highly skilled Big Data Lead to join our team in London. As a key member of our organization, you will be responsible for providing technical leadership in architecting and designing end-to-end solutions for our datalake initiatives.Key Responsibilities:Provide technical leadership in...

  • Big Data Architect

    5 days ago

    London, Greater London, United Kingdom Hunter Bond Full time

    Job Title: Big Data LeadAbout the Role:Hunter Bond is seeking a highly skilled Big Data Lead to join our team in London. As a key member of our organization, you will be responsible for providing technical leadership in architecting and designing end-to-end solutions for our datalake initiatives.Key Responsibilities:Provide technical leadership in...

  • Big Data Developer

    6 days ago

    London, Greater London, United Kingdom Hunter Bond Full time

    Job Title: Big Data DeveloperAbout Us: Hunter Bond is a leading organization in the industry, and we're looking for a talented Big Data Developer to join our team.Job Summary: We're seeking a skilled Big Data Developer to provide technical expertise in designing and developing end-to-end solutions for our datalake initiatives. As a Big Data Developer, you'll...

  • Big Data Developer

    5 days ago

    London, Greater London, United Kingdom Hunter Bond Full time

    Job Title: Big Data DeveloperAbout Us: Hunter Bond is a leading organization in the industry, and we're looking for a talented Big Data Developer to join our team.Job Summary: We're seeking a skilled Big Data Developer to provide technical expertise in designing and developing end-to-end solutions for our datalake initiatives. As a Big Data Developer, you'll...