Current jobs related to Data Engineer - Solihull - eTeam

  • Data Engineer

    1 month ago

    Solihull, Solihull, United Kingdom twentyAI Full time

    Exciting Opportunity for a Data Engineer at twentyAItwentyAI is partnering with a private equity backed hospitality business to seek a skilled Data Engineer to join their growing Analytics function. As a key member of the team, you will work closely with Data Scientists and the Commercial department to understand their goals and develop a data strategy that...

  • Data Engineer

    1 month ago

    Solihull, Solihull, United Kingdom twentyAI Full time

    Exciting Opportunity for a Data Engineer at twentyAItwentyAI is partnering with a private equity backed hospitality business to seek a skilled Data Engineer to join their growing Analytics function. As a key member of the team, you will work closely with Data Scientists and the Commercial department to understand their goals and develop a data strategy that...

  • Data Engineer

    4 weeks ago

    Solihull, Solihull, United Kingdom twentyAI Full time

    Exciting Opportunity for a Data Engineer at twentyAItwentyAI is partnering with a private equity backed hospitality business to seek a skilled Data Engineer to join their growing Analytics function. As a key member of the team, you will work closely with Data Scientists and the Commercial department to understand their goals and develop a data strategy that...

  • Data Engineer

    4 weeks ago

    Solihull, Solihull, United Kingdom twentyAI Full time

    Exciting Opportunity for a Data Engineer at twentyAItwentyAI is partnering with a private equity backed hospitality business to seek a skilled Data Engineer to join their growing Analytics function. As a key member of the team, you will work closely with Data Scientists and the Commercial department to understand their goals and develop a data strategy that...

  • Data Engineer

    2 weeks ago

    Solihull, Solihull, United Kingdom twentyAI Full time

    Unlock Business Potential with Data-Driven InsightstwentyAI is partnering with a private equity-backed hospitality business to find a skilled Data Engineer who can drive business growth through data-driven strategies. As a key member of the Analytics function, you will collaborate with Data Scientists and the Commercial department to understand business...

  • Data Engineer

    4 months ago

    Solihull, West Midlands, United Kingdom twentyAI Full time

    twentyAI are excited to be partnering with a private equity backed hospitality business who are seeking a Data Engineer to join their growing Analytics function. You will work closely with Data Scientists and the Commercial department to understand their goals and how to execute this in a data strategy. You will be able to generate valuable insights and...

  • Data Engineer

    4 months ago

    Solihull, United Kingdom twentyAI Full time

    twentyAI are excited to be partnering with a private equity backed hospitality business who are seeking a Data Engineer to join their growing Analytics function. You will work closely with Data Scientists and the Commercial department to understand their goals and how to execute this in a data strategy. You will be able to generate valuable insights and...

  • Data Engineer

    2 weeks ago

    Solihull, Solihull, United Kingdom twentyAI Full time

    twentyAI is partnering with a private equity backed hospitality business to seek a Data Engineer for their Analytics function. This role involves working closely with Data Scientists and the Commercial department to understand their goals and execute a data strategy. The successful candidate will generate valuable insights and actions to gain a competitive...

  • Data Engineer

    2 months ago

    Solihull, Solihull, United Kingdom twentyAI Full time

    **About twentyAI and the Role**twentyAI is partnering with a private equity-backed hospitality business to fill a Data Engineer position in their growing Analytics function. As a Data Engineer, you will collaborate closely with Data Scientists and the Commercial department to understand their goals and develop a data-driven strategy.**Key...

  • Data Engineer

    2 weeks ago

    Solihull, Solihull, United Kingdom twentyAI Full time

    twentyAI is partnering with a private equity backed hospitality business to find a Data Engineer who can drive analytics and data strategy. This role involves working closely with Data Scientists and the Commercial department to understand business goals and execute data-driven initiatives. The ideal candidate will generate valuable insights and actions to...

  • Data Engineer

    2 months ago

    Solihull, Solihull, United Kingdom twentyAI Full time

    **About twentyAI and the Role**twentyAI is partnering with a private equity-backed hospitality business to fill a Data Engineer position in their growing Analytics function. As a Data Engineer, you will collaborate closely with Data Scientists and the Commercial department to understand their goals and develop a data-driven strategy.**Key...

  • Data / Fibre Installer

    5 months ago

    Solihull, United Kingdom Apex Recruitment Services Full time

    **Contract (Inside IR35)** **Solihull / Midlands** **£25.00 - £29.00 per hour** **Shifts - Weekdays and Weekends** We are looking for a Data/Fibre Installation Engineer to join a world-leading automotive company based in Solihull on a contract basis. The **Data/Fibre Installer **will be responsible for Data/Fibre installations and modifications on site...

  • Data Extraction Specialist

    2 months ago

    Solihull, Solihull, United Kingdom smartworkingio Full time

    Job DescriptionWe are seeking a highly skilled Web Scraping Engineer to join our team at SmartWorkingIO. As a key member of our data collection team, you will be responsible for designing and implementing web scraping solutions to extract valuable data from various websites.Key Responsibilities:Data Extraction: Develop and maintain web scraping scripts to...

  • Data Extraction Specialist

    2 months ago

    Solihull, Solihull, United Kingdom smartworkingio Full time

    Job DescriptionWe are seeking a highly skilled Web Scraping Engineer to join our team at SmartWorkingIO. As a key member of our data collection team, you will be responsible for designing and implementing web scraping solutions to extract valuable data from various websites.Key Responsibilities:Data Extraction: Develop and maintain web scraping scripts to...

  • Data Specialist

    5 months ago

    Solihull, United Kingdom Jonathan Lee Recruitment Ltd Full time

    **Sector**: Automotive **Function**: IT **Contact**: Ellie Ebbage **Phone**:01384 446118** **Duration**: Contract **Job Ref**:67063 - Job details**Data Specialist - 39440** **3 month initial contract** **Location: Solihull** **Rate : £22.46/hr Umbrella (inside IR35)** We are seeking a highly skilled Data Analyst to join our team on a short term...

  • Data Integrity Specialist

    1 month ago

    Solihull, Solihull, United Kingdom Jaguar Land Rover Full time

    Job Title: Data Integrity SpecialistJoin Jaguar Land Rover as a Data Integrity Specialist and play a critical role in ensuring the accuracy and alignment of inventory across Solihull. As a key member of the MP&L team, you will be responsible for managing the reconciliation processes, overseeing a team of counters, and maintaining data accuracy.Key...

  • Data Analyst

    2 weeks ago

    Solihull, United Kingdom CV-Library Full time

    Data Analyst Business Based in Solihull – Hybrid £40,000-£45,000 T2M are recruiting on behalf of a leading retail and ecommerce business for a Data Analyst. This is a great opportunity for a Data Analyst to join a fast-growing group of companies who are keen to develop the commercial and business insights function to provide high...

  • Data Integrity Specialist

    1 month ago

    Solihull, Solihull, United Kingdom Jaguar Land Rover Full time

    Job Title: Data Integrity SpecialistJoin Jaguar Land Rover's team of experts in Solihull and play a critical role in ensuring the accuracy and alignment of inventory across the manufacturing facility. As a Data Integrity Specialist, you will be responsible for managing the reconciliation processes and overseeing a team of counters to maintain data...

  • Data Integrity Specialist

    1 month ago

    Solihull, Solihull, United Kingdom Jaguar Land Rover Full time

    Job Title: Data Integrity SpecialistJoin Jaguar Land Rover's team of experts in Solihull and play a critical role in ensuring the accuracy and alignment of inventory across the manufacturing facility. As a Data Integrity Specialist, you will be responsible for managing the reconciliation processes and overseeing a team of counters to maintain data...

  • Data Integrity Specialist

    1 month ago

    Solihull, Solihull, United Kingdom Jaguar Land Rover Full time

    Job Title: Data Integrity SpecialistJoin Jaguar Land Rover's team of experts in Solihull and play a critical role in ensuring the accuracy and alignment of inventory across the manufacturing facility. As a Data Integrity Specialist, you will be responsible for managing the reconciliation processes and overseeing a team of counters to maintain data...

Data Engineer

2 months ago

Solihull, United Kingdom eTeam Full time

Data Engineer

Solihull - Needs to be on site 2 days a week

Rate - 500 - 520/Day (inside IR35) (via Umbrella)


Key skills (most important) Spark, Airflow , Hadoop, Oozie, Docker, Kubernetes containerization, COS, Scala, SQL, Dremio, Git, GitLab, Jenkins, Bash


About the Role:

As a Data Engineer at BNP Paribas, you will be instrumental in designing, building, and optimizing the data processing pipelines in a centralized data platform "DATAHUB." This platform consolidates, federates, and enhances massive data assets for various use cases, including reporting, analytics, and machine learning. You will work with multiple data sources, ensuring the seamless integration, transformation, and quality of data, while also migrating Hadoop infrastructure to cloud environments.


Key Responsibilities:


- Data Integration: Integrate data from multiple sources and formats into the Raw Layer of the DATAHUB.

- Data Modeling and Pipeline Development: Model data and develop efficient data pipelines to enrich and transform large volumes of data with complex business rules, automating data pipelines and streamline data ingestion. Designing and implementing scalable and secure data processing pipelines using Scala, Spark, cloud Object storage, Hadoop, Cloud object storage

- Data Transformation and Quality: Implement data transformation and quality control processes to ensure data consistency and accuracy. Utilize programming languages such as Scala and SQL and tools like Spark for data transformation and enrichment operations.

- Scheduling with Airflow: Schedule data processing tasks using Airflow.

- Validation Testing: Write and conduct unit and validation tests to ensure accuracy and integrity of code developed.

- CI/CD Pipeline Implementation: Set up CI/CD pipelines to automate deployment, unit testing, and development management.

- Documentation: Write technical documentation (specifications, operational documents) to ensure knowledge capitalization.

- Code Improvement: understand existing code, modify the existing code as per business requirements and Continuously improve for better performance and maintainability and prepare relevant documentation.

- Infrastructure Migration: Migrate the existing Hadoop infrastructure to cloud infrastructure on Kubernetes Engine, Object Storage, Spark as a service, and Airflow as a service

- Performance Optimization and Security: Ensure the performance and security of the data infrastructure and follow the best practices of Data engineering.

- Production Support and Maintenance: Contribute to production support, incident and anomaly correction, trouble shoot data related issues, and implement functional and technical evolutions to ensure the stability of production processes.

- Team Collaboration: Work closely with data squads and business teams to understand data needs and provide tailored solutions.

- Agile Experience – understand of agile principle and rituals

- Software Development Lifecycle (SDLC) awareness