Data Engineer

3 weeks ago

Coventry, United Kingdom The Virtual Forge Full time
Job Description

About us:


The Virtual Forge is an international company with offices in the UK, Portugal, UAE, Canada and the US. We are experts in designing and developing data driven software solutions for the cloud and we are currently looking for a talented Data Engineer to join our team and work with one of our clients. 


You will be based in our clients offices in Coventry and in Warwick 2 days per week, with the remaining days being from your own home. 


Role Overview:

We are looking for an experienced Data Engineer to join our growing team and help us create dynamic data pipelines and data warehouse solutions for our client. In this role, you will be responsible for writing and testing scalable code, developing back-end components, and integrating user-facing elements in collaboration with front-end developers.


To be successful, you should have in-depth knowledge of object-relational mapping, experience with server-side logic, above-average knowledge of Python programming and the ability to translate business requirements into technical requirements. 


Duties and Responsibilities:


  • Coordinating with business stakeholders to determine business requirements and translate these into technical requirements.
  • Assessing and prioritising business requirements against backlog.
  • Maintaining and enhancing data pipelines to support business reporting processes
  • Formulating test cases and test plan to validate all data pipeline changes
  • Investigating potential data quality issues in the data pipeline to identify true root cause along with an action plan for immediate resolution and also for a permanent fix.
  • Providing ad-hoc data to support business queries, including the creation of basic visualisation of data through Excel or Tableau to aid the process.
  • Maintaining and continually enhancing data quality and data governance of data pipelines
  • Maintaining documentation of the data pipeline process to ensure business continuity
  • Maintaining documentation of the data stored in BigQuery to support business


Essential Skills:

  • + 4 years of work experience in similar roles
  • Advanced Python
  • Data processing using Pandas
  • Python client for Google BigQuery
  • Advanced SQL (GoogleSQL, MySQL)
  • Google Cloud Services
  • Advanced BigQuery
  • Advanced Google Cloud Storage
  • Google Dataform
  • Google Cloud Function
  • Advanced Apache Airflow
  • Basic Tableau: ability to create basic visualisations
  • Ability to integrate multiple data sources and databases into one system
  • Able to create database schemas that represent and support business processes
  • Effective verbal and written communication skills
  • Strong Excel skills (complex formulas, pivot tables)


What do you need to do: 

  • Send us your CV to workwithus@thevirtualforge.com
  • Gross Salary expectation and availability 
  • You need to be authorised to work in the United Kingdom


Do you have concerns about facing discrimination based on factors such as age, gender, race, religion, disability, sexual orientation, or gender identity? Rest assured, at The Virtual Forge, we are committed to being an inclusive employer that values diversity in our workforce


At The Virtual Forge, we have a dedicated recruitment team that works globally to fill all our recruitment needs. Therefore we don't need a response from recruitment companies. Thanks for understanding

  • Lead Engine Problem Solving Engineer

    4 weeks ago

    Coventry, United Kingdom The Engineer Full time

    JOB TITLE: Lead Engine Problem Solving Engineer POSTING START DATE: 29/04/2024 POSTING END DATE: 13/05/2024 LOCATION: Whitley, Coventry, UK JLR is harnessing technology to make driving smarter, safer and cleaner. You can help create a world in which responsible, sustainable vehicles revolutionise the driving experience for generations. Our vision is to...

  • Calibration Engineer

    2 months ago

    Coventry, United Kingdom The Engineer Full time

    REQ ID: 120509 JOB TITLE: Calibration Engineer SALARY: Competitive POSTING END DATE: 22nd January 2024 LOCATION: Coventry JLR is harnessing technology to make driving smarter, safer and cleaner. You can help create a world in which responsible, sustainable vehicles revolutionise the driving experience for generations. Our vision is to leverage the...

  • From Data Engineer to Head of Data Engineering

    1 week ago

    Coventry, United Kingdom WEG Tech Full time €65,000 - €75,000

    Head of Data Engineering & Data Governance £34 Days Holidays + Bank Holidays Fantastic Pension & Other Great Public Sector Benefits Career Progression Hybrid Working (Mainly working from home) Excellent Sport & Leisure Facilities On-Site Training and Personnel Development Offerings Office Location is close to A45, A46, M1, M6, M40, M42, M69 We...

  • From Data Engineer to Head of Data Engineering

    2 months ago

    Coventry, United Kingdom WEG Tech Full time

    Head of Data Engineering & Data Governance £34 Days Holidays + Bank Holidays Fantastic Pension & Other Great Public Sector Benefits Career Progression Hybrid Working (Mainly working from home) Excellent Sport & Leisure Facilities On-Site Training and Personnel Development Offerings Office Location is close to A45, A46, M1, M6, M40, M42, M69 We...

  • Data Engineer

    2 weeks ago

    Coventry, Coventry, United Kingdom WEG Technology Recruitment Full time

    We have a great opportunity for an experienced Data Engineer to join an established team within one of the UK's leading universities.As one of the Data Engineers within the team, you will be responsible for leveraging Azure Data Factory and DBT to design, develop, and maintain robust data pipelines and scalable data models which integrate data from a wide...

  • Data Engineer

    2 weeks ago

    Coventry, United Kingdom WEG Technology Recruitment Full time

    We have a great opportunity for an experienced Data Engineer to join an established team within one of the UK’s leading universities. As one of the Data Engineers within the team, you will be responsible for leveraging Azure Data Factory and DBT to design, develop, and maintain robust data pipelines and scalable data models which integrate data from a wide...

  • Senior Engineer, Data Engineering

    2 weeks ago

    Coventry, United Kingdom Tata Consultancy Services Full time

    Are you a Data Engineer with a passion for engineering various data tools ? TCS is a purpose-led transformation company, built on belief. We don’t just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK...

  • Senior Engineer, Data Engineering

    1 week ago

    Coventry, United Kingdom Tata Consultancy Services Full time

    Are you a Data Engineer with a passion for engineering various data tools ? TCS is a purpose-led transformation company, built on belief. We don’t just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK...

  • Senior Engineer, Data Engineering

    2 weeks ago

    Coventry, United Kingdom Tata Consultancy Services Full time

    Job Description Are you a Data Engineer with a passion for engineering various data tools ? TCS is a purpose-led transformation company, built on belief. We don’t just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest...

  • Data Engineer

    3 weeks ago

    Coventry, United Kingdom The Virtual Forge Full time

    About us:The Virtual Forge is an international company with offices in the UK, Portugal, UAE, Canada and the US. We are experts in designing and developing data driven software solutions for the cloud and we are currently looking for a talented Data Engineer to join our team and work with one of our clients. You will be based in our clients offices in...

  • Data Engineer

    3 weeks ago

    Coventry, United Kingdom The Virtual Forge Full time

    About us: The Virtual Forge is an international company with offices in the UK, Portugal, UAE, Canada and the US. We are experts in designing and developing data driven software solutions for the cloud and we are currently looking for a talented Data Engineer to join our team and work with one of our clients.  You will be based in our clients offices in...

  • Data Engineer

    3 weeks ago

    Coventry, United Kingdom The Virtual Forge Full time

    About us:The Virtual Forge is an international company with offices in the UK, Portugal, UAE, Canada and the US. We are experts in designing and developing data driven software solutions for the cloud and we are currently looking for a talented Data Engineer to join our team and work with one of our clients. You will be based in our clients offices in...

  • Data Engineer

    3 weeks ago

    Coventry, United Kingdom The Virtual Forge Full time

    About us:The Virtual Forge is an international company with offices in the UK, Portugal, UAE, Canada and the US. We are experts in designing and developing data driven software solutions for the cloud and we are currently looking for a talented Data Engineer to join our team and work with one of our clients. You will be based in our clients offices in...

  • Data Engineer

    3 weeks ago

    Coventry, United Kingdom The Virtual Forge Full time

    About us: The Virtual Forge is an international company with offices in the UK, Portugal, UAE, Canada and the US. We are experts in designing and developing data driven software solutions for the cloud and we are currently looking for a talented Data Engineer to join our team and work with one of our clients.  You will be based in our clients offices in...

  • Data Engineer

    3 weeks ago

    Coventry, United Kingdom The Virtual Forge Full time

    About us: The Virtual Forge is an international company with offices in the UK, Portugal, UAE, Canada and the US. We are experts in designing and developing data driven software solutions for the cloud and we are currently looking for a talented Data Engineer to join our team and work with one of our clients.  You will be based in our clients offices in...

  • Data Engineer

    2 weeks ago

    Coventry, United Kingdom The Virtual Forge Full time

    About us:If your skills, experience, and qualifications match those in this job overview, do not delay your application.The Virtual Forge is an international company with offices in the UK, Portugal, UAE, Canada and the US. We are experts in designing and developing data driven software solutions for the cloud and we are currently looking for a talented Data...

  • Data Engineer

    2 weeks ago

    Coventry, United Kingdom The Virtual Forge Full time

    Job Description About us: The Virtual Forge is an international company with offices in the UK, Portugal, UAE, Canada and the US. We are experts in designing and developing data driven software solutions for the cloud and we are currently looking for a talented Data Engineer to join our team and work with one of our clients.  You will be based in our...

  • Data Engineer

    3 weeks ago

    Coventry, United Kingdom The Virtual Forge Full time

    About us:If your skills, experience, and qualifications match those in this job overview, do not delay your application.The Virtual Forge is an international company with offices in the UK, Portugal, UAE, Canada and the US. We are experts in designing and developing data driven software solutions for the cloud and we are currently looking for a talented Data...

  • Senior Engineer, Data Engineering

    3 weeks ago

    Coventry, United Kingdom Lear Corporation Full time

    We foster collaboration, inclusion, respect and excellence. Our teams have invented groundbreaking technologies, flawlessly manufactured millions of products and earned a long list of awards. Passionate about their craft. Lear, a global automotive technology leader in Seating and E-Systems, enables superior in-vehicle experiences for consumers around the...

  • Senior Data Engineer

    3 weeks ago

    Coventry, United Kingdom NHS Counter Fraud Authority Full time

    Job summary The Senior Data Engineer will have direct oversight and responsibility for the development, implementation, review, and establishment of data and techniques used in the Advanced Data Analytics Portfolio (DAP). As a Senior Data Engineer, you will work with project managers, data scientists, counter fraud experts, stakeholders, and senior...