Data Engineer

2 weeks ago

Coventry, United Kingdom WEG Technology Recruitment Full time

We have a great opportunity for an experienced Data Engineer to join an established team within one of the UK’s leading universities.

As one of the Data Engineers within the team, you will be responsible for leveraging Azure Data Factory and DBT to design, develop, and maintain robust data pipelines and scalable data models which integrate data from a wide variety of structured and unstructured data sources across the university, ensuring appropriate security and utility of data.

The role will design analytical environments such as data marts, using a user centred design approach to meet a variety of reporting or analytical needs.

The role will also mentor users of various skill levels to engage with and succeed with their own use of the data products you help deliver. Directly contributing to enhancing data accessibility, quality, and analytics capabilities within the university. 

Duties:

  • Technical work to model data and Design and Develop Data Pipelines
  • Undertake and manage the development of data models
  • Contribute to the design of data products and organise the backlog of work in planning tools like Jira
  • Utilise Azure Data Factory to design and develop scalable and efficient data pipelines
  • Utilise DBT (Data Build Tool) to create and manage data transformation processes, ensuring consistent and reliable data output
  • Design, implement and maintain DataVault and Kimball-style data models to ensure efficient storage, retrieval, and analysis of data by different user communities across the university.
  • Monitor and optimise the performance of data pipelines and data warehouses, identifying and resolving bottlenecks and inefficiencies.
  • Design and implement data security measures
  • Design and implement data quality checks and validation processes within the pipelines using expectations with the pipeline, or dedicated testing tools (SODA)
  • Collaborate with data governance, architects, system/product owners and end users to ensure quality issues are addressed as needed.
  • Create and maintain technical documentation, including data pipeline specifications, data models, and transformation logic
  • Contribute to data modelling and schema design standards and related documentation.

Qualifications & Requirements

  • Degree in Computer Science, Data Engineering, or a related field or equivalent experience
  • Strong experience working as a Data Engineer, preferably in a cloud-based environment.
  • Experience with cloud-based data storage platforms, preferably Snowflake, Azure SQL Data Warehouse or AWS Redshift.
  • Solid practical experience and understanding of DataVault and Kimball-style data warehousing methodologies.
  • Proficient in SQL and data querying languages for data manipulation and analysis. Proficiency in Azure Data Factory and DBT, with a demonstrated ability to build scalable and reliable data pipelines and transformation processes.
  • Familiarity with data modelling concepts and techniques, including dimensional modelling.
  • Strong problem-solving and analytical skills, with the ability to analyse complex data-related issues and provide effective solutions.
  • Excellent communication and collaboration skills, with the ability to work effectively in a team environment and engage with stakeholders at various levels.

About the University

Born in the 60s with a mindset of boldness, imagination and collaboration, the University of Warwick is a world-leading research-intensive university with the highest academic and research standards. We’re one of the world’s top universities, ranked 67th in the world and 10th in the UK*, with 92% of our research assessed to be ‘world leading or internationally excellent’**.

You’ll be joining a diverse, innovative and globally connected community committed to igniting real world progress. Here at Warwick, we offer you opportunities to follow your ambitions as long as you bring the energy and determination to succeed.

*QS World University Rankings 2024

** Research Excellence Framework 2021

What we Offer

We will provide you with a great range of benefits, which include an attractive pension scheme, 30 days holiday plus Christmas closure, excellent learning and development opportunities, and savings on a wide range of products and services. We offer a generous maternity/paternity/adoption/parental leave policy, and onsite childcare facilities.

This is a fantastic opportunity to join a newly created and fast-growing team within a large public sector / HE environment

To apply please reach out to Pete.Hampshire@wegtechrec.com for more information.

WEG Technology Recruitment is acting as an internal recruitment agency on behalf of the University of Warwick.

Location – University of Warwick

30 Days Holidays + 4 Days Christmas Closure + Bank Holidays

Great Pension

Career Development

Flexible Working - (Hybrid)

A Great Working Environment

Excellent Sport & Leisure Facilities

Training and Personnel Development Offerings

Office Location is close to A45, A46, M1, M6, M40, M42, M69

Great Public Transport Links 

  • Lead Engine Problem Solving Engineer

    4 weeks ago

    Coventry, United Kingdom The Engineer Full time

    JOB TITLE: Lead Engine Problem Solving Engineer POSTING START DATE: 29/04/2024 POSTING END DATE: 13/05/2024 LOCATION: Whitley, Coventry, UK JLR is harnessing technology to make driving smarter, safer and cleaner. You can help create a world in which responsible, sustainable vehicles revolutionise the driving experience for generations. Our vision is to...

  • Calibration Engineer

    2 months ago

    Coventry, United Kingdom The Engineer Full time

    REQ ID: 120509 JOB TITLE: Calibration Engineer SALARY: Competitive POSTING END DATE: 22nd January 2024 LOCATION: Coventry JLR is harnessing technology to make driving smarter, safer and cleaner. You can help create a world in which responsible, sustainable vehicles revolutionise the driving experience for generations. Our vision is to leverage the...

  • From Data Engineer to Head of Data Engineering

    1 week ago

    Coventry, United Kingdom WEG Tech Full time €65,000 - €75,000

    Head of Data Engineering & Data Governance £34 Days Holidays + Bank Holidays Fantastic Pension & Other Great Public Sector Benefits Career Progression Hybrid Working (Mainly working from home) Excellent Sport & Leisure Facilities On-Site Training and Personnel Development Offerings Office Location is close to A45, A46, M1, M6, M40, M42, M69 We...

  • From Data Engineer to Head of Data Engineering

    2 months ago

    Coventry, United Kingdom WEG Tech Full time

    Head of Data Engineering & Data Governance £34 Days Holidays + Bank Holidays Fantastic Pension & Other Great Public Sector Benefits Career Progression Hybrid Working (Mainly working from home) Excellent Sport & Leisure Facilities On-Site Training and Personnel Development Offerings Office Location is close to A45, A46, M1, M6, M40, M42, M69 We...

  • Data Engineer

    2 weeks ago

    Coventry, Coventry, United Kingdom WEG Technology Recruitment Full time

    We have a great opportunity for an experienced Data Engineer to join an established team within one of the UK's leading universities.As one of the Data Engineers within the team, you will be responsible for leveraging Azure Data Factory and DBT to design, develop, and maintain robust data pipelines and scalable data models which integrate data from a wide...

  • Senior Engineer, Data Engineering

    1 week ago

    Coventry, United Kingdom Tata Consultancy Services Full time

    Are you a Data Engineer with a passion for engineering various data tools ? TCS is a purpose-led transformation company, built on belief. We don’t just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK...

  • Senior Engineer, Data Engineering

    2 weeks ago

    Coventry, United Kingdom Tata Consultancy Services Full time

    Are you a Data Engineer with a passion for engineering various data tools ? TCS is a purpose-led transformation company, built on belief. We don’t just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK...

  • Senior Engineer, Data Engineering

    2 weeks ago

    Coventry, United Kingdom Tata Consultancy Services Full time

    Job Description Are you a Data Engineer with a passion for engineering various data tools ? TCS is a purpose-led transformation company, built on belief. We don’t just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest...

  • Data Engineer

    3 weeks ago

    Coventry, United Kingdom The Virtual Forge Full time

    About us:The Virtual Forge is an international company with offices in the UK, Portugal, UAE, Canada and the US. We are experts in designing and developing data driven software solutions for the cloud and we are currently looking for a talented Data Engineer to join our team and work with one of our clients. You will be based in our clients offices in...

  • Data Engineer

    3 weeks ago

    Coventry, United Kingdom The Virtual Forge Full time

    About us: The Virtual Forge is an international company with offices in the UK, Portugal, UAE, Canada and the US. We are experts in designing and developing data driven software solutions for the cloud and we are currently looking for a talented Data Engineer to join our team and work with one of our clients.  You will be based in our clients offices in...

  • Data Engineer

    3 weeks ago

    Coventry, United Kingdom The Virtual Forge Full time

    About us:The Virtual Forge is an international company with offices in the UK, Portugal, UAE, Canada and the US. We are experts in designing and developing data driven software solutions for the cloud and we are currently looking for a talented Data Engineer to join our team and work with one of our clients. You will be based in our clients offices in...

  • Data Engineer

    3 weeks ago

    Coventry, United Kingdom The Virtual Forge Full time

    About us:The Virtual Forge is an international company with offices in the UK, Portugal, UAE, Canada and the US. We are experts in designing and developing data driven software solutions for the cloud and we are currently looking for a talented Data Engineer to join our team and work with one of our clients. You will be based in our clients offices in...

  • Data Engineer

    3 weeks ago

    Coventry, United Kingdom The Virtual Forge Full time

    Job DescriptionAbout us:The Virtual Forge is an international company with offices in the UK, Portugal, UAE, Canada and the US. We are experts in designing and developing data driven software solutions for the cloud and we are currently looking for a talented Data Engineer to join our team and work with one of our clients. You will be based in our clients...

  • Data Engineer

    3 weeks ago

    Coventry, United Kingdom The Virtual Forge Full time

    About us: The Virtual Forge is an international company with offices in the UK, Portugal, UAE, Canada and the US. We are experts in designing and developing data driven software solutions for the cloud and we are currently looking for a talented Data Engineer to join our team and work with one of our clients.  You will be based in our clients offices in...

  • Data Engineer

    3 weeks ago

    Coventry, United Kingdom The Virtual Forge Full time

    About us: The Virtual Forge is an international company with offices in the UK, Portugal, UAE, Canada and the US. We are experts in designing and developing data driven software solutions for the cloud and we are currently looking for a talented Data Engineer to join our team and work with one of our clients.  You will be based in our clients offices in...

  • Data Engineer

    2 weeks ago

    Coventry, United Kingdom The Virtual Forge Full time

    About us:If your skills, experience, and qualifications match those in this job overview, do not delay your application.The Virtual Forge is an international company with offices in the UK, Portugal, UAE, Canada and the US. We are experts in designing and developing data driven software solutions for the cloud and we are currently looking for a talented Data...

  • Data Engineer

    2 weeks ago

    Coventry, United Kingdom The Virtual Forge Full time

    Job Description About us: The Virtual Forge is an international company with offices in the UK, Portugal, UAE, Canada and the US. We are experts in designing and developing data driven software solutions for the cloud and we are currently looking for a talented Data Engineer to join our team and work with one of our clients.  You will be based in our...

  • Data Engineer

    3 weeks ago

    Coventry, United Kingdom The Virtual Forge Full time

    About us:If your skills, experience, and qualifications match those in this job overview, do not delay your application.The Virtual Forge is an international company with offices in the UK, Portugal, UAE, Canada and the US. We are experts in designing and developing data driven software solutions for the cloud and we are currently looking for a talented Data...

  • Senior Engineer, Data Engineering

    3 weeks ago

    Coventry, United Kingdom Lear Corporation Full time

    We foster collaboration, inclusion, respect and excellence. Our teams have invented groundbreaking technologies, flawlessly manufactured millions of products and earned a long list of awards. Passionate about their craft. Lear, a global automotive technology leader in Seating and E-Systems, enables superior in-vehicle experiences for consumers around the...

  • Senior Data Engineer

    3 weeks ago

    Coventry, United Kingdom NHS Counter Fraud Authority Full time

    Job summary The Senior Data Engineer will have direct oversight and responsibility for the development, implementation, review, and establishment of data and techniques used in the Advanced Data Analytics Portfolio (DAP). As a Senior Data Engineer, you will work with project managers, data scientists, counter fraud experts, stakeholders, and senior...