Data Engineer

Found in: Talent UK 2 C2 - 2 weeks ago


Salford, United Kingdom UK Civil Service Full time

Job summary

About the organisation

The recently created Department for Business and Trade is at the heart of the UK�s relationship with the global economy. We have��but in essence, we are the department for economic growth. We support businesses to invest, grow and export, creating jobs and opportunities across the , innovation, and data-centric decision making underpin the work of the department and in particular the way that digital services to support the businesses and the economy are delivered. Professionals like you will enable the department to continue to deliver at pace and achieve the ambitious departmental goals.�

This role is available in seven UK locations and can only be worked from within the UK, not overseas. If your office location is London, you will be eligible to receive London weighting. DBT employees work in a hybrid pattern, spending 2-3 days a week (pro rata) in the office on average. Changes to these working arrangements are available in certain circumstances but must be agreed with the vacancy manager and in line with the requirements of the role and can only be discussed with successful candidates. Travel to your primary office location will not be paid for by DBT, but costs for travel to an office which is not your main location will be covered.�Find out about life at DBT, our benefits and meet the team by watching our recruitment��visiting our��or reading�

Job description

About the team

To enable the work of the department you will join our� team of over 400 colleagues working across the full spectrum of the DDaT specialisms, in a modern, user-centric, agile will join the team that build and operate innovative tools and services such as �that support businesses in the UK and overseas. Our public-facing services are visited millions of times each year and the tools we develop for our staff, across the globe, help them be more efficient in their daily working is possible due to the state-of-the-art data infrastructure our teams build and maintain. We work on critical national infrastructure that powers trade at the UK border and innovative data projects looking at global supply chains and future ways of believe in creativity, curiosity, diversity of thought, entrepreneurship, delivery focus and collaboration. We embody the DBT values to be expert, enterprising, engaged and inclusive. These values have helped us become a high performing team that continuously delivers high quality outputs.

About the role

As a�r you will help us design, implement, test and operate our data products, pipelines and services. You will work in a cross-functional, agile, team to integrate them into wider systems and business you will have opportunities to contribute to the wider solution to satisfy our user needs, the team will rely on your hands-on expertise in querying and transforming data, automating common tasks, building efficient data pipelines and creating services that expose the data through do this, you will work with multiple raw data formats like csv, json, xml, parquet, use languages like SQL and Python in multiple cloud-based solutions.�

The role follows the DDaT framework:�

As a Data Engineer, you will

Design, build and test data products and services using standard techniques and tools.Deliver data solutions which are scalable, resilient and future proof.Understand typical problems in databases, data processes, data products and services. You understand and can apply typical solutions to those problems.Undertake data profiling and source system analysis including techniques like reverse engineering.Design, code, test and document, pipelines, Web APIs, services or scripts.Work in an Agile and cross-functional team

Person specification

You will need to have demonstrable skills and experience of:

Agile methodologies. Experience in working in agile methodologies on data projects.Data development process. You can design, build and test data products based on feeds from multiple systems using a range of different storage technologies and/or access methods. You know how to create repeatable and reusable products.Data modelling. You understand the concepts and principles of data modelling and can produce, maintain and update relevant data models for specific business needs. You know how to reverse-engineer data models from a live system.Problem resolution (data). You know about the types of problems in databases, data processes, data products and services.Programming and build (data engineering). You can design, code, test, correct and document simple programs or scripts using Python and SQL. You can use source control to manage your code.Technical understanding (data engineering). You understand core technical concepts like data normalisation, modelling, performance of data intensive solutions. You understand basic software development concepts.

Desirable Skills and Experience

These are not necessary but would be ideal if you:

Communication skills (data). You know about the need to translate technical concepts into non-technical language and understand what communication is required for internal and external stakeholders.Data analysis and synthesis. You know how to undertake data profiling and source system analysis and can present clear insights to colleagues to support the end use of the data.Testing. You can execute test scripts under supervision. You understand the role of testing and how it works.

Benefits

Learning and development tailored to your roleAn environment with flexible working optionsA culture encouraging inclusion and diversityA with an average employer contribution of 27%
  • Data Centre Engineer

    2 weeks ago


    Salford, United Kingdom In Technology Group Limited Full time

    Title: Datacentre EngineerSalary: £30,000 DOELocation: SalfordWe are looking for a passionate Data Centre Engineer who wants to join a medium sized company with a great community culture and lots of opportunity for career progression. They have been providing their clients with fully-managed dedicated server hosting, colocation, cloud hosting and data...


  • Salford, Greater Manchester, United Kingdom Abs Data Full time

    Research Assistant (Software Engineer) University of Salford Opportunity The School of Science, Engineering and Environment (SEE) is a centre of discovery and innovation. With a broad portfolio across computer sciences, engineering, built environment and human and natural sciences, we are one of the largest schools within the University, home to over...

  • Senior Data Architect

    Found in: Talent UK C2 - 3 days ago


    Salford, United Kingdom TalkTalk Group Full time

    n You will review the ‘as is’ solution, work closely across TalkTalk and wider teams to identify an approach that allows us to move data across various data warehouses to agreed tight timelines and budget. This includes people, process and technology. You will support the design data models and metadata systems ensuring artifacts are created,...


  • Salford, United Kingdom In Technology Group Limited Full time

    Title: Senior Datacentre EngineerSalary: £40,000 DOELocation: SalfordWe are looking for an experienced Data Centre Engineer who wants to join a medium sized company with a great community culture and lots of progression opportunities onto management roles. They have been providing their clients with fully-managed dedicated server hosting, colocation, cloud...

  • Software Engineer

    Found in: beBee S GB - 2 weeks ago


    Salford, United Kingdom Senitor Associates Full time

    Software Engineer - Test Development - £48K DOE - BoltonInterested in learning more about this job Scroll down and find out what skills, experience and educational qualifications are needed.This role sits within the Manufacturing Engineering team with a focus on manufacturing test support. Working within the manufacturing engineering team this role is...

  • Software Engineer

    Found in: Appcast UK C C2 - 2 weeks ago


    Salford, United Kingdom Senitor Associates Full time

    Software Engineer - Test Development - £48K DOE - BoltonThis role sits within the Manufacturing Engineering team with a focus on manufacturing test support. Working within the manufacturing engineering team this role is primarily to develop and maintain production test and verification software applications for sub-assemblies, modules and final products....

  • Software Engineer

    Found in: beBee jobs GB - 6 days ago


    Salford, Salford, United Kingdom Senitor Associates Full time

    Software Engineer - Test Development - £48K DOE - BoltonInterested in learning more about this job Scroll down and find out what skills, experience and educational qualifications are needed.This role sits within the Manufacturing Engineering team with a focus on manufacturing test support. Working within the manufacturing engineering team this role is...

  • Software Engineer

    Found in: Appcast UK C2 - 2 weeks ago


    Salford, United Kingdom Senitor Associates Full time

    Software Engineer - Test Development - £48K DOE - BoltonThis role sits within the Manufacturing Engineering team with a focus on manufacturing test support. Working within the manufacturing engineering team this role is primarily to develop and maintain production test and verification software applications for sub-assemblies, modules and final products....

  • Software Engineer

    Found in: Whatjobs ES C2 - 6 days ago


    Salford, United Kingdom Senitor Associates Full time

    Software Engineer - Test Development - £48K DOE - Bolton This role sits within the Manufacturing Engineering team with a focus on manufacturing test support. Working within the manufacturing engineering team this role is primarily to develop and maintain production test and verification software applications for sub-assemblies, modules and final products....

  • Software Engineer

    Found in: Appcast Linkedin GBL C2 - 2 weeks ago


    Salford, United Kingdom Senitor Associates Full time

    Software Engineer - Test Development - £48K DOE - BoltonThis role sits within the Manufacturing Engineering team with a focus on manufacturing test support. Working within the manufacturing engineering team this role is primarily to develop and maintain production test and verification software applications for sub-assemblies, modules and final products....

  • Software Engineer

    Found in: Talent UK 2A C2 - 2 weeks ago


    Salford, United Kingdom Senitor Associates Full time

    Software Engineer - Test Development - £48K DOE - BoltonThis role sits within the Manufacturing Engineering team with a focus on manufacturing test support. Working within the manufacturing engineering team this role is primarily to develop and maintain production test and verification software applications for sub-assemblies, modules and final products....

  • Software Engineer

    2 days ago


    Salford, United Kingdom REED Professional Services Full time

    **Software Engineer - Insde IR35** Reed Professional Services are looking for a Software Engineer to join a team who are transforming how our client engages with its audience. Our client's aim is to become more data driven in how it supports the delivery of its services. As Software Engineers you will be expected to contribute to the design and...

  • Quality Engineer

    Found in: Talent UK 2A C2 - 1 hour ago


    Salford, United Kingdom Yolk Recruitment Ltd Full time

    Quality Engineer - £30 per hour inside ir35 – 6 months (Extension highly likely) – Bolton – one stage interview – Sector: Aerospace & Defence Yolk recruitment is recruiting for a quality engineer to work with a cutting-edge aerospace and defence client leading global innovations within there industry. Due to the security nature of the projects the...


  • Salford, United Kingdom RHL Full time

    We have an opportunity for a Logistics Engineer to join a major manufacturing company that has global reach, on a 6-12-month contract, based in Irlam, Manchester. The Logistics Engineer will design and implement successful logistics solutions, utilise technical skills and soft skills, data purification & analysis; warehouse storage design & manufacturing...

  • Service Architect

    2 days ago


    Salford, Greater Manchester, United Kingdom Knewin Full time

    You will review the ‘as is’ solution, work closely across TalkTalk and wider teams to identify an approach that allows us to move data across various data warehouses to agreed tight timelines and budget. You will support the design data models and metadata systems ensuring artifacts are created, managed and maintained. You will be responsible for...


  • Salford, Greater Manchester, United Kingdom Knewin Full time

    n You will review the ‘as is’ solution, work closely across TalkTalk and wider teams to identify an approach that allows us to move data across various data warehouses to agreed tight timelines and budget. This includes people, process and technology. You will support the design data models and metadata systems ensuring artifacts are created,...

  • Senior Design Engineer

    Found in: Whatjobs ES C2 - 6 days ago


    Salford, United Kingdom Kier Group Full time

    We're looking for a Senior Design Engineer to join our Highways Design Team based in Salford or Penrith to work on the National Highways Scheme Delivery Framework Contract within Highways. Within this role you can expect a competitive salary, private healthcare and other exciting benefits. Can you envision a world without transportation links by land, sea,...


  • Salford, United Kingdom Kier Group Full time

    We're looking for a Senior Design Engineer to join our Highways Design Team based in Salford or Penrith to work on the National Highways Scheme Delivery Framework Contract within Highways. Within this role you can expect a competitive salary, private healthcare and other exciting benefits.   Can you envision a world without transportation links by land,...


  • Salford, United Kingdom Kier Group Full time

    We're looking for a Senior Design Engineer to join our Highways Design Team based in Salford or Penrith to work on the National Highways Scheme Delivery Framework Contract within Highways. Within this role you can expect a competitive salary, private healthcare and other exciting benefits.   Can you envision a world without transportation links by land,...

  • PostDoc Researcher

    Found in: beBee S GB - 3 weeks ago


    Salford, United Kingdom University of Salford Full time

    The School of Science, Engineering and Environment at the University of Salford is looking for a Post Doc Researcher in Software Engineering and Digital Information Management Systems for the development and application in construction and demolition waste management. This researcher will form part of the RECONMATIC Horizon Europe project and will test,...