Data Engineer

2 weeks ago

Newcastle upon Tyne, United Kingdom Undisclosed Full time

Role Title: Data Engineer

Duration: contract to run until 31/03/2025

Location: Remote but potentially one day a month in Newcastle Upon Tyne

Rate: up to £623.70 p/d Umbrella inside IR35

Clearance required: Active Security Clearance is required for this role. UK National candidates and no Dual Nationals will be accepted due to the Clearance required

Job Description:

  • 3-5 years experience
  • Listen to the needs of technical and business stakeholders, and interpret them
  • Effectively manage stakeholder expectations
  • Manage active and reactive communication
  • Support or host difficult discussions within the team or with diverse senior stakeholders
  • Understand and help teams to apply a range of techniques for data profiling
  • Source system analysis from a complex single source
  • Bring multiple data sources together in a conformed model for analysis
  • Establish enterprise-scale data integration procedures across the data development life cycle, and ensure that teams adhere to them
  • Manage resources to ensure that data services work effectively at an enterprise level
  • Identify areas of innovation in data tools and techniques, and recognise appropriate timing for adoption
  • Establish standards, keep them up to date and ensure adherence to them
  • Keep abreast of best practice in industry and across government
  • Understand the concepts and principles of data modelling and can produce relevant data models
  • Work across government and industry, recognising opportunities for the reuse and alignment of data models in different organisations
  • Design the method to categorise data models within an organisation
  • Design an appropriate metadata repository and present changes to existing metadata repositories
  • Understand a range of tools for storing and working with metadata
  • Provide oversight and advice to more inexperienced members of the team
  • Ensure that the most appropriate actions are taken to resolve problems as they occur
  • Co-ordinate teams to resolve problems and to implement solutions and preventative measures
  • Use agreed standards and tools to design, code, test, correct and document moderate-to-complex programs and scripts from agreed specifications and subsequent iterations
  • Collaborate with others to review specifications where appropriate
  • Show a thorough understanding of the technical concepts required for the role, and can explain how these fit into the wider technical landscape
  • Review requirements and specifications, and define test conditions
  • Identify issues and risks associated with work
  • Analyse and report test activities and results

Key Technical Skills

  • AWS: S3, Lambda, EMR, SMS, SQS

Additional services related to data infrastructure:

  • Terraform
  • Databricks
  • Kafka
  • Data Lake, Warehouse, Lakehouse architecture and design
  • Python/Pyspark
  • Data platforms and notebooks: Jupyter, Databricks, Azure
  • Gitlab: repository and CI/CD
  • Java (Spring Boot) experience is a plus

All profiles will be reviewed against the required skills and experience. Due to the high number of applications we will only be able to respond to successful applicants in the first instance. We thank you for your interest and the time taken to apply

  • Data Engineer

    1 week ago

    Newcastle upon Tyne, United Kingdom NRG. Full time

    Role: Data Engineer Location: Newcastle-upon-Tyne We are excited to partner with our client in seeking skilled Data Engineers to join their innovative team. This is a unique opportunity to work on cutting-edge data products and pipelines that deliver high-quality, standardized data for analysts, both internally and across government sectors. These roles...

  • Data Engineer

    1 week ago

    Newcastle upon Tyne, United Kingdom NRG. Full time

    Role: Data Engineer Location: Newcastle-upon-Tyne We are excited to partner with our client in seeking skilled Data Engineers to join their innovative team. This is a unique opportunity to work on cutting-edge data products and pipelines that deliver high-quality, standardized data for analysts, both internally and across government sectors. These roles...

  • Data Engineer

    3 months ago

    Newcastle Upon Tyne, United Kingdom G.Digital Full time

    Data Engineer | £50-55k | Hybrid onsite in the North East 2 days per week If you're a Data Engineer who wants to work for one of THE best and fastest growing Data functions in this sector then you'll want to check this out... About the business

  • Data Engineer

    4 weeks ago

    Newcastle Upon Tyne, United Kingdom NRG. Full time

    Role: Data EngineerLocation: Newcastle-upon-TyneWe are excited to partner with our client in seeking skilled Data Engineers to join their innovative team. This is a unique opportunity to work on cutting-edge data products and pipelines that deliver high-quality, standardized data for analysts, both internally and across government sectors. These roles are...

  • Data Engineer

    1 week ago

    Newcastle Upon Tyne, United Kingdom NRG. Full time

    Role: Data Engineer Location: Newcastle-upon-Tyne We are excited to partner with our client in seeking skilled Data Engineers to join their innovative team. This is a unique opportunity to work on cutting-edge data products and pipelines that deliver high-quality, standardized data for analysts, both internally and across government sectors. These roles are...

  • Data Engineer

    2 weeks ago

    Newcastle Upon Tyne, United Kingdom NRG. Full time

    Role: Data EngineerLocation: Newcastle-upon-TyneWe are excited to partner with our client in seeking skilled Data Engineers to join their innovative team. This is a unique opportunity to work on cutting-edge data products and pipelines that deliver high-quality, standardized data for analysts, both internally and across government sectors. These roles are...

  • Data Engineer

    3 weeks ago

    Newcastle Upon Tyne, United Kingdom NRG. Full time

    Role: Data EngineerLocation: Newcastle-upon-TyneWe are excited to partner with our client in seeking skilled Data Engineers to join their innovative team. This is a unique opportunity to work on cutting-edge data products and pipelines that deliver high-quality, standardized data for analysts, both internally and across government sectors. These roles are...

  • Data Engineer

    4 weeks ago

    Newcastle upon Tyne, United Kingdom NRG. Full time

    Job Description Role: Data Engineer Location: Newcastle-upon-Tyne We are excited to partner with our client in seeking skilled Data Engineers to join their innovative team. This is a unique opportunity to work on cutting-edge data products and pipelines that deliver high-quality, standardized data for analysts, both internally and across government sectors....

  • Data Engineer

    3 weeks ago

    Newcastle upon Tyne, United Kingdom NRG. Full time

    Role: Data EngineerLocation: Newcastle-upon-TyneWe are excited to partner with our client in seeking skilled Data Engineers to join their innovative team. This is a unique opportunity to work on cutting-edge data products and pipelines that deliver high-quality, standardized data for analysts, both internally and across government sectors. These roles are...

  • Data Engineer

    2 weeks ago

    Newcastle upon Tyne, United Kingdom G.Digital Full time

    Data Engineer | £50-55k | Hybrid onsite in the North East 3 days per week If you're a Data Engineer who wants to work for one of THE best and fastest growing Data functions in this sector then you'll want to check this out... About the business G.Digital has partnered with this organisation who are revolutionising the game playing...

  • Senior Engineer, Data Engineering

    1 week ago

    Newcastle upon Tyne, United Kingdom NRG. Full time

    Role: Data Engineer Location: We are excited to partner with our client in seeking skilled Data Engineers to join their innovative team. This is a unique opportunity to work on cutting-edge data products and pipelines that deliver high-quality, standardized data for analysts, both internally and across government sectors. As a Data Engineer, you will play a...

  • Senior Engineer, Data Engineering

    1 week ago

    Newcastle upon Tyne, United Kingdom NRG. Full time

    Role: Data Engineer Location: We are excited to partner with our client in seeking skilled Data Engineers to join their innovative team. This is a unique opportunity to work on cutting-edge data products and pipelines that deliver high-quality, standardized data for analysts, both internally and across government sectors. As a Data Engineer, you will play a...

  • Data Engineer

    2 weeks ago

    Newcastle Upon Tyne, United Kingdom G.Digital Full time

    Data Engineer | £50-55k | Hybrid onsite in the North East 3 days per weekIf you're a Data Engineer who wants to work for one of THE best and fastest growing Data functions in this sector then you'll want to check this out...About the business 🚀G.Digital has partnered with this organisation who are revolutionising the game playing experience! From being...

  • Data Engineer

    2 weeks ago

    Newcastle upon Tyne, United Kingdom G.Digital Full time

    Data Engineer | £50-55k | Hybrid onsite in the North East 3 days per weekIf you're a Data Engineer who wants to work for one of THE best and fastest growing Data functions in this sector then you'll want to check this out...About the business G.Digital has partnered with this organisation who are revolutionising the game playing experience! From being one...

  • Data Engineer

    2 weeks ago

    Newcastle Upon Tyne, United Kingdom G.Digital Full time

    Data Engineer | £50-55k | Hybrid onsite in the North East 3 days per weekIf you're a Data Engineer who wants to work for one of THE best and fastest growing Data functions in this sector then you'll want to check this out...About the business 🚀G.Digital has partnered with this organisation who are revolutionising the game playing experience! From being...

  • Data Engineer Leader

    1 week ago

    Newcastle upon Tyne, Newcastle upon Tyne, United Kingdom Opus Recruitment Solutions Full time

    Data Engineer Leader Opportunity in NewcastleWe are seeking a highly skilled and experienced Data Engineer to join our team as a leader, responsible for developing the data strategy, leading the team, and driving progress in terms of data engineering tools and technologies.The successful candidate will have expertise in Azure, Google BigQuery, Python, and...

  • Data Engineer for a Data-Driven Future

    3 weeks ago

    Newcastle upon Tyne, Newcastle upon Tyne, United Kingdom Ronald James Ltd. Full time

    This is an exciting opportunity at Ronald James Ltd. to revolutionize your career as a Data Engineer. Our company continues to invest in cutting-edge products and technology, driving our market share forward.As a Data Engineer, you will be responsible for designing and maintaining robust data pipelines within the AWS ecosystem, with a primary focus on the...

  • Data Engineering Leader

    3 weeks ago

    Newcastle upon Tyne, Newcastle upon Tyne, United Kingdom Opus Recruitment Solutions Ltd Full time

    We are seeking a highly skilled and experienced Data Engineering Leader to join our team in Newcastle, UK. As the Lead Data Engineer, you will be responsible for developing the data strategy, leading the team, and driving progress in terms of data engineering tools and technologies.About the Role:Develop and maintain data pipelines, ETL processes, and data...

  • Senior Engineer, Data Engineering

    4 months ago

    Newcastle upon Tyne, United Kingdom Oliver Bernard Full time €85,000 - €110,000

    Senior Data Engineer - Python, SQL A key client of OB, who are a pioneering venture, providing the financial and investment markets with technology consulting services are looking to hire a Senior Data Engineer to their best in class engineering team. This is an incredibly exciting time to join a venture backed by two industry leaders in their...

  • Senior Engineer, Data Engineering

    3 months ago

    Newcastle upon Tyne, United Kingdom Oliver Bernard Full time €85,000 - €110,000

    Senior Data Engineer - Python, SQL A key client of OB, who are a pioneering venture, providing the financial and investment markets with technology consulting services are looking to hire a Senior Data Engineer to their best in class engineering team. This is an incredibly exciting time to join a venture backed by two industry leaders in their...