Data Engineer

2 months ago

Birmingham, Birmingham, United Kingdom TerraQuest Solutions Ltd Full time

About TerraQuest Solutions Ltd

TerraQuest Solutions Ltd is a leading provider of innovative and cost-effective solutions to the public and private sectors. As a specialist in planning, land, property, and business solutions, we deliver bespoke, flexible, and efficient services through a process-orientated delivery structure.

Our Culture

We are a Living Wage Foundation accredited employer, committed to supporting the well-being and development of all our people. With competitive salaries, enhanced Family Friendly policies, a range of benefits, and true flexibility with our Agile Working approach, we care about our team's growth and development.

Job Overview

We are seeking a Data Engineer to join our Solutions Team, supporting our period of sustained growth. As a Data Engineer, you will work with a range of data technologies to implement an enterprise-wide Data Platform, building, testing, and maintaining Data Platform pipelines, and supporting software engineering teams in developing new web-based solutions.

Key Responsibilities

  • Design, implement, and maintain Data Platform pipelines using Azure Data Factory
  • Transform and process data using Azure Databricks and Spark
  • Model data using Azure Data Lake
  • Work with Azure Storage Accounts and Azure SQL Server
  • Produce entity relationship diagrams
  • Develop and maintain data engineering scripts using Python
  • Collaborate with the Data Team on data management and governance
  • Support data migration activities as required
  • Share knowledge and expertise with the team
  • Stay up-to-date with current and latest data technologies and practices

Requirements

  • Minimum 2 years' experience as a Data Engineer, preferably 5 years
  • Good familiarity with key digital data concepts and methodologies
  • Working knowledge of Microsoft Azure data technologies
  • Ability to produce entity relationship diagrams
  • Programming/scripting experience in Python
  • Familiarity with a Software Development Cycle Management Tool

Desirable Skills and Experience

  • Data modelling (relational, star, snowflake schemas)
  • Azure Data Warehouse / Synapse
  • Source control (git)
  • C# programming
  • NoSQL databases (Mongo / CosmosDB)
  • JSON, XML
  • RestAPI
  • PowerBI

Non-Technical Requirements

  • Must be a team player
  • Should have previous experience working in an agile software development environment
  • Should be able to take ownership of tasks from planning to presentation
  • Should be DevOps aware

  • Senior Data Engineer

    1 month ago

    Birmingham, Birmingham, United Kingdom Harnham - Data & Analytics Recruitment Full time

    {"title": "Senior Data Engineer", "company": "Harnham - Data & Analytics Recruitment", "description": "Job SummaryWe are seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and pipelines.Key ResponsibilitiesDesign and implement...

  • Senior Data Engineer

    1 month ago

    Birmingham, Birmingham, United Kingdom Harnham - Data & Analytics Recruitment Full time

    {"title": "Senior Data Engineer", "company": "Harnham - Data & Analytics Recruitment", "description": "Job SummaryWe are seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and pipelines.Key ResponsibilitiesDesign and implement...

  • Senior Data Engineer

    1 month ago

    Birmingham, Birmingham, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Senior Data EngineerJoin our client, a leading global organisation, as they seek a highly skilled Senior Data Engineer to modernise their existing data infrastructure.Key Responsibilities:Support the team in designing and implementing end-to-end data pipelines, ensuring scalability and efficiency.Collaborate with stakeholders to understand their needs and...

  • Senior Data Engineer

    1 month ago

    Birmingham, Birmingham, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Senior Data EngineerJoin our client, a leading global organisation, as they seek a highly skilled Senior Data Engineer to modernise their existing data infrastructure.Key Responsibilities:Support the team in designing and implementing end-to-end data pipelines, ensuring scalability and efficiency.Collaborate with stakeholders to understand their needs and...

  • Data Engineer

    4 weeks ago

    Birmingham, Birmingham, United Kingdom Irwin Mitchell Full time

    About the RoleIrwin Mitchell is seeking a highly skilled Data Engineer to join our team and contribute to the design, development, and maintenance of our cloud data platform in Azure. As a Data Engineer, you will play a critical role in shaping the future of our data capabilities and ensuring the delivery of high-quality data solutions.Key...

  • Data Engineer

    4 weeks ago

    Birmingham, Birmingham, United Kingdom Irwin Mitchell Full time

    About the RoleIrwin Mitchell is seeking a highly skilled Data Engineer to join our team and contribute to the design, development, and maintenance of our cloud data platform in Azure. As a Data Engineer, you will play a critical role in shaping the future of our data capabilities and ensuring the delivery of high-quality data solutions.Key...

  • Data Engineer

    2 weeks ago

    Birmingham, Birmingham, United Kingdom caia - Jobboard Full time

    Unlock Your Potential as a Data EngineerAt Caia - Jobboard, we're seeking a talented Data Engineer to join our team and help us build a next-gen data platform. As a key member of our engineering team, you'll be responsible for designing and developing scalable data pipelines, ensuring data integrity, and collaborating with cross-functional teams to drive...

  • Data Engineer

    3 weeks ago

    Birmingham, Birmingham, United Kingdom Goldman Sachs Group, Inc. Full time

    Unlock Your Potential as a Data Engineer at Goldman SachsAre you a skilled Java developer looking to take your career to the next level? Do you have a passion for building scalable software solutions? We're seeking a talented Data Engineer to join our team at Goldman Sachs, where you'll have the opportunity to work on cutting-edge projects and make a real...

  • Data Engineer

    3 weeks ago

    Birmingham, Birmingham, United Kingdom Goldman Sachs Group, Inc. Full time

    Unlock Your Potential as a Data Engineer at Goldman SachsAre you a skilled Java developer looking to take your career to the next level? Do you have a passion for building scalable software solutions? We're seeking a talented Data Engineer to join our team at Goldman Sachs, where you'll have the opportunity to work on cutting-edge projects and make a real...

  • Data Engineer

    3 weeks ago

    Birmingham, Birmingham, United Kingdom Interquest Group Full time

    Job Title: Junior Data EngineerMy client, a global technology business, is seeking a talented Junior Data Engineer to contribute to the design and development of end-to-end data solutions within a Product/SaaS environment.Key Responsibilities:Collaborate with the team to design and develop data solutions that meet business requirements.Develop, maintain, and...

  • Data Engineer

    3 weeks ago

    Birmingham, Birmingham, United Kingdom Interquest Group Full time

    Job Title: Junior Data EngineerMy client, a global technology business, is seeking a talented Junior Data Engineer to contribute to the design and development of end-to-end data solutions within a Product/SaaS environment.Key Responsibilities:Collaborate with the team to design and develop data solutions that meet business requirements.Develop, maintain, and...

  • Data Engineer

    1 month ago

    Birmingham, Birmingham, United Kingdom Goldman Sachs Group, Inc. Full time

    Unlock Your Potential as a Data Engineer at Goldman SachsAre you a skilled Java developer looking to take your career to the next level? Do you have a passion for building scalable software solutions and working with big data? If so, we have an exciting opportunity for you to join our team as a Data Engineer at Goldman Sachs.About the RoleWe are seeking a...

  • Data Engineer

    1 month ago

    Birmingham, Birmingham, United Kingdom Goldman Sachs Group, Inc. Full time

    Unlock Your Potential as a Data Engineer at Goldman SachsAre you a skilled Java developer looking to take your career to the next level? Do you have a passion for building scalable software solutions and working with big data? If so, we have an exciting opportunity for you to join our team as a Data Engineer at Goldman Sachs.About the RoleWe are seeking a...

  • Data Engineer

    1 month ago

    Birmingham, Birmingham, United Kingdom Goldman Sachs Group, Inc. Full time

    Unlock Your Potential as a Data Engineer at Goldman SachsAre you a skilled Java developer looking to take your career to the next level? Do you have a passion for building scalable software solutions and working with big data? If so, we have an exciting opportunity for you to join our team as a Data Engineer at Goldman Sachs.About the RoleWe are seeking a...

  • Data Engineer

    1 month ago

    Birmingham, Birmingham, United Kingdom Goldman Sachs Group, Inc. Full time

    Unlock Your Potential as a Data Engineer at Goldman SachsAre you a skilled Java developer looking to take your career to the next level? Do you have a passion for building scalable software solutions and working with big data? If so, we have an exciting opportunity for you to join our team as a Data Engineer at Goldman Sachs.About the RoleWe are seeking a...

  • Data Engineer

    3 weeks ago

    Birmingham, Birmingham, United Kingdom ENGINEERINGUK Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at ENGINEERINGUK. As a Data Engineer, you will play a key role in designing, building, and maintaining our cloud-based data systems.Key Responsibilities:Collaborate with cross-functional teams to develop and implement data pipelines.Design and build scalable data...

  • Data Engineer

    3 weeks ago

    Birmingham, Birmingham, United Kingdom ENGINEERINGUK Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at ENGINEERINGUK. As a Data Engineer, you will play a key role in designing, building, and maintaining our cloud-based data systems.Key Responsibilities:Collaborate with cross-functional teams to develop and implement data pipelines.Design and build scalable data...

  • Data Engineer

    4 weeks ago

    Birmingham, Birmingham, United Kingdom Annapurna Full time

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Annapurna. As a key member of our data engineering team, you will be responsible for designing and implementing data pipelines and models, ensuring data quality and integrity.About the Role:Design and implement data pipelines and models to support reporting and...

  • Data Engineer

    4 weeks ago

    Birmingham, Birmingham, United Kingdom Annapurna Full time

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Annapurna. As a key member of our data engineering team, you will be responsible for designing and implementing data pipelines and models, ensuring data quality and integrity.About the Role:Design and implement data pipelines and models to support reporting and...

  • Data Engineer

    1 month ago

    Birmingham, Birmingham, United Kingdom Hays Technology Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team in the West Midlands. As a Data Engineer, you will play a key role in designing, building, and maintaining large-scale data systems.Key Responsibilities:Design and implement data pipelines using Azure Data Factory and KubernetesDevelop and maintain data warehouses using...