Data Engineer

3 weeks ago

Manchester Area, United Kingdom Forsyth Barnes Full time

Title: Principle Data Engineer

Location: Hybrid - Once per Month Travel to office in North West.

Salary: £75,000 + Package


Role Overview:



The Principal Data Engineer holds a key position within the Data Engineering function, reporting directly to the Head of Data & Platform Engineering. This role requires a deep understanding of Google Cloud Platform to ensure that all production data processes are reliable, efficient, and compliant. Key responsibilities include overseeing data ingestion, quality, integrity, modeling, warehousing, transformation, security, encryption, monitoring tools, and batch management.



The Principal Data Engineer will:



  • Identify opportunities for automation and process improvement.
  • Mentor and guide data engineers.
  • Establish coding standards and best practices.
  • Implement and document data integrity and quality checks.
  • Optimize queries.
  • Facilitate collaboration within the data engineering team.
  • This role involves close collaboration with the Principal Cloud Engineer and the Data Architect to ensure data pipeline designs are optimized and reliable within the Google Cloud Platform. Effective documentation and communication of solutions to both technical and non-technical stakeholders are essential.



Candidate Profile:



  • Extensive ETL/ELT background with experience in developing data pipelines, optimizing queries, and enhancing database performance.
  • Proficient in data modeling and data warehousing.
  • Multiple years of experience with GCP, especially with core processing and orchestration products like BigQuery, DataFlow, DataFusion, DataStream, Cloud Functions, DataProc, and Airflow/Composer.
  • Strong problem-solving skills and a meticulous approach to code reviews.
  • Proven leadership qualities with the ability to uphold high standards within the team.
  • Experience in managing and participating in the full development lifecycle of data products.
  • Demonstrated experience in a leading role within a Data Engineering function, including directing other data engineers through the design, build, and deployment of complex data solutions and driving CI/CD implementation and adoption.
  • Self-motivated with the ability to drive innovation and mentor team members.



Experience & Skills:



  • 7+ years in Data Engineering.
  • 1+ years in a Lead/Principal Engineer role.
  • 3+ years of experience with GCP.
  • Extensive experience with SQL and Data Lake/Warehouse solutions.
  • Proficiency in languages such as SQL, Python, Java, or Scala.
  • In-depth knowledge of query optimization techniques and experience in fine-tuning complex SQL queries.
  • Strong understanding of Data Governance, including Data Dictionaries, MDM, Lineage, Data Legislation, and handling PII.
  • Excellent communication skills and the ability to work collaboratively with cross-functional teams.
  • Experience with Agile/Scrum/SDLC methodologies.

  • Aws Data Engineer

    3 days ago

    Manchester, United Kingdom Data Idols Full time

    **AWS Data Engineer** With the backing from a large multinational company, and certainly becoming a known name throughout the UK, we are thrilled to be working with a tech disruptor that's driving an industry transformation within the automotive world as they expand their Engineering,Product and UX Teams. They are seeking a Data Engineer, skilled in AWS, to...

  • Data Engineer

    2 weeks ago

    Manchester, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **DATA ENGINEER** **REMOTE (MUST BE UK BASED)** **UP TO £85,000** **THE COMPANY** This company is one of the UK's largest telecommunication businesses. They are a very 'member focused' business, focusing on a great customer experience. Alongside this, they are also B Corp certified, meaning they have high-quality social and...

  • Data Engineer

    2 weeks ago

    Manchester, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **Data Engineer** **Fully Remote** **Up to £85, 000** **Permanent** A major telecommunications company is looking for a Data Engineer to join them and assist with their migration to AWS. **The Company** An exciting opportunity for a Senior Data Engineer, or an experienced Data Engineer looking for their next career step, has opened up in a major...

  • Data Engineer

    2 weeks ago

    Manchester, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **DATA ENGINEER** **REMOTE (MUST be UK based)** **Up to £45,000 per annum** **THE COMPANY** This company are a brand-new tech business, specializing in the healthcare industry. They've recently launched an app to support the NHS nurses, and 2021 hugely improved performance post-pandemic so they foresee continued growth over the next few years. **THE...

  • Data Engineer

    1 week ago

    Manchester, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **DATA ENGINEER** **REMOTE (MUST be UK based)** **Up to £45,000 per annum** **THE COMPANY** This company are a brand-new tech business, specializing in the healthcare industry. They've recently launched an app to support the NHS nurses, and 2021 hugely improved performance post-pandemic so they foresee continued growth over the next few years. **THE...

  • Senior Data Engineer

    3 weeks ago

    Manchester, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **SENIOR DATA ENGINEER** **UP TO £95,000** **REMOTE** **THE COMPANY**: A telecommunications company with an aim to become the biggest and most recommended amongst consumers in the UK. **THE ROLE**: The role will involve: - Building data pipelines - Building and maintaining a self-serve platform for data modeling - Building data products to improve...

  • DevOps Engineer

    3 weeks ago

    Manchester, United Kingdom The Engineer Full time €20,000

    Job Title: DevOps Engineer Location: Manchester Salary: Highly Competitive Job Type: Full Time, Permanent, Remote The Role: As a DevOps Engineer, you will be part of the Platform team focussing on transforming and operating: Legacy TSG services and systems into cloud native solutions delivered in a repeatable fashion, following an agile software...

  • Data Engineer

    3 weeks ago

    Manchester Area, United Kingdom Forsyth Barnes Full time

    Title: Principle Data Engineer Location: Hybrid - Once per Month Travel to office in North West. Salary: £75,000 + Package Role Overview: The Principal Data Engineer holds a key position within the Data Engineering function, reporting directly to the Head of Data & Platform Engineering. This role requires a deep understanding of Google Cloud...

  • Data Engineer

    1 week ago

    Manchester Area, United Kingdom Forsyth Barnes Full time

    Title: Principle Data Engineer Location: Hybrid - Once per Month Travel to office in North West. Salary: £75,000 + Package Role Overview: The Principal Data Engineer holds a key position within the Data Engineering function, reporting directly to the Head of Data & Platform Engineering. This role requires a deep understanding of Google Cloud...

  • Data Warehouse Developer

    4 weeks ago

    Manchester, United Kingdom Data Idols Full time

    Data Warehouse Architect Location: Remote/Hybrid Data Idols are working with one of the largest entertainment organisations growing rapidly within their global operations. With innovation, creativity, and data at the company's heart, they are looking for a Data Warehouse Architect to join the team. As a Data Warehouse Architect you will be responsible...

  • Data Warehouse Developer

    2 weeks ago

    Manchester, United Kingdom Data Idols Full time €80,000 - €85,000

    Data Warehouse Architect Location: Remote/Hybrid Data Idols are working with one of the largest entertainment organisations growing rapidly within their global operations. With innovation, creativity, and data at the company's heart, they are looking for a Data Warehouse Architect to join the team. As a Data Warehouse Architect you will be responsible...

  • Data Warehouse Developer

    2 weeks ago

    Manchester, United Kingdom Data Idols Full time €80,000 - €85,000

    Data Warehouse Architect Location: Remote/Hybrid Data Idols are working with one of the largest entertainment organisations growing rapidly within their global operations. With innovation, creativity, and data at the company's heart, they are looking for a Data Warehouse Architect to join the team. As a Data Warehouse Architect you will be responsible...

  • Data Warehouse Developer

    2 weeks ago

    Manchester, United Kingdom Data Idols Full time €80,000 - €85,000

    Data Warehouse Architect Location: Remote/Hybrid Data Idols are working with one of the largest entertainment organisations growing rapidly within their global operations. With innovation, creativity, and data at the company's heart, they are looking for a Data Warehouse Architect to join the team. As a Data Warehouse Architect you will be responsible...

  • Data Warehouse Developer

    1 week ago

    Manchester, United Kingdom Data Idols Full time

    Data Warehouse Architect Location: Remote/Hybrid Data Idols are working with one of the largest entertainment organisations growing rapidly within their global operations. With innovation, creativity, and data at the company's heart, they are looking for a Data Warehouse Architect to join the team. As a Data Warehouse Architect you will be responsible for...

  • DevOps Engineer

    3 weeks ago

    Manchester, United Kingdom The Engineer Full time €20,000

    Job Title: DevOps Engineer Job Type: Full Time, Permanent, Remote As a DevOps Engineer, you will be part of the Platform team focussing on transforming and operating: Legacy TSG services and systems into cloud native solutions delivered in a repeatable fashion, following an agile software delivery methodology. TSGs current approach to the build and...

  • Data Engineer

    3 weeks ago

    Manchester Area, United Kingdom MBN Solutions Full time

    Azure Data EngineerGreater Manchester (Hybrid)Up to £60,000 DOEAre you an experienced Data Engineer looking for your next move?Does establishing a new Data Warehouse capability, promoting a data-driven culture, and ensuring high levels of data quality excite you?About the RoleThis is a great opportunity to join an international healthcare manufacturer on a...

  • Data Engineer

    3 weeks ago

    Manchester Area, United Kingdom MBN Solutions Full time

    Azure Data EngineerGreater Manchester (Hybrid)Up to £60,000 DOEAre you an experienced Data Engineer looking for your next move?Does establishing a new Data Warehouse capability, promoting a data-driven culture, and ensuring high levels of data quality excite you?About the RoleThis is a great opportunity to join an international healthcare manufacturer on a...

  • Data Engineer

    3 weeks ago

    Manchester Area, United Kingdom MBN Solutions Full time

    Azure Data Engineer Greater Manchester (Hybrid) Up to £60,000 DOE Are you an experienced Data Engineer looking for your next move? Does establishing a new Data Warehouse capability, promoting a data-driven culture, and ensuring high levels of data quality excite you? About the Role This is a great opportunity to join an international healthcare...

  • Data Engineer

    3 weeks ago

    Manchester Area, United Kingdom Adria Solutions Ltd Full time

    Data EngineerWe are seeking a Data Engineer to join our friendly team. Our client is building a new data platform centred around a Microsoft SQL server-based data warehouse that runs on AWS RDS. This role is crucial in expanding our client's data capabilities and supporting the launch of our new platform and mobile app.Key Responsibilities:Support and...

  • Data Engineer

    2 weeks ago

    Manchester Area, United Kingdom Adria Solutions Ltd Full time

    Data EngineerWe are seeking a Data Engineer to join our friendly team. Our client is building a new data platform centred around a Microsoft SQL server-based data warehouse that runs on AWS RDS. This role is crucial in expanding our client's data capabilities and supporting the launch of our new platform and mobile app.Key Responsibilities:Support and...