Platform Engineer

1 week ago

Colindale, United Kingdom Reed Talent Solutions Full time

**Essential Criteria**
- Strong at python, unit testing (pytest) and pep8 standards
- Writing robust data pipeline code that can run unattended
- Pandas data validation, manipulation, merging, joining and at times visualisation
- Experience of designing and developing CI/CD pipelines and provisioning resources using infrastructure as code, including DevOps tooling such as: Gitlab, AWS CodeCommit and CloudFormation, Terraform, Ansible, Vagrant, Docker, Kubernets.
- Ability to troubleshoot and solve numerical and technical problems
- Excellent communication and facilitation skills evidenced through verbal and written means to a wide range of stakeholders
- Experience with Agile delivery
- Technically proficient expert in MS Azure, Data Bricks, Data Factory, SQL, Python.
- Experience with publishing data sets for visualisation and analysis and supporting design of data models / data flows
- Ability to work as part of a team to develop and deliver end-to-end data warehouse solutions
- Analytical skill set with an ability to understand data requirements and support the development of data solutions
- Ability to manage in an ambiguous environment, clarifying strategies and plans, giving a sense of direction and purpose for self and team.
- Design, build, maintain, test and deploy data pipelines including quality assurance
- Extract, transform and load data from multiple source systems
- +5 years as a Senior Data Engineer / Data Engineer

**Desirable Criteria**

Skills, knowledge or equivalent experience in:

- Machine learning for engineering practices, such as meta driven intelligent ETL and pipeline processes
- Experience of working with JIRA (or Azure DevOps or similar tools) within an Agile/Scrum environment
- Experience/understanding of software and data lifecycle management
- Educated to degree level (not essential, experience is key). Relevant numerate, technical or computer science discipline would be an advantage
- Have 3 - 5 years’ experience of working as a platform engineer on business as usual and projects which address complex data processing and advanced analytic problems.
- Will have a technology background including software development and a detailed understanding of DevOps practices
- Experience of working within agile teams, using collaboration tools like Confluence and Jira
- Hands on ETL development experience utilizing Microsoft enterprise stack / Azure and AWS Glue

  • Assistant Design Engineer

    6 days ago

    Colindale, Greater London, United Kingdom Barnet Council Full time

    About Barnet CouncilBarnet is a borough with much to be proud of. Our excellent schools, vibrant town centres, vast green spaces, and diverse communities all help make it a wonderful place to live and work. As a council we want to build on these strengths as we move into the future. We are growing and developing as an organisation to meet the challenges...

  • Assistant Design Engineer

    1 week ago

    Colindale, United Kingdom Barnet Council Full time

    **About Barnet Council** Barnet is a borough with much to be proud of. Our excellent schools, vibrant town centres, vast green spaces, and diverse communities all help make it a wonderful place to live and work. As a council we want to build on these strengths as we move into the future. We are growing and developing as an organisation to meet the...

  • Product Owner

    2 months ago

    Colindale, United Kingdom Reed Talent Solutions Full time

    You will work in the Data Engineering and Enablement Division that reports into the Data Operations Directorate. It’s an exciting time to join as we seek to create leading Health Protection data capabilities that enable data scientists and data analyststo develop insights that inform public health decisions with resilience platforms and curated data...

  • Service Support Analyst

    1 week ago

    Colindale, United Kingdom Reed Talent Solutions Full time

    You will work in the Data Engineering and Enablement Division that reports into the Data Operations Directorate. It’s an exciting time to join as we seek to create leading Health Protection data capabilities that enable data scientists and data analyststo develop insights that inform public health decisions with resilience platforms and curated data...

  • Head of Data Quality Delivery

    2 months ago

    Colindale, United Kingdom Reed Talent Solutions Full time

    **Main duties of the job** You will work in the Data Engineering and Enablement Division that reports into the Data Operations Directorate, and you will report to the Deputy Director of Engineering and Enablement. It’s an exciting time to join as we seek to create leading Health Protection data capabilities that enable data scientists and data analysts...

  • Scrum Master

    1 week ago

    Colindale, United Kingdom Reed Talent Solutions Full time

    You will possess strong relationship management, excellent communication and influencing skills both verbal and written with the ability to liaise at all levels. You will have a balance of both technical awareness and business acumen and the ability to manage in an ambiguous environment, clarifying strategies and plans, giving a sense of direction and...

  • Head of Data Quality Strategy

    2 months ago

    Colindale, United Kingdom Reed Talent Solutions Full time

    **Main duties of the job** You will work in the Data Engineering and Enablement Division that reports into the Data Operations Directorate, and you will report to the Deputy Director of Engineering and Enablement. It’s an exciting time to join as we seek to create leading Health Protection data capabilities that enable data scientists and data analysts...