Lead Data Engineer

1 month ago

Islington, United Kingdom Rail Safety and Standards Board Full time

Fixed Term Contract

The Lead Data Engineer will lead agile data engineering activities as a technical leader, delivering data and insights products to the rail industry.

You will understand the business and IT strategy to align technical solutions with outcomes, develop APIs and integrations to transfer data between systems and deliver aggregated data solutions.

You will develop both quick prototypes and high-quality products, judging which is needed. The role will also coach data engineers and undertake code reviews to ensure the team can continue to deliver sustainable solutions.

Responsibilities

Lead ambiguous and complex data engineering projects as a technical leader.

Design, code, test, and document data applications, applying software engineering best practices.

Initiate the development and management of scalable APIs, machine learning endpoints, data integration pipelines and data storage solutions.

Influence the information strategy and platform architecture to align technical solutions with outcomes.

Influence new Data Engineering tools, frameworks, standards, and processes to improve the productivity and quality of outputs for Data Engineers across the team.

Ensure that agreed standards and tools are applied to achieve well-engineered outcomes, and that own work and that of colleagues meets coding standards, through code review processes.

Ensure technical solutions support the accessibility, retrievability, security, quality, retention, and ethical handling of specific sets of data.

Qualifications

Essential

BSc in a scientific or computer science discipline.

Experience of strategies and design approaches for APIs and data pipelines.

Experience designing and implementing data-driven tools and solutions.

Experience developing scalable data pipelines in Spark/Python using orchestrators such as Airflow.

Experience using SQL, Python, and other scripting/programming to solve a wide array of data challenges.

Experience working with a diverse range of data infrastructure and systems, such as PostgreSQL; SQL Server; Azure data lakes; Data Bricks; Kubernetes.

Communicate effectively and share thoughts and ideas through methods appropriate to the audience.

Adapt and respond effectively when embracing new opportunities, change and in navigating uncertainty.

Actively contribute as part of a team and work towards achieving team goals and outcomes.

Take responsibility and demonstrate accountability in completing tasks and achieving objectives, actively seeking to resolve problems and identify opportunities.

Committed to customer service and placing customer satisfaction at the heart of our success to ensure we deliver against our shared goals.

Can work collaboratively within an evolving industry, gaining stakeholder confidence through understanding their goals and motivations and demonstrating credibility as an expert.

Make timely, informed decisions taking account of the benefits and constraints involved.

Desirable

Experience developing scalable APIs in Python using frameworks such as Fast API or Flask.

We are committed to investing in our staff and offer formal and informal learning opportunities for development.

We value diversity and equal opportunities in employment and are committed to creating a workplace which is inclusive to everyone. As a member of the Disability Confident Scheme, we encourage candidates with disabilities who meet the minimum criteria, to apply for our jobs. If you have applied under the Disability Confident Scheme, please let us know in advance by emailing

If you require any reasonable adjustments with respect to our selection process including information in an alternative format, please contact us at

We understand the importance of work-life balance and we offer our staff the flexibility to work within our core hours and the option to vary their location between both the office and home. If you are looking for further flexibility, speak to us at interview stage so that we can consider your request.

We value our staff and we offer a competitive benefits package to ensure our staff can achieve their best throughout their journey with us. This includes 30 days annual leave (plus bank holidays); a holiday buy and sell scheme; private medical and dental cover; a season ticket loan and travel subsidy; access to a cycle to work scheme; volunteer leave; a performance related bonus and pension.

Fixed-Term Full-Time or Secondment

  • Data Lead for Performance

    1 month ago

    Islington, Norfolk, United Kingdom Aatom Recruitment Full time

    Working on behalf of a Local Authority, Aatom Recruitment has a new opportunity for a Strategic Resourcing Lead on a 3 months contract with a possibility of further extension. Develop an attraction strategy aligned to the client’s workforce strategy, workforce planning ensuring the development of talent pools and pipelines and identify new channels to...

  • Data Quality Coordinator

    1 month ago

    Islington, United Kingdom Islington Council Full time

    We are looking for a Data Quality Coordinator to join the Adult Social Care analytical and performance team. The Data Quality Coordinator role is a new role that is essential in supporting teams to capture accurate data so we can effectively support our residents. This is an exciting opportunity for someone who likes working with people and driving...

  • Quality Engineer

    1 month ago

    Islington, United Kingdom Morgan Fraser Group Limited Full time

    The main purpose of the Quality Engineer is to manage and improve document management system, ensuring full compliance - This is a multi-skilled role where the job holder will be expected to undertake a wide range of internal audits **Main Duties** - Provide metrics that are compliant to, raise issues and manage resolution on: other committed assurance...

  • Senior Mechanical Project Engineer

    4 days ago

    Islington, United Kingdom LJB & Co Full time

    Senior Mechanical Project Engineer - London - CommercialIf you think you are the right match for the following opportunity, apply after reading the complete description.Are you an experienced Mechanical Engineer looking for a challenging role in Central London? Join our client, a prominent Mechanical and Electrical Package Contractor specializing in...

  • Process Dynamic Simulation Lead

    1 month ago

    Islington, Norfolk, United Kingdom FINTEC recruit Full time

    Job Title: Process Dynamic Simulation Lead Energy Industry Type: Permanent, Full-time Salary: Competitive with Benefits Work Arrangement: Flexible and Hybrid Options Available We are currently seeking a skilled Dynamics Simulation Lead to join our esteemed Energy client based in Aberdeen. This permanent position involves working on cutting-edge sustainable...

  • Process Dynamic Simulation Lead

    1 month ago

    Islington, Norfolk, United Kingdom FINTEC recruit Full time

    Job Title: Process Dynamic Simulation Lead Energy Industry Type: Permanent, Full-time Salary: Competitive with Benefits Work Arrangement: Flexible and Hybrid Options Available We are currently seeking a skilled Dynamics Simulation Lead to join our esteemed Energy client based in Aberdeen. This permanent position involves working on cutting-edge sustainable...

  • Senior Project Development Engineer

    5 days ago

    Islington, Norfolk, United Kingdom Carbon60 - Eng&Tech Full time

    Carbon60 are currently working with a leading industrial engineering company to recruit a Senior Project Development Engineer on a permanent basis to support the engineering team in the development of engineering projects, processes and development plans. The position will be on a hybrid basis with the main office being in central London but will require...

  • Civils Project Manager

    2 weeks ago

    Islington, United Kingdom Carrowhugh Group Limited Full time

    Civil Project Manager-Nationwide Carrowhugh recruitment is currently recruiting for Civils Project Managers for a Data and Distribution Centre main contractor that delivers turnkey projects for customers in the fields of logistics, food industry, pharmaceuticals, high-tech production and data centres. The general contractor, working nationwide,...

  • Civils Project Manager

    2 weeks ago

    Islington, United Kingdom Carrowhugh Group Limited Full time

    Civil Project Manager-NationwideCarrowhugh recruitment is currently recruiting for Civils Project Managers for a Data and Distribution Centre main contractor that delivers turnkey projects for customers in the fields of logistics, food industry, pharmaceuticals, high-tech production and data centres.The general contractor, working nationwide, specialising in...

  • Front End Lead Full Time

    1 month ago

    Islington, Norfolk, United Kingdom FINTEC recruit Full time

    Energy Industry Type: Permanent, Full-time Flexible and Hybrid Options Available This permanent position involves working on cutting-edge sustainable emission reduction projects, encompassing electrification, CCUS, Hydrogen, and optimizing existing plants, equipment, and traditional technologies through to production enhancement. Play an active role in...

  • Front End Lead Full Time

    1 month ago

    Islington, Norfolk, United Kingdom FINTEC recruit Full time

    Energy Industry Type: Permanent, Full-time Flexible and Hybrid Options Available This permanent position involves working on cutting-edge sustainable emission reduction projects, encompassing electrification, CCUS, Hydrogen, and optimizing existing plants, equipment, and traditional technologies through to production enhancement. Play an active role in...

  • Employee Relations Lead

    1 month ago

    Islington, Norfolk, United Kingdom Aatom Recruitment Full time

    Main Responsibilities for the role * Identify, develop, and implement service improvements for Employee Relations team e.g, support the design of coaching and training modules for line managers, enhance professional employee relations practice in the ER team and foster a “one team” approach with other HR teams. * Assist Employee Relations Manager...

  • Inspection and Business Improvement Lead

    1 month ago

    Islington, Norfolk, United Kingdom Aatom Recruitment Full time

    Working on behalf of a Local Authority, Aatom Recruitment has a new opportunity for an Inspection and Business Improvement Lead on a 3 months contract with a possibility of further extension. Main purpose of the role: Oversee and drive forward our client’s inspection readiness programme Support Lead Directors with the planning, development and...

  • Senior Electrical Engineer

    1 month ago

    Islington, Norfolk, United Kingdom Beeby Anderson Recruitment Full time

    Work for a leading engineering consultancy specializing in building services. Join a team of experienced engineers and designers providing innovative and sustainable solutions for a range of projects across various sectors, including commercial, residential, education, healthcare and industrial in the UK and Internationally. We are seeking an experienced...

  • Strategic Resourcing Lead

    1 month ago

    Islington, Norfolk, United Kingdom Aatom Recruitment Full time

    Working on behalf of a Local Authority, Aatom Recruitment has a new opportunity for a Strategic Resourcing Lead on a 3 months contract with a possibility of further extension. Main responsibilities: Develop an attraction strategy aligned to the client’s workforce strategy, workforce planning ensuring the development of talent pools and pipelines and...

  • Senior Mechanical Engineer

    1 month ago

    Islington, Norfolk, United Kingdom Beeby Anderson Recruitment Full time

    Work for a leading engineering consultancy specializing in building services. Join a team of experienced engineers and designers providing innovative and sustainable solutions for a range of projects across various sectors, including commercial, residential, education, healthcare and industrial in the UK and Internationally. We are seeking an Senior...

  • MEP Project Engineer

    1 month ago

    Islington, Norfolk, United Kingdom Beeby Anderson Recruitment Full time

    Work for a leading engineering consultancy specializing in building services. Join a team of experienced engineers and designers providing innovative and sustainable solutions for a range of projects across various sectors, including commercial, residential, education, healthcare and industrial in the UK and Internationally. You will have the opportunity to...

  • Mechanical Project Engineer

    4 days ago

    Islington, Norfolk, United Kingdom LJB & Co Full time

    Senior Mechanical Project Engineer - London - Commercial Are you an experienced Mechanical Engineer looking for a challenging role in Central London? Join our client, a prominent Mechanical and Electrical Package Contractor specializing in commercial projects. Immerse yourself in the heart of London's bustling commercial developments, contributing to...

  • Procurement Business Partner

    1 day ago

    Islington, United Kingdom kane recruitment Full time

    To work as part of a dynamic specialist Procurement team to deliver strategic Procurement in line with best practice guidance and leading on specific projects within a portfolio of projects/programmes that deliver high value, improved and cost efficiency savings across the council. Assist the Team Leader in the delivery of the annual work plan ensuring...

  • Data management officer

    1 month ago

    Islington, Norfolk, United Kingdom Aatom Recruitment Full time

    You will lead our payroll service and be responsible for the integrity of our payroll processes, providing strategic and operational direction and leadership. You will lead on the payroll digital improvements as part of our ambitious HR IT Programme You will act as at the council’s expert, liaising with HM Revenue and Customs, ensuring that the payroll...