AWS Solutions Engineer

5 days ago

London, Greater London, United Kingdom Crane Venture Partners Full time

**Role Overview**

The DevOps Engineer - ML Pipeline Specialist will be responsible for creating a CI/CD pipeline for building containers from in-house Python packages, running integration tests, and publishing to AWS ECR. You will also set up ECS or AWS Batch Tasks to run containers stored in AWS ECR and establish a robust configuration management system to store, version, and retrieve configurations associated with multiple machine learning workflows.

Additionally, you will implement robust error handling and monitoring solutions to ensure timely debugging across the pipeline with centralised logging and error reporting. A key aspect of this role is implementing cost monitoring solutions to track and manage compute costs across different runs, building dashboards to provide insights into resource usage and cost optimization.

In collaboration with the team, you will ensure security and data protection are integrated into the pipelines by applying AWS best practices for security protocols and data management. You will also monitor and manage the team's compute resources, including both cloud (AWS) and on-premise GPU nodes, ensuring efficient use and scalability.

**Key Responsibilities:**

  • Create a CI/CD pipeline for building containers from in-house Python packages, running integration tests, and publishing to AWS ECR.
  • Set up ECS or AWS Batch Tasks to run containers stored in AWS ECR.
  • Establish a robust configuration management system to store, version, and retrieve configurations associated with multiple machine learning workflows.
  • Implement robust error handling and monitoring solutions to ensure timely debugging across the pipeline with centralised logging and error reporting.
  • Implement cost monitoring solutions to track and manage compute costs across different runs, building dashboards to provide insights into resource usage and cost optimization.
  • Ensure security and data protection are integrated into the pipelines by applying AWS best practices for security protocols and data management.
  • Monitor and manage the team's compute resources, including both cloud (AWS) and on-premise GPU nodes, ensuring efficient use and scalability.

**Requirements:**

  • Detailed knowledge of Git or Bitbucket for version control, including experience with managing versioned infrastructure-as-code (IaC) repositories.
  • Certification in one or more AWS services such as ECS, Batch, or CloudFormation.
  • Experience with containerization tools like Docker and Kubernetes.
  • Excellent communication skills and ability to collaborate with cross-functional teams.

**What We Offer:**

  • A competitive salary of **£80,000 - £110,000 per annum**, depending on experience.
  • A comprehensive benefits package, including private medical insurance, dental insurance, and a company pension scheme.
  • A generous holiday allowance of 25 days per year, plus bank holidays.
  • The opportunity to work on challenging projects and develop your skills in a dynamic environment.
  • A collaborative and supportive team culture.

  • AWS Solutions Engineer

    6 days ago

    London, Greater London, United Kingdom Search 5.0 Full time

    Solutions Engineer Role in FintechWe are seeking an experienced Solutions Engineer to help us design and implement cloud-native solutions that drive our core applications. As a Solutions Engineer, you will play a key role in this process, working closely with cross-functional teams to deliver high-quality solutions.Key Responsibilities:Help to build and...

  • AWS Solutions Engineer

    7 days ago

    London, Greater London, United Kingdom NP Group Full time

    About the JobWe are seeking a highly skilled AWS Solutions Engineer to join our team. As a Senior DevOps Specialist, you will be responsible for designing and implementing cutting-edge cloud solutions for our clients.About the TeamWe are a dynamic and innovative team dedicated to delivering exceptional technology solutions to the financial services...

  • AWS Solutions Engineer

    7 days ago

    London, Greater London, United Kingdom Fruition IT Full time £95,000

    AWS Solutions Architect / Engineer required for a leading UK consultancy. In this challenging role, you will be responsible for designing and building comprehensive infrastructure solutions using AWS. You will work closely with our team to deliver top-notch migration and modernisation projects to SMBs across the UK.Key responsibilities include:• Designing...

  • AWS Solutions Engineer

    2 days ago

    London, Greater London, United Kingdom Salt Full time

    We have partnered with a forward-thinking financial institution committed to driving innovation and operational excellence within their Payments Technology division. Our team plays a critical role in building scalable, secure, and mission-critical infrastructure that powers transformative digital solutions.As an AWS Solutions Engineer, you will be...

  • AWS Solutions Engineer

    5 days ago

    London, Greater London, United Kingdom Lynx Recruitment Full time

    Lynx Recruitment offers a challenging and rewarding opportunity as an AWS Solutions Engineer. You will work closely with stakeholders to translate requirements into technical specifications and develop robust software solutions using AWS, Node, Java, C#, JavaScript, React, and Typescript.About the JobThe estimated salary for this role is £100,000 -...

  • AWS Solutions Engineer

    17 hours ago

    London, Greater London, United Kingdom Anson McCade Full time £60,000 - £100,000

    About the Role: We are seeking a talented AWS Solutions Engineer to join our platform engineering team at Anson McCade. As a key member of our team, you will be responsible for designing, implementing, and maintaining scalable and secure cloud-based systems using AWS services. You will work closely with cross-functional teams to identify business needs and...

  • AWS Solutions Architect

    5 days ago

    London, Greater London, United Kingdom Electus Recruitment Solutions Full time

    Role Summary:\This Senior Geospatial Systems Engineer role is an excellent opportunity to join a dynamic team focused on delivering complex GIS solutions. As a key member of our Geospatial Engineering team, you will lead the design and deployment of geospatial systems, particularly Esri ArcGIS Enterprise.\The ideal candidate will have extensive experience in...

  • AWS Cloud Solutions Engineer

    1 week ago

    London, Greater London, United Kingdom InfoSec People Ltd Full time £60,000 - £70,000

    Job Title: AWS Cloud Solutions EngineerWe are seeking a highly skilled AWS Cloud Solutions Engineer to join our team at InfoSec People Ltd in Central London. As a proactive self-starter, you will take ownership of your work, contribute to cutting-edge cloud-based projects, and progress your career within a business offering a clear pathway to Senior and...

  • AWS Cloud Solutions Engineer

    4 weeks ago

    London, Greater London, United Kingdom CV Library Full time

    Job Opening: AWS Cloud Solutions Engineer at CV LibraryAbout the PositionWe are seeking an experienced AWS Cloud Solutions Engineer to join our team. As a Cloud Solutions Engineer, you will be responsible for designing, building, and deploying cloud-based solutions for our clients using Amazon Web Services (AWS).In this role, you will have the opportunity to...

  • AWS Engineer Position with MBN Solutions

    15 hours ago

    London, Greater London, United Kingdom MBN Solutions Full time £55,000 - £65,000

    Job Summary:MBN Solutions, in partnership with a leading Financial Services Consulting firm, seeks a seasoned AWS Engineer to join their growing IT team. As a key contributor, you will drive innovation and support the organization's technological advancement. Your primary responsibilities include designing and implementing custom solutions using Power Apps,...

  • AWS Cloud Solutions Engineer

    6 days ago

    London, Greater London, United Kingdom ZipRecruiter Full time

    Job Title: AWS Cloud Solutions EngineerWe are looking for an experienced AWS Cloud Solutions Engineer to join our team at ZipRecruiter. As a key member of our technical strategy team, you will work closely with our CTO and Head of Architecture to design and implement secure, efficient, and scalable data solutions.About the Role:You will have strong...

  • AWS Solutions Leader

    17 hours ago

    London, Greater London, United Kingdom Lorien Full time

    We are looking for an experienced AWS Solutions Leader to join our team at Lorien in Central London. As a key member of our engineering team, you will be responsible for leading our AWS solutions from concept to delivery, ensuring they meet the highest standards of quality and customer satisfaction.About the RoleThis is a varied and challenging role that...

  • AWS Cloud Engineer

    4 weeks ago

    London, Greater London, United Kingdom Opus Recruitment Solutions Full time

    Job Title:AWS Senior Data EngineerAbout the Role:We are seeking a highly skilled AWS Senior Data Engineer to join our next-gen data & analytics consultancy.Key Responsibilities:Design, build, and maintain large-scale data processing systems on AWS.Collaborate with cross-functional teams to deliver data-driven solutions.Develop and implement data engineering...

  • AWS Solutions Engineer

    4 weeks ago

    London, Greater London, United Kingdom Amazon Full time

    Company OverviewAmazon Web Services (AWS) is the world's most comprehensive and broadly adopted cloud platform. As a Data Warehousing Solutions Architect, you will be part of the AWS sales organization, working with customers who have complex challenges that require expert-level knowledge to solve. Your role will involve crafting scalable, flexible, and...

  • AWS Cloud Solutions Engineer

    5 days ago

    London, Greater London, United Kingdom Entasis Partners Full time

    We are seeking a highly skilled AWS Cloud Solutions Engineer to join our team. This is a 12-month contract role, working inside IR35.The successful candidate will have advanced AWS expertise and be responsible for designing and managing secure, scalable containerised applications on EKS.This role focuses on enhancing security operations, with a strong...

  • AWS Cloud Engineer

    5 days ago

    London, Greater London, United Kingdom Macquarie Bank Limited Full time

    **Commodities and Global Markets Data Analytics Team Overview**The Commodities and Global Markets team within technology is building a leading data and analytics platform to drive business growth. As a senior Data Engineer, you will be part of this team and work closely with traders, quants, desk analysts, and central data teams to provide innovative data...

  • AWS Solutions Developer

    1 week ago

    London, Greater London, United Kingdom Lorien Full time

    Job OverviewLorien's client, a leading provider of Cloud, Infrastructure and transformational services/solutions, seeks an experienced AWS Solutions Architect / Solutions Expert. This role combines project involvement and architecture expertise, offering a unique blend of responsibilities.The ideal candidate will have a proven background in AWS solutions...

  • Senior Software Engineer

    7 days ago

    London, Greater London, United Kingdom Axiom Software Solutions Limited Full time

    Job Title: Senior Software Engineer - AWSAxiom Software Solutions Limited is seeking an accomplished Senior Software Engineer to join our team and drive the development of cutting-edge cloud-based solutions on AWS. As a key member of our engineering team, you will work closely with cross-functional teams to design, develop, and deploy high-quality software...

  • AWS Cybersecurity Engineer

    7 days ago

    London, Greater London, United Kingdom Opus Recruitment Solutions Full time £15

    Job Description:We are seeking an experienced AWS Cybersecurity Engineer to join our team at Opus Recruitment Solutions. The successful candidate will have a strong background in cloud security and experience with AWS services and serverless technologies.Key Responsibilities:Design and implement secure cloud-based architectures using AWS servicesDevelop and...

  • AWS Partner Solutions Engineer

    4 weeks ago

    London, Greater London, United Kingdom Amazon Full time

    As a key member of the Amazon team, you will play a crucial role in shaping and delivering our strategy to build strong relationships with partners across the globe. This position requires exceptional technical expertise, excellent communication skills, and the ability to work effectively with diverse stakeholders.Job OverviewThe AWS Partner Solutions...