AWS Data Engineer
2 weeks ago
Role Type: Permanent
Location: Telford, UK
Hybrid – 2 days’ work from Telford office
Salary: 70K GBP/Annum
AWS Data Engineer
• Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams.
• Collaborate with stakeholders to gather requirements and design efficient data streaming architectures for real-time analytics, monitoring, and alerting.
• Build and optimize Kinesis Data Streams, Kinesis Data Firehose, and Kinesis Data Analytics to process real-time data from various sources.
• Develop and implement ETL processes to transform, enrich, and aggregate streaming data for downstream consumption in data lakes or data warehouses such as AWS S3, Redshift, and DynamoDB.
• Integrate Kinesis with other AWS services like Lambda, S3, and EMR for real-time data ingestion, processing, and storage.
• Optimize streaming applications for performance and scalability, ensuring efficient resource usage and minimal latency.
• Develop and maintain robust error handling, data validation, and retry mechanisms within Kinesis pipelines to ensure data consistency and reliability.
• Implement security best practices for data streaming, including encryption in transit and at rest, access control using IAM roles and policies, and data retention policies.
• Monitor and troubleshoot AWS Kinesis streams using CloudWatch metrics, alarms, and logs, ensuring high availability and minimal downtime.
• Collaborate with DevOps teams to automate the deployment and scaling of streaming pipelines using AWS CloudFormation, Lambda, and CI/CD tools.
• Work closely with data analysts and data scientists to ensure real-time data is processed and delivered for immediate insights and reporting.
• Implement data partitioning, sharding, and key management strategies to handle high-throughput data streams and ensure scalability.
• Optimize the cost of real-time data processing by tuning the configurations of Kinesis and associated AWS services like Lambda and Firehose.
• Stay current with AWS updates and best practices for streaming data, recommending improvements to the architecture as new features and services become available.
• Provide guidance and mentorship to junior engineers in real-time data processing, ensuring best practices in streaming technologies and AWS cloud services.
• Create and maintain detailed technical documentation for data pipelines, including data flow diagrams, stream processing logic, and operational guidelines.
-
Cloud Engineer
2 weeks ago
Telford, UK, Shropshire, United Kingdom SmartChoice International Limited Full timeCLOUD ENGINEER - AMAZON CONNECTKey Responsibilities:Technical Implementation: Work closely with senior engineers and architects to design, test, and implement contact center solutions.AWS Expertise: Utilize your knowledge of AWS services (Lambda, DynamoDB, S3, SNS, Lex, API Gateway, Pinpoint, etc.) to help create effective contact center systems.Amazon...
-
Control Engineer
2 months ago
Telford, UK, Shropshire, United Kingdom Wynne Consulting Full time2 roles for Control/Automation EngineersMidlandsCurrent working with one of our brilliant Wynne Talent Partner clients.The Controls Engineer will be responsible for the design, development, commissioning and acceptance of automated assembly lines and machines. Full life cycle responsibilities of projects include designing to customer standards, producing an...
-
Technology Solution Architect
1 week ago
Telford, UK, Shropshire, United Kingdom Infinity Quest Full timeRole : Technology Solution ArchitectLocation: Sheffield UK (2-3 days per week onsite)Note we need profiles based north to travel into Sheffield / Leeds 2-3 days a week (Manchester, Leeds, Sheffield triangle or prepared to travel at own expense)ROle Type: PermanentSalary : 110K GBP Must have a banking domain) banking modernization. Lending Mortgage exp...
-
Senior Development Engineer
3 weeks ago
Shrewsbury, UK, Shropshire, United Kingdom PE Global Full timePE Global is recruiting a Senior Development Engineer for our multinational industrial machinery manufacturing client located in Shrewsbury. The role is an initial 12 month contract and is hybrid with an immediate start. Responsibilities:Support to planning (resource profiling and costing of verification and validation) engineering programs.Creating detailed...
-
Production Manager
4 weeks ago
Telford, UK, Shropshire, United Kingdom Gleeson Recruitment Group Full timeOverview: The Production Manager plays a vital role in overseeing daily production operations, ensuring a safe work environment, and meeting customer requirements across all three shifts.Key Responsibilities:Develop strategic plans for the HPDC production department to align with customer and business needs, including scheduling for prototype runs,...
-
Senior Development Engineer
2 weeks ago
Shrewsbury, UK, Shropshire, United Kingdom Innova Solutions International Full timeSenior Development Engineer, Contract, Shrewsbury, hybridThe Senior Development Engineer role focuses on the verification and validation needs of powertrain products for primarily the defence land systems segment. The successful incumbent will play a leading technical role in areas such as component resourcing validation, post design services reporting,...
-
Lead Applications Engineer
2 months ago
Four Ashes, UK, Shropshire, United Kingdom SI Group Full timeLocation: Initially Manchester, relocating to Wolverhampton in 2025At SI Group, we aspire for all employees to live and work to their full potential. We foster a unique environment where each employee is empowered to create value for our business with a commitment to safety and compliance. We promote personal and professional success that aligns with...
-
Four Ashes, UK, Shropshire, United Kingdom SI Group Full timeAt SI Group, we aspire for all employees to live and work to their full potential. We foster a unique environment where each employee is empowered to create value for our business with a commitment to safety and compliance. We promote personal and professional success that aligns with productivity and extraordinary results. Become a Catalyst for Change and...
-
AWS Data Engineer
2 weeks ago
Telford, United Kingdom Infinity Quest Full timeAWS Data Engineer Role Type: Permanent Location: Telford, UK Hybrid – 2 days’ work from Telford officeRole : AWS Data Engineer • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams.• Collaborate with stakeholders to gather requirements and design efficient data...
-
AWS Data Engineer
2 weeks ago
Telford, United Kingdom Infinity Quest Full timeAWS Data Engineer Role Type: Permanent Location: Telford, UK Hybrid – 2 days’ work from Telford office Role : AWS Data Engineer • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams. • Collaborate with stakeholders to gather requirements and...
-
AWS Data Engineer
2 weeks ago
Telford, United Kingdom Infinity Quest Full timeAWS Data Engineer Role Type: Permanent Location: Telford, UK Hybrid – 2 days’ work from Telford officeRole : AWS Data Engineer • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams.• Collaborate with stakeholders to gather requirements and design efficient data...
-
AWS Data Engineer
2 weeks ago
Telford, United Kingdom LSA Recruit Full timeJob Description We have an exciting job opportunity for AWS Data Engineer role at Telford, UK - Permanent . Title: AWS Data Engineer Location: Telford, UK Duration: Permanent Job Description: Design, develop, and maintain Real Time data streaming pipelines using AWS Kinesis for processing and analysing high-velocity data streams. Collaborate with...
-
AWS Data Engineer
2 weeks ago
Telford, United Kingdom Infinity Quest Full timeAWS Data Engineer Role Type: Permanent Location: Telford, UK Hybrid – 2 days’ work from Telford office Role : AWS Data Engineer • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams. • Collaborate with stakeholders to gather requirements and design...
-
AWS Data Engineer
2 weeks ago
Telford, United Kingdom Infoplus Technologies UK Limited Full timeRole : AWS Data Engineer – Kinesis • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams.• Collaborate with stakeholders to gather requirements and design efficient data streaming architectures for real-time analytics, monitoring, and alerting.• Build and optimize...
-
AWS Data Engineer
2 weeks ago
Telford, United Kingdom Infoplus Technologies UK Limited Full timeRole : AWS Data Engineer – Kinesis • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams.• Collaborate with stakeholders to gather requirements and design efficient data streaming architectures for real-time analytics, monitoring, and alerting.• Build and optimize...
-
AWS Data Engineer
2 weeks ago
Telford, United Kingdom Infoplus Technologies UK Limited Full timeRole : AWS Data Engineer – Kinesis • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams.• Collaborate with stakeholders to gather requirements and design efficient data streaming architectures for real-time analytics, monitoring, and alerting.• Build and optimize...
-
AWS Data Engineer
2 weeks ago
Telford, United Kingdom Infinity Quest Full timeRole Type: PermanentLocation: Telford, UKHybrid – 2 days’ work from Telford officeSalary: 70K GBP/Annum AWS Data Engineer • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams.• Collaborate with stakeholders to gather requirements and design efficient data...
-
AWS Data Engineer
2 weeks ago
Telford, Shropshire, United Kingdom Infinity Quest Full timeAWS Data Engineer Role Type: Permanent Location: Telford, UK Hybrid – 2 days’ work from Telford office Role : AWS Data Engineer • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams. • Collaborate with stakeholders to gather requirements and design efficient...
-
AWS Data Engineer
2 weeks ago
Telford, Shropshire, United Kingdom Infinity Quest Full timeAWS Data Engineer Role Type: Permanent Location: Telford, UK Hybrid – 2 days’ work from Telford office Role : AWS Data Engineer • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams. • Collaborate with stakeholders to gather requirements and design efficient...
-
AWS Data Engineer
18 hours ago
Telford, United Kingdom Infoplus Technologies UK Ltd Full timeJob Description Role: AWS Data Engineer - Kinesis (Band 3) Design, develop, and maintain Real Time data streaming pipelines using AWS Kinesis for processing and analysing high-velocity data streams. Collaborate with stakeholders to gather requirements and design efficient data streaming architectures for Real Time analytics, monitoring, and alerting. ...
-
AWS Data Engineer
2 weeks ago
Telford, Shropshire, United Kingdom Infoplus Technologies UK Limited Full timeRole : AWS Data Engineer – Kinesis • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams. • Collaborate with stakeholders to gather requirements and design efficient data streaming architectures for real-time analytics, monitoring, and alerting. • Build and...
-
Data Engineer Contract
1 month ago
Telford, United Kingdom eTeam Full timeJob title Data Engineer Contract :Telford 6 Month Contract Skills: Talend, Client RDBMS, AWS, CICD, Talend ETL, ETL SC is required for this role. We require a software engineer with experience of ETL tooling and processes, ideally within Talend and usage of Client RDS databases. Software engineering experience ETL projects and development. Talend ...
-
Data Engineer Contract
1 month ago
Telford, Shropshire, United Kingdom eTeam Full timeJob title Data Engineer Contract :Telford 6 Month Contract Skills: Talend, Client RDBMS, AWS, CICD, Talend ETL, ETL SC is required for this role. We require a software engineer with experience of ETL tooling and processes, ideally within Talend and usage of Client RDS databases. Software engineering experience ETL projects and development. Talend ...
-
Data Engineer Contract
1 month ago
Telford, Shropshire, United Kingdom eTeam Full timeJob title Data Engineer Contract :Telford 6 Month Contract Skills: Talend, Client RDBMS, AWS, CICD, Talend ETL, ETL SC is required for this role. We require a software engineer with experience of ETL tooling and processes, ideally within Talend and usage of Client RDS databases. Software engineering experience ETL projects and development. Talend ...
-
AWS Cloud Data Migration Specialist
3 weeks ago
Telford, Telford and Wrekin, United Kingdom Adroit People Ltd. Full timeJob Description - Cloud Data Migration EngineerAt Adroit People Ltd., we're seeking a skilled Cloud Data Migration Engineer to lead end-to-end data migration projects. Your expertise will be essential in planning, mapping, extracting, transforming, loading, and validating large volumes of structured and unstructured data across various environments.We're...
-
SC Cleared Data Engineer
4 weeks ago
UK, UK, United Kingdom Focus on WD Full timeJob Title: Azure & AWS Data Engineer Contract Length: 4 Months (Outside IR35) Location: Remote, with occasional on-site presence in London (approx. once a month) Client: Consultancy Firm based in London Job Description: We are seeking an experienced Azure & AWS Data Engineer to join our client, a dynamic consultancy based in London, on a 4-month contract....
-
Senior Data Engineer Python Spark AWS
3 weeks ago
London, UK, UK, United Kingdom Client Server Full timeSenior Data Engineer (Python Spark AWS) Remote UK to £90kAre you a tech savvy Data Engineer with strong Python coding skills?You could be progressing your career in a senior, hands-on Data Engineer role as part of a friendly and supportive international team at a growing and hugely successful European car insurance tech company as they expand their UK...
-
Data Engineering Lead
3 weeks ago
London, UK, UK, United Kingdom Datatech Analytics Full timeData Engineering Lead – AWS & SnowflakeHybrid working: 3 days in TW6, Middlesex offices & 2 days homer/remoteSalary: Negotiable to £70,000 DOE plus 40 % bonus potentialJob Reference: J12869Full UK working rights required/no sponsorship availableTHE ROLELooking for a challenge in one of the world’s largest airfreight logistics organisation and a FTSE 100...