AWS Data Engineer

2 days ago

Telford, United Kingdom Infinity Quest Full time

AWS Data Engineer

Role Type: Permanent

Location: Telford, UK

Hybrid – 2 days’ work from Telford office


Role : AWS Data Engineer


• Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams.

• Collaborate with stakeholders to gather requirements and design efficient data streaming architectures for real-time analytics, monitoring, and alerting.

• Build and optimize Kinesis Data Streams, Kinesis Data Firehose, and Kinesis Data Analytics to process real-time data from various sources.

• Develop and implement ETL processes to transform, enrich, and aggregate streaming data for downstream consumption in data lakes or data warehouses such as AWS S3, Redshift, and DynamoDB.

• Integrate Kinesis with other AWS services like Lambda, S3, and EMR for real-time data ingestion, processing, and storage.

• Optimize streaming applications for performance and scalability, ensuring efficient resource usage and minimal latency.

• Develop and maintain robust error handling, data validation, and retry mechanisms within Kinesis pipelines to ensure data consistency and reliability.

• Implement security best practices for data streaming, including encryption in transit and at rest, access control using IAM roles and policies, and data retention policies.

• Monitor and troubleshoot AWS Kinesis streams using CloudWatch metrics, alarms, and logs, ensuring high availability and minimal downtime.

• Collaborate with DevOps teams to automate the deployment and scaling of streaming pipelines using AWS CloudFormation, Lambda, and CI/CD tools.

• Work closely with data analysts and data scientists to ensure real-time data is processed and delivered for immediate insights and reporting.

• Implement data partitioning, sharding, and key management strategies to handle high-throughput data streams and ensure scalability.

• Optimize the cost of real-time data processing by tuning the configurations of Kinesis and associated AWS services like Lambda and Firehose.

• Stay current with AWS updates and best practices for streaming data, recommending improvements to the architecture as new features and services become available.

• Provide guidance and mentorship to junior engineers in real-time data processing, ensuring best practices in streaming technologies and AWS cloud services.

• Create and maintain detailed technical documentation for data pipelines, including data flow diagrams, stream processing logic, and operational guidelines.

  • AWS Data Engineer

    7 days ago

    Telford, United Kingdom LSA Recruit Full time

    Job Description We have an exciting job opportunity for AWS Data Engineer role at Telford, UK - Permanent . Title: AWS Data Engineer Location: Telford, UK Duration: Permanent Job Description: Design, develop, and maintain Real Time data streaming pipelines using AWS Kinesis for processing and analysing high-velocity data streams. Collaborate with...

  • AWS Data Engineer

    2 days ago

    Telford, United Kingdom Infinity Quest Full time

    AWS Data Engineer Role Type: Permanent Location: Telford, UK Hybrid – 2 days’ work from Telford officeRole : AWS Data Engineer • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams.• Collaborate with stakeholders to gather requirements and design efficient data...

  • AWS Data Engineer

    2 days ago

    Telford, United Kingdom Infinity Quest Full time

    AWS Data Engineer Role Type: Permanent Location: Telford, UK Hybrid – 2 days’ work from Telford officeRole : AWS Data Engineer • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams.• Collaborate with stakeholders to gather requirements and design efficient data...

  • AWS Data Engineer

    2 days ago

    Telford, United Kingdom Infinity Quest Full time

    AWS Data Engineer Role Type: Permanent Location: Telford, UK Hybrid – 2 days’ work from Telford office Role : AWS Data Engineer • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams. • Collaborate with stakeholders to gather requirements and...

  • AWS Data Engineer

    3 days ago

    Telford, United Kingdom Infoplus Technologies UK Limited Full time

    Role : AWS Data Engineer – Kinesis • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams.• Collaborate with stakeholders to gather requirements and design efficient data streaming architectures for real-time analytics, monitoring, and alerting.• Build and optimize...

  • AWS Data Engineer

    4 days ago

    Telford, United Kingdom Infoplus Technologies UK Limited Full time

    Role : AWS Data Engineer – Kinesis • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams.• Collaborate with stakeholders to gather requirements and design efficient data streaming architectures for real-time analytics, monitoring, and alerting.• Build and optimize...

  • AWS Data Engineer

    3 days ago

    Telford, United Kingdom Infoplus Technologies UK Limited Full time

    Role : AWS Data Engineer – Kinesis • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams.• Collaborate with stakeholders to gather requirements and design efficient data streaming architectures for real-time analytics, monitoring, and alerting.• Build and optimize...

  • AWS Data Engineer

    4 days ago

    Telford, United Kingdom Infinity Quest Full time

    Role Type: PermanentLocation: Telford, UKHybrid – 2 days’ work from Telford officeSalary: 70K GBP/Annum AWS Data Engineer • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams.• Collaborate with stakeholders to gather requirements and design efficient data...

  • AWS Data Engineer

    4 days ago

    Telford, United Kingdom Infinity Quest Full time

    Role Type: PermanentLocation: Telford, UKHybrid – 2 days’ work from Telford officeSalary: 70K GBP/Annum AWS Data Engineer • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams.• Collaborate with stakeholders to gather requirements and design efficient data...

  • AWS Data Engineer

    2 days ago

    Telford, Shropshire, United Kingdom Infinity Quest Full time

    AWS Data Engineer Role Type: Permanent Location: Telford, UK Hybrid – 2 days’ work from Telford office Role : AWS Data Engineer • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams. • Collaborate with stakeholders to gather requirements and design efficient...

  • AWS Data Engineer

    3 days ago

    Telford, Shropshire, United Kingdom Infinity Quest Full time

    AWS Data Engineer Role Type: Permanent Location: Telford, UK Hybrid – 2 days’ work from Telford office Role : AWS Data Engineer • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams. • Collaborate with stakeholders to gather requirements and design efficient...

  • AWS Data Engineer

    4 days ago

    Telford, Shropshire, United Kingdom Infoplus Technologies UK Limited Full time

    Role : AWS Data Engineer – Kinesis • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams. • Collaborate with stakeholders to gather requirements and design efficient data streaming architectures for real-time analytics, monitoring, and alerting. • Build and...

  • AWS Data Engineer

    4 days ago

    Telford, UK, Shropshire, United Kingdom Infinity Quest Full time

    Role Type: PermanentLocation: Telford, UKHybrid – 2 days’ work from Telford officeSalary: 70K GBP/Annum AWS Data Engineer • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams.• Collaborate with stakeholders to gather requirements and design efficient data...

  • Data Engineer Contract

    4 weeks ago

    Telford, United Kingdom eTeam Full time

    Job title Data Engineer Contract :Telford 6 Month Contract Skills: Talend, Client RDBMS, AWS, CICD, Talend ETL, ETL SC is required for this role. We require a software engineer with experience of ETL tooling and processes, ideally within Talend and usage of Client RDS databases. Software engineering experience ETL projects and development. Talend ...

  • Data Engineer Contract

    4 weeks ago

    Telford, Shropshire, United Kingdom eTeam Full time

    Job title Data Engineer Contract :Telford 6 Month Contract Skills: Talend, Client RDBMS, AWS, CICD, Talend ETL, ETL SC is required for this role. We require a software engineer with experience of ETL tooling and processes, ideally within Talend and usage of Client RDS databases. Software engineering experience ETL projects and development. Talend ...

  • Data Engineer Contract

    4 weeks ago

    Telford, Shropshire, United Kingdom eTeam Full time

    Job title Data Engineer Contract :Telford 6 Month Contract Skills: Talend, Client RDBMS, AWS, CICD, Talend ETL, ETL SC is required for this role. We require a software engineer with experience of ETL tooling and processes, ideally within Talend and usage of Client RDS databases. Software engineering experience ETL projects and development. Talend ...

  • AWS Cloud Data Migration Specialist

    1 week ago

    Telford, Telford and Wrekin, United Kingdom Adroit People Ltd. Full time

    Job Description - Cloud Data Migration EngineerAt Adroit People Ltd., we're seeking a skilled Cloud Data Migration Engineer to lead end-to-end data migration projects. Your expertise will be essential in planning, mapping, extracting, transforming, loading, and validating large volumes of structured and unstructured data across various environments.We're...

  • Data Engineer

    4 weeks ago

    Telford, United Kingdom eTeam Full time

    Role- Data Engineer x 2 Telford 6 Month Contract Contract Inside IR35 SC clearance is mandatory. You should have experience as a Software Engineer delivering within large scale data analytics solutions and the ability to operate at all stages of the software engineering lifecycle, as well as some experience in the following; • Awareness of devops culture...

  • AWS Cloud Infrastructure Engineer

    4 weeks ago

    Telford, Telford and Wrekin, United Kingdom Digital Waffle Full time

    Job Title:Lead DevOps Engineer (AWS)Location: Telford, UK (Hybrid)Salary: up to £80k per annum + 20% bonusWe are seeking a highly skilled AWS DevOps Lead to join our team at Digital Waffle. As a key member of our cloud infrastructure team, you will be responsible for designing, implementing, and maintaining our cloud infrastructure on AWS.Key...

  • AWS Cloud Infrastructure Engineer

    4 weeks ago

    Telford, Telford and Wrekin, United Kingdom Digital Waffle Full time

    Job Title:Lead DevOps Engineer (AWS)Location: Telford, UK (Hybrid)Salary: up to £80k per annum + 20% bonusWe are seeking a highly skilled AWS DevOps Lead to join our team at Digital Waffle. As a key member of our cloud infrastructure team, you will be responsible for designing, implementing, and maintaining our cloud infrastructure on AWS.Key...