AWS Data Engineer

4 days ago

Telford Shropshire, United Kingdom Infoplus Technologies UK Limited Full time

Role : AWS Data Engineer – Kinesis

• Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams.

• Collaborate with stakeholders to gather requirements and design efficient data streaming architectures for real-time analytics, monitoring, and alerting.

• Build and optimize Kinesis Data Streams, Kinesis Data Firehose, and Kinesis Data Analytics to process real-time data from various sources.

• Develop and implement ETL processes to transform, enrich, and aggregate streaming data for downstream consumption in data lakes or data warehouses such as AWS S3, Redshift, and DynamoDB.

• Integrate Kinesis with other AWS services like Lambda, S3, and EMR for real-time data ingestion, processing, and storage.

• Optimize streaming applications for performance and scalability, ensuring efficient resource usage and minimal latency.

• Develop and maintain robust error handling, data validation, and retry mechanisms within Kinesis pipelines to ensure data consistency and reliability.

• Implement security best practices for data streaming, including encryption in transit and at rest, access control using IAM roles and policies, and data retention policies.

• Monitor and troubleshoot AWS Kinesis streams using CloudWatch metrics, alarms, and logs, ensuring high availability and minimal downtime.

• Collaborate with DevOps teams to automate the deployment and scaling of streaming pipelines using AWS CloudFormation, Lambda, and CI/CD tools.

• Work closely with data analysts and data scientists to ensure real-time data is processed and delivered for immediate insights and reporting.

• Implement data partitioning, sharding, and key management strategies to handle high-throughput data streams and ensure scalability.

• Optimize the cost of real-time data processing by tuning the configurations of Kinesis and associated AWS services like Lambda and Firehose.

• Stay current with AWS updates and best practices for streaming data, recommending improvements to the architecture as new features and services become available.

• Provide guidance and mentorship to junior engineers in real-time data processing, ensuring best practices in streaming technologies and AWS cloud services.

• Create and maintain detailed technical documentation for data pipelines, including data flow diagrams, stream processing logic, and operational guidelines.

  • AWS Data Engineer

    3 days ago

    Telford, Shropshire, United Kingdom Infinity Quest Full time

    AWS Data Engineer Role Type: Permanent Location: Telford, UK Hybrid – 2 days’ work from Telford office Role : AWS Data Engineer • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams. • Collaborate with stakeholders to gather requirements and design efficient...

  • AWS Data Engineer

    2 days ago

    Telford, Shropshire, United Kingdom Infinity Quest Full time

    AWS Data Engineer Role Type: Permanent Location: Telford, UK Hybrid – 2 days’ work from Telford office Role : AWS Data Engineer • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams. • Collaborate with stakeholders to gather requirements and design efficient...

  • Data Engineer Contract

    4 weeks ago

    Telford, Shropshire, United Kingdom eTeam Full time

    Job title Data Engineer Contract :Telford 6 Month Contract Skills: Talend, Client RDBMS, AWS, CICD, Talend ETL, ETL SC is required for this role. We require a software engineer with experience of ETL tooling and processes, ideally within Talend and usage of Client RDS databases. Software engineering experience ETL projects and development. Talend ...

  • Data Engineer Contract

    4 weeks ago

    Telford, Shropshire, United Kingdom eTeam Full time

    Job title Data Engineer Contract :Telford 6 Month Contract Skills: Talend, Client RDBMS, AWS, CICD, Talend ETL, ETL SC is required for this role. We require a software engineer with experience of ETL tooling and processes, ideally within Talend and usage of Client RDS databases. Software engineering experience ETL projects and development. Talend ...

  • AWS Data Engineer

    6 days ago

    Telford, United Kingdom LSA Recruit Full time

    Job Description We have an exciting job opportunity for AWS Data Engineer role at Telford, UK - Permanent . Title: AWS Data Engineer Location: Telford, UK Duration: Permanent Job Description: Design, develop, and maintain Real Time data streaming pipelines using AWS Kinesis for processing and analysing high-velocity data streams. Collaborate with...

  • AWS Data Engineer

    1 day ago

    Telford, United Kingdom Infinity Quest Full time

    AWS Data Engineer Role Type: Permanent Location: Telford, UK Hybrid – 2 days’ work from Telford office Role : AWS Data Engineer • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams. • Collaborate with stakeholders to gather requirements and design...

  • AWS Data Engineer

    2 days ago

    Telford, United Kingdom Infinity Quest Full time

    AWS Data Engineer Role Type: Permanent Location: Telford, UK Hybrid – 2 days’ work from Telford officeRole : AWS Data Engineer • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams.• Collaborate with stakeholders to gather requirements and design efficient data...

  • AWS Data Engineer

    2 days ago

    Telford, United Kingdom Infinity Quest Full time

    AWS Data Engineer Role Type: Permanent Location: Telford, UK Hybrid – 2 days’ work from Telford office Role : AWS Data Engineer • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams. • Collaborate with stakeholders to gather requirements and...

  • AWS Data Engineer

    2 days ago

    Telford, United Kingdom Infinity Quest Full time

    AWS Data Engineer Role Type: Permanent Location: Telford, UK Hybrid – 2 days’ work from Telford officeRole : AWS Data Engineer • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams.• Collaborate with stakeholders to gather requirements and design efficient data...

  • AWS Data Engineer

    3 days ago

    Telford, United Kingdom Infoplus Technologies UK Limited Full time

    Role : AWS Data Engineer – Kinesis • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams.• Collaborate with stakeholders to gather requirements and design efficient data streaming architectures for real-time analytics, monitoring, and alerting.• Build and optimize...

  • AWS Data Engineer

    3 days ago

    Telford, United Kingdom Infoplus Technologies UK Limited Full time

    Role : AWS Data Engineer – Kinesis • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams.• Collaborate with stakeholders to gather requirements and design efficient data streaming architectures for real-time analytics, monitoring, and alerting.• Build and optimize...

  • AWS Data Engineer

    4 days ago

    Telford, United Kingdom Infoplus Technologies UK Limited Full time

    Role : AWS Data Engineer – Kinesis • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams.• Collaborate with stakeholders to gather requirements and design efficient data streaming architectures for real-time analytics, monitoring, and alerting.• Build and optimize...

  • AWS Data Engineer

    4 days ago

    Telford, United Kingdom Infinity Quest Full time

    Role Type: PermanentLocation: Telford, UKHybrid – 2 days’ work from Telford officeSalary: 70K GBP/Annum AWS Data Engineer • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams.• Collaborate with stakeholders to gather requirements and design efficient data...

  • AWS Data Engineer

    3 days ago

    Telford, United Kingdom Infinity Quest Full time

    Role Type: PermanentLocation: Telford, UKHybrid – 2 days’ work from Telford officeSalary: 70K GBP/Annum AWS Data Engineer • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams.• Collaborate with stakeholders to gather requirements and design efficient data...

  • AWS Data Engineer

    4 days ago

    Telford, UK, Shropshire, United Kingdom Infinity Quest Full time

    Role Type: PermanentLocation: Telford, UKHybrid – 2 days’ work from Telford officeSalary: 70K GBP/Annum AWS Data Engineer • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams.• Collaborate with stakeholders to gather requirements and design efficient data...

  • Data Engineer Contract

    4 weeks ago

    Telford, United Kingdom eTeam Full time

    Job title Data Engineer Contract :Telford 6 Month Contract Skills: Talend, Client RDBMS, AWS, CICD, Talend ETL, ETL SC is required for this role. We require a software engineer with experience of ETL tooling and processes, ideally within Talend and usage of Client RDS databases. Software engineering experience ETL projects and development. Talend ...

  • Senior Engineer, Data Engineering

    4 weeks ago

    Telford, Shropshire, United Kingdom eTeam Full time

    Role- Data Engineer x 2 Telford 6 Month Contract Contract Inside IR35 SC clearance is mandatory. You should have experience as a Software Engineer delivering within large scale data analytics solutions and the ability to operate at all stages of the software engineering lifecycle, as well as some experience in the following; • Awareness of devops...

  • Senior Engineer, Data Engineering

    4 weeks ago

    Telford, Shropshire, United Kingdom eTeam Full time

    Role- Data Engineer x 2 Telford 6 Month Contract Contract Inside IR35 SC clearance is mandatory. You should have experience as a Software Engineer delivering within large scale data analytics solutions and the ability to operate at all stages of the software engineering lifecycle, as well as some experience in the following; • Awareness of devops...

  • Data Engineer

    2 weeks ago

    Telford, Shropshire, United Kingdom Experis UK Full time

    Job Description Role Title: Data Engineer Location: Hybrid 2 days a week Telford Would you like to join a global leader in consulting, technology services and digital transformation? Our client is at the forefront of innovation to address the entire breadth of opportunities in the evolving world of cloud, digital and platforms. You should have...

  • Data Engineer

    2 weeks ago

    Telford, Shropshire, United Kingdom Experis UK Full time

    Job Description Role Title: Data Engineer Location: Hybrid 2 days a week Telford Would you like to join a global leader in consulting, technology services and digital transformation? Our client is at the forefront of innovation to address the entire breadth of opportunities in the evolving world of cloud, digital and platforms. You should have...