AWS Data Engineer

7 days ago

Telford, United Kingdom LSA Recruit Full time
Job Description

We have an exciting job opportunity for AWS Data Engineer role at Telford, UK - Permanent .

Title: AWS Data Engineer

Location: Telford, UK

Duration: Permanent

Job Description:

  • Design, develop, and maintain Real Time data streaming pipelines using AWS Kinesis for processing and analysing high-velocity data streams.
  • Collaborate with stakeholders to gather requirements and design efficient data streaming architectures for Real Time analytics, monitoring, and alerting.
  • Build and optimize Kinesis Data Streams, Kinesis Data Firehose, and Kinesis Data Analytics to process Real Time data from various sources.
  • Develop and implement ETL processes to transform, enrich, and aggregate streaming data for downstream consumption in data lakes or data warehouses such as AWS S3, Redshift, and DynamoDB.
  • Integrate Kinesis with other AWS services like Lambda, S3, and EMR for Real Time data ingestion, processing, and storage.
  • Optimize streaming applications for performance and scalability, ensuring efficient resource usage and minimal latency.
  • Develop and maintain robust error handling, data validation, and retry mechanisms within Kinesis pipelines to ensure data consistency and reliability.
  • Implement security best practices for data streaming, including encryption in transit and at rest, access control using IAM roles and policies, and data retention policies.
  • Monitor and troubleshoot AWS Kinesis streams using CloudWatch metrics, alarms, and logs, ensuring high availability and minimal downtime.
  • Collaborate with DevOps teams to automate the deployment and scaling of streaming pipelines using AWS CloudFormation, Lambda, and CI/CD tools.
  • Work closely with data analysts and data scientists to ensure Real Time data is processed and delivered for immediate insights and reporting.
  • Implement data partitioning, sharding, and key management strategies to handle high-throughput data streams and ensure scalability.
  • Optimize the cost of Real Time data processing by tuning the configurations of Kinesis and associated AWS services like Lambda and Firehose.
  • Stay current with AWS updates and best practices for streaming data, recommending improvements to the architecture as new features and services become available.
  • Provide guidance and mentorship to junior engineers in Real Time data processing, ensuring best practices in streaming technologies and AWS cloud services.
  • Create and maintain detailed technical documentation for data pipelines, including data flow diagrams, stream processing logic, and operational guidelines

  • AWS Data Engineer

    2 days ago

    Telford, United Kingdom Infinity Quest Full time

    AWS Data Engineer Role Type: Permanent Location: Telford, UK Hybrid – 2 days’ work from Telford officeRole : AWS Data Engineer • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams.• Collaborate with stakeholders to gather requirements and design efficient data...

  • AWS Data Engineer

    2 days ago

    Telford, United Kingdom Infinity Quest Full time

    AWS Data Engineer Role Type: Permanent Location: Telford, UK Hybrid – 2 days’ work from Telford officeRole : AWS Data Engineer • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams.• Collaborate with stakeholders to gather requirements and design efficient data...

  • AWS Data Engineer

    2 days ago

    Telford, United Kingdom Infinity Quest Full time

    AWS Data Engineer Role Type: Permanent Location: Telford, UK Hybrid – 2 days’ work from Telford office Role : AWS Data Engineer • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams. • Collaborate with stakeholders to gather requirements and...

  • AWS Data Engineer

    2 days ago

    Telford, United Kingdom Infinity Quest Full time

    AWS Data Engineer Role Type: Permanent Location: Telford, UK Hybrid – 2 days’ work from Telford office Role : AWS Data Engineer • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams. • Collaborate with stakeholders to gather requirements and design...

  • AWS Data Engineer

    4 days ago

    Telford, United Kingdom Infoplus Technologies UK Limited Full time

    Role : AWS Data Engineer – Kinesis • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams.• Collaborate with stakeholders to gather requirements and design efficient data streaming architectures for real-time analytics, monitoring, and alerting.• Build and optimize...

  • AWS Data Engineer

    3 days ago

    Telford, United Kingdom Infoplus Technologies UK Limited Full time

    Role : AWS Data Engineer – Kinesis • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams.• Collaborate with stakeholders to gather requirements and design efficient data streaming architectures for real-time analytics, monitoring, and alerting.• Build and optimize...

  • AWS Data Engineer

    3 days ago

    Telford, United Kingdom Infoplus Technologies UK Limited Full time

    Role : AWS Data Engineer – Kinesis • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams.• Collaborate with stakeholders to gather requirements and design efficient data streaming architectures for real-time analytics, monitoring, and alerting.• Build and optimize...

  • AWS Data Engineer

    4 days ago

    Telford, United Kingdom Infinity Quest Full time

    Role Type: PermanentLocation: Telford, UKHybrid – 2 days’ work from Telford officeSalary: 70K GBP/Annum AWS Data Engineer • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams.• Collaborate with stakeholders to gather requirements and design efficient data...

  • AWS Data Engineer

    4 days ago

    Telford, United Kingdom Infinity Quest Full time

    Role Type: PermanentLocation: Telford, UKHybrid – 2 days’ work from Telford officeSalary: 70K GBP/Annum AWS Data Engineer • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams.• Collaborate with stakeholders to gather requirements and design efficient data...

  • AWS Data Engineer

    2 days ago

    Telford, Shropshire, United Kingdom Infinity Quest Full time

    AWS Data Engineer Role Type: Permanent Location: Telford, UK Hybrid – 2 days’ work from Telford office Role : AWS Data Engineer • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams. • Collaborate with stakeholders to gather requirements and design efficient...

  • AWS Data Engineer

    3 days ago

    Telford, Shropshire, United Kingdom Infinity Quest Full time

    AWS Data Engineer Role Type: Permanent Location: Telford, UK Hybrid – 2 days’ work from Telford office Role : AWS Data Engineer • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams. • Collaborate with stakeholders to gather requirements and design efficient...

  • AWS Data Engineer

    4 days ago

    Telford, Shropshire, United Kingdom Infoplus Technologies UK Limited Full time

    Role : AWS Data Engineer – Kinesis • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams. • Collaborate with stakeholders to gather requirements and design efficient data streaming architectures for real-time analytics, monitoring, and alerting. • Build and...

  • AWS Data Engineer

    4 days ago

    Telford, UK, Shropshire, United Kingdom Infinity Quest Full time

    Role Type: PermanentLocation: Telford, UKHybrid – 2 days’ work from Telford officeSalary: 70K GBP/Annum AWS Data Engineer • Design, develop, and maintain real-time data streaming pipelines using AWS Kinesis for processing and analyzing high-velocity data streams.• Collaborate with stakeholders to gather requirements and design efficient data...

  • Data Engineer Contract

    4 weeks ago

    Telford, United Kingdom eTeam Full time

    Job title Data Engineer Contract :Telford 6 Month Contract Skills: Talend, Client RDBMS, AWS, CICD, Talend ETL, ETL SC is required for this role. We require a software engineer with experience of ETL tooling and processes, ideally within Talend and usage of Client RDS databases. Software engineering experience ETL projects and development. Talend ...

  • Data Engineer Contract

    4 weeks ago

    Telford, Shropshire, United Kingdom eTeam Full time

    Job title Data Engineer Contract :Telford 6 Month Contract Skills: Talend, Client RDBMS, AWS, CICD, Talend ETL, ETL SC is required for this role. We require a software engineer with experience of ETL tooling and processes, ideally within Talend and usage of Client RDS databases. Software engineering experience ETL projects and development. Talend ...

  • Data Engineer Contract

    4 weeks ago

    Telford, Shropshire, United Kingdom eTeam Full time

    Job title Data Engineer Contract :Telford 6 Month Contract Skills: Talend, Client RDBMS, AWS, CICD, Talend ETL, ETL SC is required for this role. We require a software engineer with experience of ETL tooling and processes, ideally within Talend and usage of Client RDS databases. Software engineering experience ETL projects and development. Talend ...

  • AWS Cloud Data Migration Specialist

    1 week ago

    Telford, Telford and Wrekin, United Kingdom Adroit People Ltd. Full time

    Job Description - Cloud Data Migration EngineerAt Adroit People Ltd., we're seeking a skilled Cloud Data Migration Engineer to lead end-to-end data migration projects. Your expertise will be essential in planning, mapping, extracting, transforming, loading, and validating large volumes of structured and unstructured data across various environments.We're...

  • Data Engineer

    4 weeks ago

    Telford, United Kingdom eTeam Full time

    Role- Data Engineer x 2 Telford 6 Month Contract Contract Inside IR35 SC clearance is mandatory. You should have experience as a Software Engineer delivering within large scale data analytics solutions and the ability to operate at all stages of the software engineering lifecycle, as well as some experience in the following; • Awareness of devops culture...

  • AWS Cloud Infrastructure Engineer

    4 weeks ago

    Telford, Telford and Wrekin, United Kingdom Digital Waffle Full time

    Job Title:Lead DevOps Engineer (AWS)Location: Telford, UK (Hybrid)Salary: up to £80k per annum + 20% bonusWe are seeking a highly skilled AWS DevOps Lead to join our team at Digital Waffle. As a key member of our cloud infrastructure team, you will be responsible for designing, implementing, and maintaining our cloud infrastructure on AWS.Key...

  • AWS Cloud Infrastructure Engineer

    4 weeks ago

    Telford, Telford and Wrekin, United Kingdom Digital Waffle Full time

    Job Title:Lead DevOps Engineer (AWS)Location: Telford, UK (Hybrid)Salary: up to £80k per annum + 20% bonusWe are seeking a highly skilled AWS DevOps Lead to join our team at Digital Waffle. As a key member of our cloud infrastructure team, you will be responsible for designing, implementing, and maintaining our cloud infrastructure on AWS.Key...