AWS With Pyspark And Python

2 months ago

London, United Kingdom N Consulting Ltd Full time


Job Title: AWS With Pyspark and Python
Location: London
Contract: 6 months

Required Core Skills:
- AWS
- Python
- PySpark
- SQL
- Shell scripting

Minimum years of experience: 5 - 7 years

Areas of responsibility / Detailed Job Description:
• Talent will need to work as a lead at onsite
• Should be able to perform data integration with cross platforms,
• Should be able to setup data connections from various source,
• Should be able to build transform in SQL or PySpark/Python,
• Should be able to build data pipelines using pipeline builder or code repositories.
• Should be able to configure and setup/manage Middleware agents on Linux so need to have knowledge on Linux system and commands.
• Should be able to debug check, build failures which requires understanding in spark framework and java to optimize the failures.
• Should be able to administer platform, which involves whitelisting endpoints, ingress/egress policy setup, SAML config/management/migration, role setup, organization permission setup.
• Should be able to perform Governance operations which involves PII data identification/rectification, access approval setup.
• Should be able to perform security operations which involve vulnerability fixes, resource management on servers.
• Should be able to support ontologies and other data pipelines.
 

  • AWS Data Engineer with PySpark and Python Expertise

    4 days ago

    London, Greater London, United Kingdom N Consulting Ltd Full time

    Job Title:AWS Data Engineer with PySpark and Python ExpertiseLocation:RemoteContract:6 monthsRequired Core Skills:AWSPythonPySparkSQLShell scriptingMinimum years of experience: 7 yearsAreas of responsibility / Detailed Job Description:The successful candidate will work as a lead on-site, overseeing the development and implementation of data integration...

  • AWS Data Engineer with PySpark and Python Expertise

    6 days ago

    London, Greater London, United Kingdom N Consulting Ltd Full time

    Job Title:AWS Data Engineer with PySpark and Python ExpertiseLocation:RemoteContract:6 monthsRequired Core Skills:AWSPythonPySparkSQLShell scriptingMinimum years of experience: 7 yearsAreas of responsibility / Detailed Job Description:The successful candidate will work as a lead on-site, overseeing the development and implementation of data integration...

  • Lead Data Architect with AWS, PySpark, and Python Skills

    4 days ago

    London, Greater London, United Kingdom N Consulting Ltd Full time

    Job Title:AWS Data Engineer with PySpark and Python ExpertiseLocation:RemoteContract:6 monthsRequired Core Skills:AWSPythonPySparkSQLShell scriptingMinimum years of experience: 7 yearsAreas of responsibility / Detailed Job Description:The successful candidate will work as a lead on-site, overseeing the development and implementation of data integration...

  • Lead Data Architect with AWS, PySpark, and Python Skills

    6 days ago

    London, Greater London, United Kingdom N Consulting Ltd Full time

    Job Title:AWS Data Engineer with PySpark and Python ExpertiseLocation:RemoteContract:6 monthsRequired Core Skills:AWSPythonPySparkSQLShell scriptingMinimum years of experience: 7 yearsAreas of responsibility / Detailed Job Description:The successful candidate will work as a lead on-site, overseeing the development and implementation of data integration...

  • Senior Data Integration Specialist with AWS and PySpark

    4 days ago

    London, Greater London, United Kingdom N Consulting Ltd Full time

    Job Title:AWS Data Engineer with PySpark and Python ExpertiseLocation:RemoteContract:6 monthsRequired Core Skills:AWSPythonPySparkSQLShell scriptingMinimum years of experience: 7 yearsAreas of responsibility / Detailed Job Description:The successful candidate will work as a lead on-site, overseeing the development and implementation of data integration...

  • Senior Data Integration Specialist with AWS and PySpark

    6 days ago

    London, Greater London, United Kingdom N Consulting Ltd Full time

    Job Title:AWS Data Engineer with PySpark and Python ExpertiseLocation:RemoteContract:6 monthsRequired Core Skills:AWSPythonPySparkSQLShell scriptingMinimum years of experience: 7 yearsAreas of responsibility / Detailed Job Description:The successful candidate will work as a lead on-site, overseeing the development and implementation of data integration...

  • Python Data Engineer PySpark Spark Finance Trading London

    1 month ago

    London, Greater London, United Kingdom Joseph Harry Full time

    Python Data Engineer (Software Engineer Programmer Developer Data Engineer Python PySpark Spark Glue Athena Iceberg Airflow Dagster DBT Java Agile AWS GCP Buy Side Asset Manager Investment Management Finance Front Office Trading Financial Services Pandas Numpy Scipy Banking) required by our asset management client in London.Python Data Engineer (Software...

  • Python Data Engineer PySpark Spark Finance Trading London

    3 months ago

    London, United Kingdom Joseph Harry Full time

    Python Data Engineer (Software Engineer Programmer Developer Data Engineer Python PySpark Spark Glue Athena Iceberg Airflow Dagster DBT Java Agile AWS GCP Buy Side Asset Manager Investment Management Finance Front Office Trading Financial Services Pandas Numpy Scipy Banking) required by our asset management client in London. You MUST have the following: ...

  • Python Data Engineer PySpark Spark Finance Trading London

    3 months ago

    London, UK, United Kingdom Joseph Harry Full time

    Python Data Engineer (Software Engineer Programmer Developer Data Engineer Python PySpark Spark Glue Athena Iceberg Airflow Dagster DBT Java Agile AWS GCP Buy Side Asset Manager Investment Management Finance Front Office Trading Financial Services Pandas Numpy Scipy Banking) required by our asset management client in London. You MUST have the following: ...

  • Python Data Engineer PySpark Spark Finance Trading London

    3 months ago

    London, UK, United Kingdom Joseph Harry Full time

    Python Data Engineer (Software Engineer Programmer Developer Data Engineer Python PySpark Spark Glue Athena Iceberg Airflow Dagster DBT Java Agile AWS GCP Buy Side Asset Manager Investment Management Finance Front Office Trading Financial Services Pandas Numpy Scipy Banking) required by our asset management client in London. You MUST have the following: ...

  • Python Data Engineer PySpark Spark Finance Trading London

    3 months ago

    London, United Kingdom Joseph Harry Full time

    Python Data Engineer (Software Engineer Programmer Developer Data Engineer Python PySpark Spark Glue Athena Iceberg Airflow Dagster DBT Java Agile AWS GCP Buy Side Asset Manager Investment Management Finance Front Office Trading Financial Services Pandas Numpy Scipy Banking) required by our asset management client in London. You MUST have the following: ...

  • AWS Python Data Engineer

    2 weeks ago

    City of London, United Kingdom Hays Technology Full time

    Your new company Highly reputable Financial Services CompanyYour new role As a Senior AWS Python Data Engineer, you will be working within high performance development teams to implement AWS frameworks, solutions, and improve existing platforms using AWS technologies. What you'll need to succeed Significant experience using Python with AWS...

  • AWS Python Data Engineer

    7 days ago

    City of London, United Kingdom Hays Technology Full time

    Your new company Highly reputable Financial Services CompanyYour new role As a Senior AWS Python Data Engineer, you will be working within high performance development teams to implement AWS frameworks, solutions, and improve existing platforms using AWS technologies. What you'll need to succeed Significant experience using Python with AWS technologies...

  • AWS Python Data Engineer

    2 weeks ago

    London, United Kingdom Hays Specialist Recruitment Limited Remote Work Freelance Full time

    Your new company Highly reputable Financial Services Company Your new role As a Senior AWS Python Data Engineer, you will be working within high performance development teams to implement AWS frameworks, solutions, and improve existing platforms using AWS technologies. What you'll need to succeed Significant experience using Python with AWS technologies...

  • AWS Cloud Engineer

    3 days ago

    London, Greater London, United Kingdom Hays Specialist Recruitment Limited Full time

    Job SummaryHays Specialist Recruitment Limited is seeking a highly skilled AWS Python Data Engineer to join our team. As a Senior AWS Python Data Engineer, you will be working within high-performance development teams to implement AWS frameworks, solutions, and improve existing platforms using AWS technologies.About the RoleDesign, develop, and deploy...

  • AWS Cloud Engineer

    3 days ago

    London, Greater London, United Kingdom Hays Specialist Recruitment Limited Full time

    Job SummaryHays Specialist Recruitment Limited is seeking a highly skilled AWS Python Data Engineer to join our team. As a Senior AWS Python Data Engineer, you will be working within high-performance development teams to implement AWS frameworks, solutions, and improve existing platforms using AWS technologies.About the RoleDesign, develop, and deploy...

  • AWS Data Integration Specialist

    1 day ago

    London, Greater London, United Kingdom N Consulting Ltd Full time

    Job Title: AWS Data Integration LeadCompany: N Consulting LtdLocation: RemoteContract: 6 monthsJob Description:We are seeking a seasoned professional with 7+ years of experience to lead our team in delivering high-quality data integration solutions using AWS, PySpark, and Python. As a key member of our team, you will play a crucial role in setting up data...

  • AWS Data Integration Specialist

    1 day ago

    London, Greater London, United Kingdom N Consulting Ltd Full time

    Job Title: AWS Data Integration LeadCompany: N Consulting LtdLocation: RemoteContract: 6 monthsJob Description:We are seeking a seasoned professional with 7+ years of experience to lead our team in delivering high-quality data integration solutions using AWS, PySpark, and Python. As a key member of our team, you will play a crucial role in setting up data...

  • AWS Cloud Engineer

    2 weeks ago

    London, Greater London, United Kingdom Hays Specialist Recruitment Limited Full time

    Job SummaryHays Specialist Recruitment Limited is seeking a highly skilled AWS Cloud Engineer to join our team. As a Senior AWS Python Data Engineer, you will be working within high-performance development teams to implement AWS frameworks, solutions, and improve existing platforms using AWS technologies.About the RoleDevelop and implement scalable data...

  • Python Data Engineer

    4 days ago

    London, United Kingdom Joseph Harry Full time

    Job Title: Python Data Engineer - Finance Trading LondonJob Summary:We are seeking an experienced Python Data Engineer to join our team at Joseph Harry. As a Python Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Python and PySpark.Key Responsibilities:Design and develop data...