Current jobs related to Lead Data Architect with AWS, PySpark, and Python Skills - London, Greater London - N Consulting Ltd

  • Python Data Engineer with PySpark Experience

    2 weeks ago

    London, Greater London, United Kingdom Joseph Harry Full time

    Python Data Engineer RoleWe are seeking a highly skilled Python Data Engineer to join our team at Joseph Harry. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Python and PySpark.Key ResponsibilitiesDesign and implement data pipelines using Python and...

  • Senior Data Architect Python Specialist

    2 hours ago

    London, Greater London, United Kingdom Noir Full time

    About the Role:We are seeking a seasoned Lead Data Engineer with significant Python and PySpark experience to lead our Agile engineering team and provide technical guidance through coaching and mentorship.Key Responsibilities:Build a modern data platform using cutting-edge technologiesArchitect big data solutions and develop complex enterprise data ETL and...

  • Senior Data Architect

    3 weeks ago

    London, Greater London, United Kingdom Noir Full time

    Lead Data EngineerAt Noir, we're seeking a highly skilled Lead Data Engineer to join our team. As a key member of our engineering team, you'll be responsible for designing and implementing cutting-edge data solutions using Python, PySpark, and other technologies.Key Responsibilities:Lead the development of a modern data platform using cloud-based...

  • Senior Data Architect

    3 weeks ago

    London, Greater London, United Kingdom Noir Full time

    Lead Data EngineerAt Noir, we're seeking a highly skilled Lead Data Engineer to join our team. As a key member of our engineering team, you'll be responsible for designing and implementing cutting-edge data solutions using Python, PySpark, and other technologies.Key Responsibilities:Lead the development of a modern data platform using cloud-based...

  • Senior Data Architect

    1 week ago

    London, Greater London, United Kingdom Noir Full time

    Job Title: Senior Data ArchitectJob Description:We are seeking a Senior Data Architect to lead our data engineering team and create a dynamic and positive environment for them to excel. The successful candidate will have strong Python, PySpark, and SQL experience, possess a clear understanding of Databricks, and a passion for Data Science (R, Machine...

  • Data Architect Lead

    3 weeks ago

    London, Greater London, United Kingdom Global Full time

    Job Title: Lead Data ArchitectJob Summary:We are seeking a highly skilled Lead Data Architect to play a central role in the evolution of our Data Platform and its application for use cases across the company. As a key member of our team, you will be responsible for designing and implementing a robust data infrastructure that supports our data-driven...

  • Data Architect Lead

    3 weeks ago

    London, Greater London, United Kingdom Global Full time

    Job Title: Lead Data ArchitectJob Summary:We are seeking a highly skilled Lead Data Architect to play a central role in the evolution of our Data Platform and its application for use cases across the company. As a key member of our team, you will be responsible for designing and implementing a robust data infrastructure that supports our data-driven...

  • Senior Data Architect

    2 weeks ago

    London, Greater London, United Kingdom Noir Full time

    Lead Data EngineerWe are seeking a highly skilled Lead Data Engineer to join our team at Noir. As a key member of our engineering team, you will be responsible for designing, building, and maintaining our modern data platform using cutting-edge technologies.Key Responsibilities:Lead the development of big data solutions and complex enterprise data ETL and ML...

  • Senior Data Architect

    2 weeks ago

    London, Greater London, United Kingdom Noir Full time

    Lead Data EngineerWe are seeking a highly skilled Lead Data Engineer to join our team at Noir. As a key member of our engineering team, you will be responsible for designing, building, and maintaining our modern data platform using cutting-edge technologies.Key Responsibilities:Lead the development of big data solutions and complex enterprise data ETL and ML...

  • AWS Cloud Computing Specialist

    3 weeks ago

    London, Greater London, United Kingdom Onyx-Conseil Full time

    Data Architect OpportunityOnyx-Conseil is seeking a highly skilled Data Architect to join our team. As a Data Architect, you will play a key role in designing and implementing cutting-edge data solutions using AWS cloud computing platforms.Key Responsibilities:Design and implement data pipelines and workflows using AWS services such as S3, EC2, Lambda,...

  • AWS Cloud Computing Specialist

    3 weeks ago

    London, Greater London, United Kingdom Onyx-Conseil Full time

    Data Architect OpportunityOnyx-Conseil is seeking a highly skilled Data Architect to join our team. As a Data Architect, you will play a key role in designing and implementing cutting-edge data solutions using AWS cloud computing platforms.Key Responsibilities:Design and implement data pipelines and workflows using AWS services such as S3, EC2, Lambda,...

  • Python Data Engineer

    4 weeks ago

    London, Greater London, United Kingdom Joseph Harry Full time

    Python Data Engineer - FinanceWe are seeking a highly skilled Python Data Engineer to join our team at Joseph Harry. As a Python Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Python and PySpark.Key Responsibilities:Design and develop data pipelines using Python and...

  • Python Data Engineer

    4 weeks ago

    London, Greater London, United Kingdom Joseph Harry Full time

    Python Data Engineer - FinanceWe are seeking a highly skilled Python Data Engineer to join our team at Joseph Harry. As a Python Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Python and PySpark.Key Responsibilities:Design and develop data pipelines using Python and...

  • Senior Data Architect

    3 weeks ago

    London, Greater London, United Kingdom Kite Consulting Group Full time £650

    Senior Data Engineer – PySpark, Python – Contract (Inside IR35)Our client, a global financial services organisation, is seeking a highly skilled Senior Data Engineer to join their team in London. This is a PAYE contract role offering an umbrella rate of up to £650 per day.Key Responsibilities:Design and enhance data systems and workflows that drive key...

  • Senior Data Architect

    3 weeks ago

    London, Greater London, United Kingdom Kite Consulting Group Full time £650

    Senior Data Engineer – PySpark, Python – Contract (Inside IR35)Our client, a global financial services organisation, is seeking a highly skilled Senior Data Engineer to join their team in London. This is a PAYE contract role offering an umbrella rate of up to £650 per day.Key Responsibilities:Design and enhance data systems and workflows that drive key...

  • Senior Data Architect

    4 weeks ago

    London, Greater London, United Kingdom Noir Full time

    Lead Data EngineerWe are seeking a highly skilled Lead Data Engineer to join our team at Noir. As a key member of our engineering team, you will be responsible for designing, building, and maintaining our modern data platform using cutting-edge technologies.Key Responsibilities:Lead the development of big data solutions and complex enterprise data ETL and ML...

  • Senior Data Architect

    4 weeks ago

    London, Greater London, United Kingdom Noir Full time

    Lead Data EngineerWe are seeking a highly skilled Lead Data Engineer to join our team at Noir. As a key member of our engineering team, you will be responsible for designing, building, and maintaining our modern data platform using cutting-edge technologies.Key Responsibilities:Lead the development of big data solutions and complex enterprise data ETL and ML...

  • Data Architect

    2 weeks ago

    London, Greater London, United Kingdom Simon James IT Ltd Full time

    Senior Data Architect - AWSWe are seeking a highly skilled Data Architect to join our team at Simon James IT Ltd.This is a fully remote contract opportunity for a Senior Data Architect to work on a 3-month project.The ideal candidate will have current SC Clearance and experience with AWS technologies, including S3, EC2, Lamda, Redshift, RDS, EMR Cluster, and...

  • Data Architect

    2 weeks ago

    London, Greater London, United Kingdom Simon James IT Ltd Full time

    Senior Data Architect - AWSWe are seeking a highly skilled Data Architect to join our team at Simon James IT Ltd.This is a fully remote contract opportunity for a Senior Data Architect to work on a 3-month project.The ideal candidate will have current SC Clearance and experience with AWS technologies, including S3, EC2, Lamda, Redshift, RDS, EMR Cluster, and...

  • AWS Data Architect Lead

    1 month ago

    London, Greater London, United Kingdom Cititec Talent Full time

    Job Title: Lead AWS Data ArchitectJob Summary:We are seeking a highly skilled Lead AWS Data Architect to join our team at Cititec Talent. As a key member of our organization, you will be responsible for leading the design and implementation of our data infrastructure on AWS.Key Responsibilities:Develop advanced data abstraction layers to integrate legacy...

Lead Data Architect with AWS, PySpark, and Python Skills

2 months ago

London, Greater London, United Kingdom N Consulting Ltd Full time

Job Title:

AWS Data Engineer with PySpark and Python Expertise

Location:

Remote

Contract:

6 months

Required Core Skills:

  • AWS
  • Python
  • PySpark
  • SQL
  • Shell scripting

Minimum years of experience: 7 years

Areas of responsibility / Detailed Job Description:

  • The successful candidate will work as a lead on-site, overseeing the development and implementation of data integration solutions across multiple platforms.
  • They will be responsible for setting up data connections from various sources, building and transforming data in SQL or PySpark/Python, and creating data pipelines using pipeline builders or code repositories.
  • The ideal candidate will have expertise in configuring and managing middleware agents on Linux, as well as debugging and optimizing failures in the Spark framework and Java.
  • They will also be responsible for administering the platform, including whitelisting endpoints, setting up ingress/egress policies, and managing SAML configurations.
  • Additionally, they will perform governance operations, such as identifying and rectifying PII data, setting up access approvals, and performing security operations, including vulnerability fixes and resource management on servers.
  • The successful candidate will also support ontologies and other data pipelines, ensuring seamless data flow and integration.