Current jobs related to PySpark Developer - Leeds, Leeds - PRACYVA

  • PySpark Developer

    2 months ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Job SummaryPRACYVA is seeking a highly skilled Spark Architect to join our team and lead the development of our Enterprise Data Integration platform using PySpark. As a key member of our Cloud Infrastructure team, you will be responsible for designing, implementing, and maintaining scalable and efficient data integration solutions on Cloud...

  • PySpark Developer

    2 months ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Job SummaryPRACYVA is seeking a highly skilled Spark Architect to join our team and lead the development of our Enterprise Data Integration platform using PySpark. As a key member of our Cloud Infrastructure team, you will be responsible for designing, implementing, and maintaining scalable and efficient data integration solutions on Cloud...

  • Senior Spark Developer

    2 months ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a key member of our Global Data Technology (GDT) team, you will be responsible for driving data integration upgrades to PySpark and ensuring the smooth operation of our data infrastructure.Key Responsibilities:Drive data integration...

  • Senior Spark Developer

    1 month ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for designing and implementing scalable data integration solutions using PySpark and Spark SQL.Key Responsibilities:Drive data integration upgrade to PySparkReview PySpark and Spark SQL jobs and...

  • Senior Spark Developer

    1 month ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking an experienced Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for driving data integration upgrades to PySpark and working with our clients to improve the performance of their Spark jobs.Key Responsibilities:Drive data integration upgrades to PySparkReview...

  • Senior Spark Developer

    1 month ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking an experienced Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for driving data integration upgrades to PySpark and working with our clients to improve the performance of their Spark jobs.Key Responsibilities:Drive data integration upgrades to PySparkReview...

  • Data Integration Specialist

    1 month ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking an experienced Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for driving data integration upgrades to PySpark and working closely with our clients to deliver high-quality solutions.Key Responsibilities:Drive data integration upgrades to PySparkWork closely...

  • Spark Architect

    2 months ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Job SummaryPRACYVA is seeking a highly skilled Spark Architect to join our team and lead the development of our Enterprise Data Integration platform using PySpark. As a key member of our Cloud Infrastructure team, you will be responsible for designing, implementing, and maintaining scalable and efficient data integration solutions on Cloud...

  • Spark Architect

    2 months ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Job SummaryPRACYVA is seeking a highly skilled Spark Architect to join our team and lead the development of our Enterprise Data Integration platform using PySpark. As a key member of our Cloud Infrastructure team, you will be responsible for designing, implementing, and maintaining scalable and efficient data integration solutions on Cloud...

  • Lead Data Engineer

    4 weeks ago

    Leeds, Leeds, United Kingdom LexisNexis Intellectual Property Solutions Full time

    About the RoleWe are seeking a highly skilled Data Engineer to lead our team in building a state-of-the-art Strategic Data Platform at LexisNexis Intellectual Property Solutions. As a technical lead, you will be responsible for executing our data strategy, developing and implementing advanced solutions for data integration, quality control, and continuous...

  • Lead Data Engineer

    4 weeks ago

    Leeds, Leeds, United Kingdom LexisNexis Intellectual Property Solutions Full time

    About the RoleWe are seeking a highly skilled Data Engineer to lead our team in building a state-of-the-art Strategic Data Platform at LexisNexis Intellectual Property Solutions. As a technical lead, you will be responsible for executing our data strategy, developing and implementing advanced solutions for data integration, quality control, and continuous...

  • Data Engineering Senior Manager

    3 weeks ago

    Leeds, Leeds, United Kingdom NHS England Full time

    Job Title: Data Engineering Senior ManagerWe are seeking a highly skilled Data Engineering Senior Manager to join our team at NHS England. As a key member of our Data and Analytics department, you will play a crucial role in shaping our data services and driving innovation in data products and services.About the RoleThe Data Engineering team is responsible...

  • Data Engineering Senior Manager

    3 weeks ago

    Leeds, Leeds, United Kingdom NHS England Full time

    Job Title: Data Engineering Senior ManagerWe are seeking a highly skilled Data Engineering Senior Manager to join our team at NHS England. As a key member of our Data and Analytics department, you will play a crucial role in shaping our data services and driving innovation in data products and services.About the RoleThe Data Engineering team is responsible...

  • Senior Data Architect

    2 weeks ago

    Leeds, Leeds, United Kingdom HCLTech Full time

    Lead Data EngineerWe are seeking a highly skilled Lead Data Engineer to join our team at HCLTech. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data pipelines and architectures using Azure cloud services.Key Responsibilities:Design and implement data pipelines using Azure Data...

  • Data Engineering Senior Manager

    3 weeks ago

    Leeds, Leeds, United Kingdom NHS Full time

    Job Title: Data Engineering Senior ManagerWe are seeking an experienced Data Engineering Senior Manager to join our team at the NHS. As a key member of our Data and Analytics department, you will play a crucial role in shaping our data services and driving innovation in data products and services.Key Responsibilities:Develop and maintain data and processing...

  • Data Engineering Senior Manager

    3 weeks ago

    Leeds, Leeds, United Kingdom NHS Full time

    Job Title: Data Engineering Senior ManagerWe are seeking an experienced Data Engineering Senior Manager to join our team at the NHS. As a key member of our Data and Analytics department, you will play a crucial role in shaping our data services and driving innovation in data products and services.Key Responsibilities:Develop and maintain data and processing...

  • Data Engineering Senior Manager

    2 weeks ago

    Leeds, Leeds, United Kingdom NHS Full time

    About the RoleWe are seeking a highly skilled Data Engineering Senior Manager to join our Data and Analytics team at the NHS. As a key member of our team, you will play a crucial role in developing and maintaining our data and processing workflows to architectural standards.Key ResponsibilitiesDeveloping and constructing data and processing workflows to meet...

  • Data Engineer

    3 weeks ago

    Leeds, Leeds, United Kingdom Onyx-Conseil Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team in DWP Digital. As a Data Engineer, you will be responsible for developing and maintaining efficient, scalable, and automated ETL pipelines in an AWS cloud environment using AWS S3 Cloud Object Storage.Key ResponsibilitiesDesign, develop, and deploy data-centric solutions that...

  • Data Engineer

    4 weeks ago

    Leeds, Leeds, United Kingdom Onyx-Conseil Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team in DWP Digital. As a Data Engineer, you will be responsible for developing, testing, maintaining, deploying, and supporting efficient, scalable, automated ETL pipelines in an AWS cloud environment using AWS S3 Cloud Object Storage.Key ResponsibilitiesDesign, develop, and deploy...

  • Data Engineer

    4 weeks ago

    Leeds, Leeds, United Kingdom Onyx-Conseil Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team in DWP Digital. As a Data Engineer, you will be responsible for developing, testing, maintaining, deploying, and supporting efficient, scalable, automated ETL pipelines in an AWS cloud environment using AWS S3 Cloud Object Storage.Key ResponsibilitiesDesign, develop, and deploy...

PySpark Developer

2 months ago

Leeds, Leeds, United Kingdom PRACYVA Full time
Job Description

Job Title: Spark Architect

Job Type: Contract

Location: Remote (with occasional on-site work)

Job Description:

We are seeking an experienced Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for designing and implementing scalable and efficient data integration solutions using PySpark.

Key Responsibilities:

  • Design and implement data integration solutions using PySpark
  • Refactor legacy ETL code to improve performance and efficiency
  • Collaborate with cross-functional teams to identify and prioritize data integration requirements
  • Develop and maintain high-quality PySpark code
  • Monitor and optimize Spark jobs for performance and efficiency

Requirements:

  • At least 12+ years of IT experience with deep understanding of Spark Data Integration (PySpark, scripting, variable setting etc.), Spark SQL, Spark Explain plans
  • Experience with Cloud Databases and Cloud Services
  • Excellent communication and solution presentation skills
  • Ability to work in a fast-paced environment and prioritize multiple tasks

Preferred Qualifications:

  • Experience with Prophecy low-code no-code and available converters
  • Knowledge of working with Cloud Databases
  • Collaboration with multiple customer stakeholders

What We Offer:

As a Spark Architect at PRACYVA, you will have the opportunity to work on cutting-edge technology and collaborate with senior leadership stakeholders. You will also have the chance to drive overall program objectives and make a significant impact on our company's success.