Current jobs related to Spark Solutions Architect - Leeds, Leeds - Pracyva LTD

  • Spark Architect

    1 month ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will play a key role in designing and implementing scalable data integration solutions using PySpark and Spark SQL.Key Responsibilities:Refactor Legacy ETL code using Prophecy low-code no-code and available...

  • Spark Architect

    1 month ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will play a key role in designing and implementing scalable data integration solutions using PySpark and Spark SQL.Key Responsibilities:Refactor Legacy ETL code using Prophecy low-code no-code and available...

  • Spark Architect

    1 month ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for designing and implementing scalable and efficient data integration solutions using PySpark and Spark SQL.The ideal candidate will have a deep understanding of Spark Data Integration,...

  • Spark Architect

    1 month ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for designing and implementing scalable and efficient data integration solutions using PySpark and Spark SQL.The ideal candidate will have a deep understanding of Spark Data Integration,...

  • Spark Architect

    1 month ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for designing and implementing scalable and efficient data integration solutions using PySpark.Key Responsibilities:Refactor Legacy ETL code into PySpark using Prophecy low-code no-code and...

  • Spark Architect

    4 weeks ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for designing and implementing scalable and efficient data integration solutions using PySpark and Spark SQL.Key Responsibilities:Refactor Legacy ETL code into PySpark using Prophecy low-code...

  • Spark Architect

    4 weeks ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for designing and implementing scalable and efficient data integration solutions using PySpark and Spark SQL.Key Responsibilities:Refactor Legacy ETL code into PySpark using Prophecy low-code...

  • Spark Architect

    3 weeks ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for refactoring Legacy ETL code into PySpark using Prophecy low-code no-code and available converters.Key Responsibilities:Refactor Legacy ETL code into PySpark using Prophecy low-code no-code...

  • Spark Architect

    3 weeks ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for refactoring Legacy ETL code into PySpark using Prophecy low-code no-code and available converters.Key Responsibilities:Refactor Legacy ETL code into PySpark using Prophecy low-code no-code...

  • Spark Architect

    1 month ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for refactoring Legacy ETL code into PySpark using Prophecy low-code no-code and available converters.Key Responsibilities:Refactor Legacy ETL code into PySpark using Prophecy low-code no-code...

  • Spark Architect

    1 month ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for refactoring Legacy ETL code into PySpark using Prophecy low-code no-code and available converters.Key Responsibilities:Refactor Legacy ETL code into PySpark using Prophecy low-code no-code...

  • Senior Spark Developer

    1 month ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for designing and implementing scalable data integration solutions using PySpark and Spark SQL.Key Responsibilities:Drive data integration upgrade to PySparkReview PySpark and Spark SQL jobs and...

  • Spark Architect

    2 months ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Job SummaryPRACYVA is seeking a highly skilled Spark Architect to join our team and lead the development of our Enterprise Data Integration platform using PySpark. As a key member of our Cloud Infrastructure team, you will be responsible for designing, implementing, and maintaining scalable and efficient data integration solutions on Cloud...

  • Spark Architect

    2 months ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Job SummaryPRACYVA is seeking a highly skilled Spark Architect to join our team and lead the development of our Enterprise Data Integration platform using PySpark. As a key member of our Cloud Infrastructure team, you will be responsible for designing, implementing, and maintaining scalable and efficient data integration solutions on Cloud...

  • Senior Spark Developer

    1 month ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking an experienced Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for driving data integration upgrades to PySpark and working with our clients to improve the performance of their Spark jobs.Key Responsibilities:Drive data integration upgrades to PySparkReview...

  • Senior Spark Developer

    1 month ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking an experienced Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for driving data integration upgrades to PySpark and working with our clients to improve the performance of their Spark jobs.Key Responsibilities:Drive data integration upgrades to PySparkReview...

  • Senior Spark Engineer

    2 months ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for driving data integration upgrades to PySpark and working with our clients to improve the performance of their Spark SQL jobs.Key Responsibilities:Drive data integration upgrades to...

  • Senior Spark Engineer

    2 months ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a key member of our Global Data Technology (GDT) team, you will be responsible for driving data integration upgrades to PySpark and ensuring the smooth operation of our data infrastructure.Key Responsibilities:Drive data integration...

  • Senior Spark Engineer

    2 months ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a key member of our Global Data Technology (GDT) team, you will be responsible for driving data integration upgrades to PySpark and ensuring the smooth operation of our Spark-based systems.Key Responsibilities:Drive data integration...

  • Senior Spark Developer

    2 months ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a key member of our Global Data Technology (GDT) team, you will be responsible for driving data integration upgrades to PySpark and ensuring the smooth operation of our data infrastructure.Key Responsibilities:Drive data integration...

Spark Solutions Architect

2 months ago

Leeds, Leeds, United Kingdom Pracyva LTD Full time £650

Overview: Pracyva LTD is seeking a skilled Spark Solutions Architect to lead the transformation of legacy ETL processes into modern PySpark implementations utilizing low-code and no-code methodologies. The ideal candidate will possess a deep understanding of Spark architecture and its components.

Key Responsibilities:

  • Analyze and troubleshoot converted code that is experiencing failures or performance challenges.
  • Provide expert recommendations for optimizing Spark code through detailed analysis of Spark Plans.
  • Review and enhance PySpark and Spark SQL jobs to improve overall performance.
  • Understand and address memory-related issues within Data Frames and Resilient Distributed Datasets.
  • Utilize monitoring tools, such as Grafana, to oversee Spark job performance and identify cluster-level failures.
  • Demonstrate knowledge of Cloudera (CDP) and its integration with Spark, particularly in relation to runtime libraries used by PySpark.
  • Possess a high-level understanding of Prophecy's low-code and no-code setup and its application in generating PySpark code.

Required Skills:

  • In-depth knowledge of Spark Data Integration, including PySpark, scripting, and variable management.
  • Expertise in Spark SQL and the ability to interpret Spark Explain plans.
  • Strong analytical skills to diagnose and resolve Spark code failures.
  • Experience in performance tuning and optimization of Spark applications.
  • Familiarity with monitoring and troubleshooting Spark jobs in a distributed environment.

We look forward to your interest in joining our team at Pracyva LTD, where your expertise will contribute to our innovative projects.