Current jobs related to Spark Architect - Leeds - PRACYVA

  • Spark Architect

    7 days ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will play a key role in designing and implementing scalable data integration solutions using PySpark and Spark SQL.Key Responsibilities:Refactor Legacy ETL code using Prophecy low-code no-code and available...

  • Spark Architect

    7 days ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will play a key role in designing and implementing scalable data integration solutions using PySpark and Spark SQL.Key Responsibilities:Refactor Legacy ETL code using Prophecy low-code no-code and available...

  • Spark Architect

    4 days ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for refactoring Legacy ETL code into PySpark using Prophecy low-code no-code and available converters.Key Responsibilities:Refactor Legacy ETL code into PySpark using Prophecy low-code no-code...

  • Spark Architect

    4 days ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for refactoring Legacy ETL code into PySpark using Prophecy low-code no-code and available converters.Key Responsibilities:Refactor Legacy ETL code into PySpark using Prophecy low-code no-code...

  • Spark Architect

    3 days ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Job Title: Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for designing and implementing scalable and efficient data processing systems using Apache Spark.Job DescriptionThe ideal candidate will have a deep understanding of Spark Data Integration, PySpark, and Spark...

  • Spark Architect

    3 days ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Job Title: Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for designing and implementing scalable and efficient data processing systems using Apache Spark.Job DescriptionThe ideal candidate will have a deep understanding of Spark Data Integration, PySpark, and Spark...

  • Spark Architect

    6 days ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Job Title: Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for designing and implementing scalable and efficient data processing systems using Apache Spark.Job DescriptionThe ideal candidate will have a deep understanding of Spark Data Integration, PySpark, and Spark...

  • Spark Architect

    6 days ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Job Title: Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for designing and implementing scalable and efficient data processing systems using Apache Spark.Job DescriptionThe ideal candidate will have a deep understanding of Spark Data Integration, PySpark, and Spark...

  • Spark Architect

    3 weeks ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SMECheck below to see if you have what is needed for this opportunity, and if so, make an application asap.Contract Role: Long term contract role but 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)JOB ADVERT FOR IJPExciting Long-Term Opportunity to Work on Cutting-Edge Technology in One of Client's Top...

  • Spark Architect

    3 weeks ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SMECheck below to see if you have what is needed for this opportunity, and if so, make an application asap.Contract Role: Long term contract role but 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)JOB ADVERT FOR IJPExciting Long-Term Opportunity to Work on Cutting-Edge Technology in One of Client's Top...

  • Spark Architect

    2 weeks ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Job Title: Spark ArchitectAbout the Role:We are seeking an experienced Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for designing and implementing scalable data integration solutions using PySpark and Cloudera Spark.Key Responsibilities:Refactor Legacy ETL code into PySpark using Prophecy low-code no-code and...

  • Spark Architect

    2 weeks ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Job Title: Spark ArchitectAbout the Role:We are seeking an experienced Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for designing and implementing scalable data integration solutions using PySpark and Cloudera Spark.Key Responsibilities:Refactor Legacy ETL code into PySpark using Prophecy low-code no-code and...

  • Spark Architect

    1 month ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SMEContract Role: Long term contract role but 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)JOB ADVERT FOR IJPExciting Long-Term Opportunity to Work on Cutting-Edge Technology in One of Client's Top Fastest-growing Accounts which has over 1900 associates working across India, UK, China, Hong Kong and Mexico....

  • Spark Architect

    1 month ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SME Contract Role: Long term contract role but 6 months to begin with & its extendable Location: Leeds, UK (min 3 days onsite) JOB ADVERT FOR IJP Exciting Long-Term Opportunity to Work on Cutting-Edge Technology in One of Client's Top Fastest-growing Accounts which has over 1900 associates working across India, UK, China, Hong Kong...

  • Spark Architect

    1 month ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SMEContract Role: Long term contract role but 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)JOB ADVERT FOR IJPExciting Long-Term Opportunity to Work on Cutting-Edge Technology in One of Client's Top Fastest-growing Accounts which has over 1900 associates working across India, UK, China, Hong Kong and Mexico....

  • Spark Architect

    4 weeks ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SME Contract Role: Long term contract role but 6 months to begin with & its extendable Location: Leeds, UK (min 3 days onsite) JOB ADVERT FOR IJP Exciting Long-Term Opportunity to Work on Cutting-Edge Technology in One of Client's Top Fastest-growing Accounts which has over 1900 associates working across India, UK, China, Hong Kong and...

  • Spark Architect

    4 weeks ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SME Contract Role: Long term contract role but 6 months to begin with & its extendable Location: Leeds, UK (min 3 days onsite) JOB ADVERT FOR IJP Exciting Long-Term Opportunity to Work on Cutting-Edge Technology in One of Client's Top Fastest-growing Accounts which has over 1900 associates working across India, UK, China, Hong Kong...

  • Spark Architect

    1 month ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SMEContract Role: Long term contract role but 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)JOB ADVERT FOR IJPExciting Long-Term Opportunity to Work on Cutting-Edge Technology in One of Client's Top Fastest-growing Accounts which has over 1900 associates working across India, UK, China, Hong Kong and...

  • Spark Architect

    3 weeks ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SMEContract Role: Long term contract role but 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)The information below covers the role requirements, expected candidate experience, and accompanying qualifications.JOB ADVERT FOR IJPExciting Long-Term Opportunity to Work on Cutting-Edge Technology in One of Client's...

  • Spark Architect

    3 weeks ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SMEContract Role: Long term contract role but 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)The information below covers the role requirements, expected candidate experience, and accompanying qualifications.JOB ADVERT FOR IJPExciting Long-Term Opportunity to Work on Cutting-Edge Technology in One of Client's...

Spark Architect

4 months ago

Leeds, United Kingdom PRACYVA Full time

Spark Architect / SME

Contract Role- 6 months to begin with & its extendable

Location: Leeds, UK (min 3 days onsite)


  • Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.
  • Converted code is causing failures/performance issues.


Skills:

  • Spark Architecture – component understanding around Spark Data Integration (PySpark, scripting, variable setting etc.), Spark SQL, Spark Explain plans.
  • Spark SME – Be able to analyse Spark code failures through Spark Plans and make correcting recommendations.
  • Spark SME – Be able to review PySpark and Spark SQL jobs and make performance improvement recommendations.
  • Spark – SME Be able to understand Data Frames / Resilient Distributed Data Sets and understand any memory related problems and make corrective recommendations.
  • Monitoring – Be able to monitor Spark jobs using wider tools such as Grafana to see whether there are Cluster level failures.
  • Cloudera (CDP) – Knowledge of understanding how Cloudera Spark is set up and how the run time libraries are used by PySpark code.
  • Prophecy – High level understanding of Low-Code No-Code prophecy set up and its use to generate PySpark code.