Spark Architect

3 weeks ago

Leeds, Leeds, United Kingdom PRACYVA Full time
Exciting Opportunity for a Spark Architect

We are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for refactoring Legacy ETL code into PySpark using Prophecy low-code no-code and available converters.

Key Responsibilities:
  • Refactor Legacy ETL code into PySpark using Prophecy low-code no-code and available converters.
  • Analyze Spark code failures through Spark Plans and make correcting recommendations.
  • Review PySpark and Spark SQL jobs and make performance improvement recommendations.
  • Understand Data Frames / Resilient Distributed Data Sets and make corrective recommendations.
  • Monitor Spark jobs using wider tools such as Grafana to see whether there are Cluster level failures.
Requirements:
  • At least 12+ years of IT experience with deep understanding of component understanding around Spark Data Integration (PySpark, scripting, variable setting etc.), Spark SQL, Spark Explain plans.
  • Ability to traverse and explain the architecture you have been a part of and why any particular tool/technology was used.
  • Spark SME – ability to analyze Spark code failures through Spark Plans and make correcting recommendations.
  • Spark SME – ability to review PySpark and Spark SQL jobs and make performance improvement recommendations.
  • Spark SME – ability to understand Data Frames / Resilient Distributed Data Sets and make corrective recommendations.
Preferred Skills:
  • Collaboration with multiple customer stakeholders.
  • Knowledge of working with Cloud Databases.
  • Excellent communication and solution presentation skills.

We offer a unique opportunity to work with one of the biggest IT landscapes in the world and collaborate with senior leadership stakeholders in the End client's place, guiding technical teams and driving overall program objectives.

  • Spark Architect

    1 month ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will play a key role in designing and implementing scalable data integration solutions using PySpark and Spark SQL.Key Responsibilities:Refactor Legacy ETL code using Prophecy low-code no-code and available...

  • Spark Architect

    1 month ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will play a key role in designing and implementing scalable data integration solutions using PySpark and Spark SQL.Key Responsibilities:Refactor Legacy ETL code using Prophecy low-code no-code and available...

  • Spark Architect

    1 month ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for refactoring Legacy ETL code into PySpark using Prophecy low-code no-code and available converters.Key Responsibilities:Refactor Legacy ETL code into PySpark using Prophecy low-code no-code...

  • Spark Architect

    1 month ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for refactoring Legacy ETL code into PySpark using Prophecy low-code no-code and available converters.Key Responsibilities:Refactor Legacy ETL code into PySpark using Prophecy low-code no-code...

  • Spark Architect

    1 month ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for designing and implementing scalable and efficient data integration solutions using PySpark and Spark SQL.The ideal candidate will have a deep understanding of Spark Data Integration,...

  • Spark Architect

    1 month ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for designing and implementing scalable and efficient data integration solutions using PySpark and Spark SQL.The ideal candidate will have a deep understanding of Spark Data Integration,...

  • Spark Architect

    1 month ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for designing and implementing scalable and efficient data integration solutions using PySpark.Key Responsibilities:Refactor Legacy ETL code into PySpark using Prophecy low-code no-code and...

  • Spark Architect

    1 month ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for designing and implementing scalable and efficient data integration solutions using PySpark.Key Responsibilities:Refactor Legacy ETL code into PySpark using Prophecy low-code no-code and...

  • Spark Architect

    4 weeks ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for designing and implementing scalable and efficient data integration solutions using PySpark and Spark SQL.Key Responsibilities:Refactor Legacy ETL code into PySpark using Prophecy low-code...

  • Spark Architect

    4 weeks ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for designing and implementing scalable and efficient data integration solutions using PySpark and Spark SQL.Key Responsibilities:Refactor Legacy ETL code into PySpark using Prophecy low-code...

  • Senior Spark Developer

    4 weeks ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for designing and implementing scalable data integration solutions using PySpark and Spark SQL.Key Responsibilities:Drive data integration upgrade to PySparkReview PySpark and Spark SQL jobs and...

  • Senior Spark Engineer

    1 month ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for driving data integration upgrades to PySpark and working with our clients to improve the performance of their Spark SQL jobs.Key Responsibilities:Drive data integration upgrades to...

  • Senior Spark Developer

    4 weeks ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking an experienced Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for driving data integration upgrades to PySpark and working with our clients to improve the performance of their Spark jobs.Key Responsibilities:Drive data integration upgrades to PySparkReview...

  • Senior Spark Developer

    4 weeks ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking an experienced Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for driving data integration upgrades to PySpark and working with our clients to improve the performance of their Spark jobs.Key Responsibilities:Drive data integration upgrades to PySparkReview...

  • Senior Spark Engineer

    1 month ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a key member of our Global Data Technology (GDT) team, you will be responsible for driving data integration upgrades to PySpark and ensuring the smooth operation of our data infrastructure.Key Responsibilities:Drive data integration...

  • Senior Spark Engineer

    1 month ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a key member of our Global Data Technology (GDT) team, you will be responsible for driving data integration upgrades to PySpark and ensuring the smooth operation of our Spark-based systems.Key Responsibilities:Drive data integration...

  • Senior Spark Developer

    1 month ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a key member of our Global Data Technology (GDT) team, you will be responsible for driving data integration upgrades to PySpark and ensuring the smooth operation of our data infrastructure.Key Responsibilities:Drive data integration...

  • Spark Architect

    2 months ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Job SummaryPRACYVA is seeking a highly skilled Spark Architect to join our team and lead the development of our Enterprise Data Integration platform using PySpark. As a key member of our Cloud Infrastructure team, you will be responsible for designing, implementing, and maintaining scalable and efficient data integration solutions on Cloud...

  • Spark Architect

    2 months ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Job SummaryPRACYVA is seeking a highly skilled Spark Architect to join our team and lead the development of our Enterprise Data Integration platform using PySpark. As a key member of our Cloud Infrastructure team, you will be responsible for designing, implementing, and maintaining scalable and efficient data integration solutions on Cloud...

  • Performance Architect

    4 weeks ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Job Title: Performance ArchitectJob Type: Full-timeCompany: PRACYVALocation: Remote (with occasional travel to client site)About the Role:We are seeking an experienced Performance Architect to join our team at PRACYVA. As a Performance Architect, you will be responsible for designing and implementing high-performance data integration solutions using Spark...