Spark Architect

4 weeks ago

Leeds, Leeds, United Kingdom PRACYVA Full time
Exciting Opportunity for a Spark Architect

We are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for designing and implementing scalable and efficient data integration solutions using PySpark and Spark SQL.

Key Responsibilities:

  • Refactor Legacy ETL code into PySpark using Prophecy low-code no-code and available converters.
  • Analyze Spark code failures through Spark Plans and make correcting recommendations.
  • Review PySpark and Spark SQL jobs and make performance improvement recommendations.
  • Understand Data Frames / Resilient Distributed Data Sets and make corrective recommendations.
  • Monitor Spark jobs using wider tools such as Grafana to see whether there are Cluster level failures.

Requirements:

  • At least 12+ years of IT experience with deep understanding of component understanding around Spark Data Integration (PySpark, scripting, variable setting etc.), Spark SQL, Spark Explain plans.
  • Ability to traverse and explain the architecture you have been a part of and why any particular tool/technology was used.
  • Knowledge of working with Cloud Databases and excellent communication and solution presentation skills.

What We Offer:

  • Opportunity to work with one of the biggest IT landscapes in the world.
  • Collaboration with senior leadership stakeholders in the End client's place, guiding technical team and drive overall program objectives.

Location: Leeds, UK (min 3 days onsite)

Contract Type: Long-term contract role with 6 months to begin with and extendable

  • Spark Architect

    1 month ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will play a key role in designing and implementing scalable data integration solutions using PySpark and Spark SQL.Key Responsibilities:Refactor Legacy ETL code using Prophecy low-code no-code and available...

  • Spark Architect

    1 month ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will play a key role in designing and implementing scalable data integration solutions using PySpark and Spark SQL.Key Responsibilities:Refactor Legacy ETL code using Prophecy low-code no-code and available...

  • Spark Architect

    1 month ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for refactoring Legacy ETL code into PySpark using Prophecy low-code no-code and available converters.Key Responsibilities:Refactor Legacy ETL code into PySpark using Prophecy low-code no-code...

  • Spark Architect

    1 month ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for refactoring Legacy ETL code into PySpark using Prophecy low-code no-code and available converters.Key Responsibilities:Refactor Legacy ETL code into PySpark using Prophecy low-code no-code...

  • Spark Architect

    1 month ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for designing and implementing scalable and efficient data integration solutions using PySpark and Spark SQL.The ideal candidate will have a deep understanding of Spark Data Integration,...

  • Spark Architect

    3 weeks ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for refactoring Legacy ETL code into PySpark using Prophecy low-code no-code and available converters.Key Responsibilities:Refactor Legacy ETL code into PySpark using Prophecy low-code no-code...

  • Spark Architect

    3 weeks ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for refactoring Legacy ETL code into PySpark using Prophecy low-code no-code and available converters.Key Responsibilities:Refactor Legacy ETL code into PySpark using Prophecy low-code no-code...

  • Spark Architect

    1 month ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for designing and implementing scalable and efficient data integration solutions using PySpark and Spark SQL.The ideal candidate will have a deep understanding of Spark Data Integration,...

  • Spark Architect

    1 month ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for designing and implementing scalable and efficient data integration solutions using PySpark.Key Responsibilities:Refactor Legacy ETL code into PySpark using Prophecy low-code no-code and...

  • Spark Architect

    1 month ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for designing and implementing scalable and efficient data integration solutions using PySpark.Key Responsibilities:Refactor Legacy ETL code into PySpark using Prophecy low-code no-code and...

  • Senior Spark Developer

    4 weeks ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for designing and implementing scalable data integration solutions using PySpark and Spark SQL.Key Responsibilities:Drive data integration upgrade to PySparkReview PySpark and Spark SQL jobs and...

  • Senior Spark Engineer

    1 month ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for driving data integration upgrades to PySpark and working with our clients to improve the performance of their Spark SQL jobs.Key Responsibilities:Drive data integration upgrades to...

  • Senior Spark Developer

    4 weeks ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking an experienced Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for driving data integration upgrades to PySpark and working with our clients to improve the performance of their Spark jobs.Key Responsibilities:Drive data integration upgrades to PySparkReview...

  • Senior Spark Developer

    4 weeks ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking an experienced Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for driving data integration upgrades to PySpark and working with our clients to improve the performance of their Spark jobs.Key Responsibilities:Drive data integration upgrades to PySparkReview...

  • Senior Spark Engineer

    1 month ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a key member of our Global Data Technology (GDT) team, you will be responsible for driving data integration upgrades to PySpark and ensuring the smooth operation of our data infrastructure.Key Responsibilities:Drive data integration...

  • Senior Spark Engineer

    1 month ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a key member of our Global Data Technology (GDT) team, you will be responsible for driving data integration upgrades to PySpark and ensuring the smooth operation of our Spark-based systems.Key Responsibilities:Drive data integration...

  • Senior Spark Developer

    1 month ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a key member of our Global Data Technology (GDT) team, you will be responsible for driving data integration upgrades to PySpark and ensuring the smooth operation of our data infrastructure.Key Responsibilities:Drive data integration...

  • Spark Architect

    2 months ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Job SummaryPRACYVA is seeking a highly skilled Spark Architect to join our team and lead the development of our Enterprise Data Integration platform using PySpark. As a key member of our Cloud Infrastructure team, you will be responsible for designing, implementing, and maintaining scalable and efficient data integration solutions on Cloud...

  • Spark Architect

    2 months ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Job SummaryPRACYVA is seeking a highly skilled Spark Architect to join our team and lead the development of our Enterprise Data Integration platform using PySpark. As a key member of our Cloud Infrastructure team, you will be responsible for designing, implementing, and maintaining scalable and efficient data integration solutions on Cloud...

  • Performance Architect

    4 weeks ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Job Title: Performance ArchitectJob Type: Full-timeCompany: PRACYVALocation: Remote (with occasional travel to client site)About the Role:We are seeking an experienced Performance Architect to join our team at PRACYVA. As a Performance Architect, you will be responsible for designing and implementing high-performance data integration solutions using Spark...