Spark Architect

4 days ago

Leeds, Leeds, United Kingdom PRACYVA Full time
Exciting Opportunity for a Spark Architect

We are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for refactoring Legacy ETL code into PySpark using Prophecy low-code no-code and available converters.

Key Responsibilities:
  • Refactor Legacy ETL code into PySpark using Prophecy low-code no-code and available converters.
  • Analyze Spark code failures through Spark Plans and make correcting recommendations.
  • Review PySpark and Spark SQL jobs and make performance improvement recommendations.
  • Understand Data Frames / Resilient Distributed Data Sets and understand any memory related problems and make corrective recommendations.
  • Monitor Spark jobs using wider tools such as Grafana to see whether there are Cluster level failures.
Requirements:
  • At least 12+ Years of IT Experience with Deep understanding of component understanding around Spark Data Integration (PySpark, scripting, variable setting etc.), Spark SQL, Spark Explain plans.
  • Ability to traverse and explain the architecture you have been a part of and why any particular tool/technology was used.
  • Spark SME – Be able to review PySpark and Spark SQL jobs and make performance improvement recommendations.
  • Spark – SME Be able to understand Data Frames / Resilient Distributed Data Sets and understand any memory related problems and make corrective recommendations.
What We Offer:

As a Spark Architect at PRACYVA, you will have the opportunity to work with one of the biggest IT landscapes in the world. You will also have the chance to collaborate with senior leadership stakeholders and drive overall program objectives.

  • Spark Architect

    7 days ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will play a key role in designing and implementing scalable data integration solutions using PySpark and Spark SQL.Key Responsibilities:Refactor Legacy ETL code using Prophecy low-code no-code and available...

  • Spark Architect

    7 days ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will play a key role in designing and implementing scalable data integration solutions using PySpark and Spark SQL.Key Responsibilities:Refactor Legacy ETL code using Prophecy low-code no-code and available...

  • Spark Architect

    3 days ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Job Title: Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for designing and implementing scalable and efficient data processing systems using Apache Spark.Job DescriptionThe ideal candidate will have a deep understanding of Spark Data Integration, PySpark, and Spark...

  • Spark Architect

    3 days ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Job Title: Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for designing and implementing scalable and efficient data processing systems using Apache Spark.Job DescriptionThe ideal candidate will have a deep understanding of Spark Data Integration, PySpark, and Spark...

  • Spark Architect

    6 days ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Job Title: Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for designing and implementing scalable and efficient data processing systems using Apache Spark.Job DescriptionThe ideal candidate will have a deep understanding of Spark Data Integration, PySpark, and Spark...

  • Spark Architect

    6 days ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Job Title: Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for designing and implementing scalable and efficient data processing systems using Apache Spark.Job DescriptionThe ideal candidate will have a deep understanding of Spark Data Integration, PySpark, and Spark...

  • Spark Architect

    2 weeks ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Job Title: Spark ArchitectAbout the Role:We are seeking an experienced Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for designing and implementing scalable data integration solutions using PySpark and Cloudera Spark.Key Responsibilities:Refactor Legacy ETL code into PySpark using Prophecy low-code no-code and...

  • Spark Architect

    2 weeks ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Job Title: Spark ArchitectAbout the Role:We are seeking an experienced Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for designing and implementing scalable data integration solutions using PySpark and Cloudera Spark.Key Responsibilities:Refactor Legacy ETL code into PySpark using Prophecy low-code no-code and...

  • Spark Architect

    21 hours ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for designing and implementing scalable and efficient data integration solutions using PySpark.Key Responsibilities:Refactor Legacy ETL code into PySpark using Prophecy low-code no-code and...

  • Spark Architect

    1 hour ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a Spark Architect, you will be responsible for designing and implementing scalable and efficient data integration solutions using PySpark.Key Responsibilities:Refactor Legacy ETL code into PySpark using Prophecy low-code no-code and...

  • Senior Spark Data Architect

    1 week ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a key member of our Global Data Technology (GDT) team, you will be responsible for driving data integration upgrades to PySpark and working on cutting-edge technology projects.Key Responsibilities:Drive data integration upgrades to...

  • Senior Spark Data Architect

    1 week ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a key member of our Global Data Technology (GDT) team, you will be responsible for driving data integration upgrades to PySpark and working on cutting-edge technology projects.Key Responsibilities:Drive data integration upgrades to...

  • Senior Spark Data Architect

    1 week ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a key member of our Global Data Technology (GDT) team, you will be responsible for driving data integration upgrades to PySpark and working on cutting-edge technology projects.Key Responsibilities:Drive data integration upgrades to...

  • Senior Spark Data Architect

    1 week ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a key member of our Global Data Technology (GDT) team, you will be responsible for driving data integration upgrades to PySpark and working on cutting-edge technology projects.Key Responsibilities:Drive data integration upgrades to...

  • Senior Spark Data Architect

    1 week ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a key member of our Global Data Technology (GDT) team, you will be responsible for driving data integration upgrades to PySpark and working on cutting-edge technology projects.Key Responsibilities:Drive data integration upgrades to...

  • Senior Spark Data Architect

    1 week ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a key member of our Global Data Technology (GDT) team, you will be responsible for driving data integration upgrades to PySpark and working on cutting-edge technology projects.Key Responsibilities:Drive data integration upgrades to...

  • Senior Spark Data Architect

    2 weeks ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a key member of our Global Data Technology (GDT) team, you will be responsible for driving data integration upgrades to PySpark and working on cutting-edge technology projects.Key Responsibilities:Drive data integration upgrades to...

  • Senior Spark Data Architect

    2 weeks ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a key member of our Global Data Technology (GDT) team, you will be responsible for driving data integration upgrades to PySpark and working on cutting-edge technology projects.Key Responsibilities:Drive data integration upgrades to...

  • Senior Spark Data Architect

    2 weeks ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a key member of our Global Data Technology (GDT) team, you will be responsible for driving data integration upgrades to PySpark and working on cutting-edge technology projects.Key Responsibilities:Drive data integration upgrades to...

  • Senior Spark Data Architect

    2 weeks ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Exciting Opportunity for a Spark ArchitectWe are seeking a highly skilled Spark Architect to join our team at PRACYVA. As a key member of our Global Data Technology (GDT) team, you will be responsible for driving data integration upgrades to PySpark and working on cutting-edge technology projects.Key Responsibilities:Drive data integration upgrades to...