Spark Architect

4 weeks ago

Leeds, United Kingdom PRACYVA Full time

Spark Architect / SME


Ready to make your application Please do read through the description at least once before clicking on Apply.

Contract Role- 6 months to begin with & its extendable

Location: Leeds, UK (min 3 days onsite)

  • Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.
  • Converted code is causing failures/performance issues.

Skills:

  • Spark Architecture – component understanding around Spark Data Integration (PySpark, scripting, variable setting etc.), Spark SQL, Spark Explain plans.
  • Spark SME – Be able to analyse Spark code failures through Spark Plans and make correcting recommendations.
  • Spark SME – Be able to review PySpark and Spark SQL jobs and make performance improvement recommendations.
  • Spark – SME Be able to understand Data Frames / Resilient Distributed Data Sets and understand any memory related problems and make corrective recommendations.
  • Monitoring – Be able to monitor Spark jobs using wider tools such as Grafana to see whether there are Cluster level failures.
  • Cloudera (CDP) – Knowledge of understanding how Cloudera Spark is set up and how the run time libraries are used by PySpark code.
  • Prophecy – High level understanding of Low-Code No-Code prophecy set up and its use to generate PySpark code.

  • Spark Architect

    4 weeks ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SMEnContract Role- 6 months to begin with & its extendablenLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.nConverted code is causing failures/performance issues.Skills:nSpark Architecture – component...

  • Spark Architect

    2 weeks ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SMEContract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.Converted code is causing failures/performance issues.Skills:Spark Architecture – component understanding...

  • Spark Architect

    4 weeks ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SME Contract Role- 6 months to begin with & its extendable Location: Leeds, UK (min 3 days onsite) Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters. Converted code is causing failures/performance issues. Skills: Spark Architecture – component...

  • Spark Architect

    4 weeks ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SMEContract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.Converted code is causing failures/performance issues.Skills:Spark Architecture – component understanding...

  • Spark Architect

    4 weeks ago

    Leeds, United Kingdom PRACYVA Full time

    Job Description Spark Architect / SME Contract Role- 6 months to begin with & its extendable Location: Leeds, UK (min 3 days onsite) Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters. Converted code is causing failures/performance issues. Skills: Spark Architecture...

  • Spark Architect

    4 weeks ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SMEContract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.Converted code is causing failures/performance issues.Skills:Spark Architecture – component understanding...

  • Spark Architect

    4 weeks ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SMEContract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.Converted code is causing failures/performance issues.Skills:Spark Architecture – component understanding...

  • Spark Architect

    4 weeks ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SME Contract Role- 6 months to begin with & its extendable Location: Leeds, UK (min 3 days onsite) Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters. Converted code is causing failures/performance issues. Skills: Spark Architecture – component...

  • Spark Architect

    4 weeks ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SME Contract Role- 6 months to begin with & its extendable Location: Leeds, UK (min 3 days onsite) Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters. Converted code is causing failures/performance issues. Skills: Spark Architecture – component...

  • Spark Architect

    4 weeks ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SMEReady to make your application Please do read through the description at least once before clicking on Apply.Contract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available...

  • Spark Architect

    4 weeks ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SMEContract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.Converted code is causing failures/performance issues.Skills:Spark Architecture – component understanding...

  • Data Architect

    3 weeks ago

    Leeds, United Kingdom Damia Group Ltd Full time

    Spark/PySpark Architect - 12 months+ -£Inside IR35- Hybrid working of 3 days on site in LeedsMy client are a Global Consultancy who are looking for a number of Spark/PySpark Architects to join them on a Long term programme. As the Spark architect, you will have the opportunity to work with one of the biggest IT landscapes in the world. You can also look...

  • Data Architect

    5 days ago

    Leeds, United Kingdom Damia Group Ltd Full time

    Spark/PySpark Architect - 12 months+ -£Inside IR35- Hybrid working of 3 days on site in LeedsMy client are a Global Consultancy who are looking for a number of Spark/PySpark Architects to join them on a Long term programme. As the Spark architect, you will have the opportunity to work with one of the biggest IT landscapes in the world. You can also look...

  • Data Architect

    3 weeks ago

    Leeds, United Kingdom Damia Group Ltd Full time

    Spark/PySpark Architect - 12 months+ -£Inside IR35- Hybrid working of 3 days on site in Leeds My client are a Global Consultancy who are looking for a number of Spark/PySpark Architects to join them on a Long term programme. As the Spark architect, you will have the opportunity to work with one of the biggest IT landscapes in the world. You can also look...

  • Data Architect

    3 weeks ago

    Leeds, United Kingdom Damia Group Ltd Full time

    Spark/PySpark Architect - 12 months+ -£Inside IR35- Hybrid working of 3 days on site in Leeds My client are a Global Consultancy who are looking for a number of Spark/PySpark Architects to join them on a Long term programme. As the Spark architect, you will have the opportunity to work with one of the biggest IT landscapes in the world. You can also look...

  • Data Architect

    3 weeks ago

    Leeds, United Kingdom Damia Group Ltd Full time

    Spark/PySpark Architect - 12 months+ -£Inside IR35- Hybrid working of 3 days on site in Leeds My client are a Global Consultancy who are looking for a number of Spark/PySpark Architects to join them on a Long term programme. As the Spark architect, you will have the opportunity to work with one of the biggest IT landscapes in the world. You can also look...

  • Spark Architect

    4 weeks ago

    Leeds, UK, West Yorkshire, United Kingdom PRACYVA Full time

    Spark Architect / SMEContract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.Converted code is causing failures/performance issues.Skills:Spark Architecture – component understanding...

  • Data Architect

    2 days ago

    Leeds, Yorkshire, United Kingdom Damia Group Ltd Full time

    Spark/PySpark Architect - 12 months+ -£Inside IR35- Hybrid working of 3 days on site in LeedsConsidering applying for this job Do not delay, scroll down and make your application as soon as possible to avoid missing out.My client are a Global Consultancy who are looking for a number of Spark/PySpark Architects to join them on a Long term programme. As the...

  • Data Architect

    2 weeks ago

    Leeds, United Kingdom Damia Group Full time

    Spark/PySpark Architect - 12 months+ -£Inside IR35- Hybrid working of 3 days on site in Leeds My client are a Global Consultancy who are looking for a number of Spark/PySpark Architects to join them on a Long term programme. As the Spark architect, you will have the opportunity to work with one of the biggest IT landscapes in the world. Drive Data...

  • Data Architect

    2 weeks ago

    Leeds, United Kingdom Damia Group Full time

    Spark/PySpark Architect - 12 months+ -£Inside IR35- Hybrid working of 3 days on site in Leeds My client are a Global Consultancy who are looking for a number of Spark/PySpark Architects to join them on a Long term programme. As the Spark architect, you will have the opportunity to work with one of the biggest IT landscapes in the world. Drive Data...