Spark Architect

2 weeks ago

Leeds, United Kingdom PRACYVA Full time

Spark Architect / SME


Ready to make your application Please do read through the description at least once before clicking on Apply.

Contract Role- 6 months to begin with & its extendable

Location: Leeds, UK (min 3 days onsite)

  • Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.
  • Converted code is causing failures/performance issues.

Skills:

  • Spark Architecture – component understanding around Spark Data Integration (PySpark, scripting, variable setting etc.), Spark SQL, Spark Explain plans.
  • Spark SME – Be able to analyse Spark code failures through Spark Plans and make correcting recommendations.
  • Spark SME – Be able to review PySpark and Spark SQL jobs and make performance improvement recommendations.
  • Spark – SME Be able to understand Data Frames / Resilient Distributed Data Sets and understand any memory related problems and make corrective recommendations.
  • Monitoring – Be able to monitor Spark jobs using wider tools such as Grafana to see whether there are Cluster level failures.
  • Cloudera (CDP) – Knowledge of understanding how Cloudera Spark is set up and how the run time libraries are used by PySpark code.
  • Prophecy – High level understanding of Low-Code No-Code prophecy set up and its use to generate PySpark code.

  • Spark Architect

    5 days ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SMEnContract Role- 6 months to begin with & its extendablenLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.nConverted code is causing failures/performance issues.Skills:nSpark Architecture – component...

  • Spark Architect

    2 weeks ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SMEReady to make your application Please do read through the description at least once before clicking on Apply.Contract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available...

  • Spark Architect

    2 weeks ago

    Leeds, United Kingdom PRACYVA Full time

    Job Description Spark Architect / SME Contract Role- 6 months to begin with & its extendable Location: Leeds, UK (min 3 days onsite) Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters. Converted code is causing failures/performance issues. Skills: Spark Architecture...

  • Spark Architect

    2 weeks ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SMEContract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.Converted code is causing failures/performance issues.Skills:Spark Architecture – component understanding...

  • Spark Architect

    5 days ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SMEContract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.Converted code is causing failures/performance issues.Skills:Spark Architecture – component understanding...

  • Spark Architect

    2 weeks ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SME Contract Role- 6 months to begin with & its extendable Location: Leeds, UK (min 3 days onsite) Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters. Converted code is causing failures/performance issues. Skills: Spark Architecture – component...

  • Spark Architect

    2 weeks ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SMEContract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.Converted code is causing failures/performance issues.Skills:Spark Architecture – component understanding...

  • Spark Architect

    2 weeks ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SME Contract Role- 6 months to begin with & its extendable Location: Leeds, UK (min 3 days onsite) Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters. Converted code is causing failures/performance issues. Skills: Spark Architecture – component...

  • Spark Architect

    2 weeks ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SMEContract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.Converted code is causing failures/performance issues.Skills:Spark Architecture – component understanding...

  • Spark Architect

    12 hours ago

    Leeds, England, United Kingdom PRACYVA Full time

    Spark Architect / SMEHit Apply below to send your application for consideration Ensure that your CV is up to date, and that you have read the job specs first.Contract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code...

  • Spark Architect

    5 days ago

    Leeds, UK, West Yorkshire, United Kingdom PRACYVA Full time

    Spark Architect / SMEContract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.Converted code is causing failures/performance issues.Skills:Spark Architecture – component understanding...

  • Spark Architect

    1 week ago

    leeds, west yorkshire, United Kingdom PRACYVA Full time

    Spark Architect / SMEContract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.Converted code is causing failures/performance issues.Skills:Spark Architecture – component understanding...

  • Solutions Architect

    3 days ago

    Leeds, United Kingdom Fruition Consulting Full time

    Solutions Architect - Data Product UK Remote (very ad-hoc travel) Market Day Rate - Outside IR35 Initial 6 months (high scope for extensions) Fruition Consulting are looking for an experienced Solutions Architect with extensive experience working across data platforms to join a well-recognised, highly regulated software focused business. As the...

  • Solutions Architect

    3 days ago

    Leeds, United Kingdom Fruition Consulting Full time

    Solutions Architect - Data Product UK Remote (very ad-hoc travel)Market Day Rate - Outside IR35Initial 6 months (high scope for extensions)Fruition Consulting are looking for an experienced Solutions Architect with extensive experience working across data platforms to join a well-recognised, highly regulated software focused business.As the Solutions...

  • Solutions Architect

    6 days ago

    Leeds, United Kingdom Fruition Consulting Full time

    Solutions Architect - Data Product UK Remote (very ad-hoc travel)Market Day Rate - Outside IR35Initial 6 months (high scope for extensions)Fruition Consulting are looking for an experienced Solutions Architect with extensive experience working across data platforms to join a well-recognised, highly regulated software focused business.As the Solutions...

  • Solutions Architect

    3 days ago

    Leeds, United Kingdom Fruition Consulting Full time

    Solutions Architect - Data Product UK Remote (very ad-hoc travel)Market Day Rate - Outside IR35Initial 6 months (high scope for extensions)Fruition Consulting are looking for an experienced Solutions Architect with extensive experience working across data platforms to join a well-recognised, highly regulated software focused business.As the Solutions...

  • Solutions Architect

    5 days ago

    Leeds, United Kingdom Fruition Consulting Full time

    Solutions Architect - Data Product UK Remote (very ad-hoc travel)Market Day Rate - Outside IR35Initial 6 months (high scope for extensions)Fruition Consulting are looking for an experienced Solutions Architect with extensive experience working across data platforms to join a well-recognised, highly regulated software focused business.As the Solutions...

  • Solutions Architect

    4 days ago

    Leeds, United Kingdom Fruition Consulting Full time

    Solutions Architect - Data Product UK Remote (very ad-hoc travel) Market Day Rate - Outside IR35 Initial 6 months (high scope for extensions) Fruition Consulting are looking for an experienced Solutions Architect with extensive experience working across data platforms to join a well-recognised, highly regulated software focused business. As the Solutions...

  • Solutions Architect

    4 days ago

    Leeds, United Kingdom Fruition Consulting Full time

    Job Description Solutions Architect - Data Product UK Remote (very ad-hoc travel) Market Day Rate - Outside IR35 Initial 6 months (high scope for extensions) Fruition Consulting are looking for an experienced Solutions Architect with extensive experience working across data platforms to join a well-recognised, highly regulated software focused business. ...

  • Solutions Architect

    5 days ago

    Leeds, United Kingdom Fruition IT Full time

    Solutions Architect - AWS Data PlatformnUK Remote (very ad-hoc travel)nMarket Day Rate - Outside IR35nInitial 6 months (high scope for extensions)nFruition IT are looking for an experienced Solutions Architect with extensive experience working across data platforms to join a well-recognised, highly regulated software focused business.nAs the Solutions...