Spark Architect
4 weeks ago
Spark Architect / SME
Contract Role- 6 months to begin with & its extendable
Location: Leeds, UK (min 3 days onsite)
- Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.
- Converted code is causing failures/performance issues.
Skills:
- Spark Architecture – component understanding around Spark Data Integration (PySpark, scripting, variable setting etc.), Spark SQL, Spark Explain plans.
- Spark SME – Be able to analyse Spark code failures through Spark Plans and make correcting recommendations.
- Spark SME – Be able to review PySpark and Spark SQL jobs and make performance improvement recommendations.
- Spark – SME Be able to understand Data Frames / Resilient Distributed Data Sets and understand any memory related problems and make corrective recommendations.
- Monitoring – Be able to monitor Spark jobs using wider tools such as Grafana to see whether there are Cluster level failures.
- Cloudera (CDP) – Knowledge of understanding how Cloudera Spark is set up and how the run time libraries are used by PySpark code.
- Prophecy – High level understanding of Low-Code No-Code prophecy set up and its use to generate PySpark code.
-
Spark Architect
4 weeks ago
Leeds, United Kingdom PRACYVA Full timeSpark Architect / SMEnContract Role- 6 months to begin with & its extendablenLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.nConverted code is causing failures/performance issues.Skills:nSpark Architecture – component...
-
Spark Architect
2 weeks ago
Leeds, Leeds, United Kingdom PRACYVA Full timeSpark Architect / SMEContract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.Converted code is causing failures/performance issues.Skills:Spark Architecture – component understanding...
-
Spark Architect
4 weeks ago
Leeds, United Kingdom PRACYVA Full timeSpark Architect / SMEReady to make your application Please do read through the description at least once before clicking on Apply.Contract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available...
-
Spark Architect
4 weeks ago
Leeds, United Kingdom PRACYVA Full timeSpark Architect / SMEContract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.Converted code is causing failures/performance issues.Skills:Spark Architecture – component understanding...
-
Spark Architect
4 weeks ago
Leeds, United Kingdom PRACYVA Full timeSpark Architect / SMEReady to make your application Please do read through the description at least once before clicking on Apply.Contract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available...
-
Spark Architect
4 weeks ago
Leeds, United Kingdom PRACYVA Full timeSpark Architect / SME Contract Role- 6 months to begin with & its extendable Location: Leeds, UK (min 3 days onsite) Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters. Converted code is causing failures/performance issues. Skills: Spark Architecture – component...
-
Spark Architect
4 weeks ago
Leeds, United Kingdom PRACYVA Full timeSpark Architect / SMEContract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.Converted code is causing failures/performance issues.Skills:Spark Architecture – component understanding...
-
Spark Architect
4 weeks ago
Leeds, United Kingdom PRACYVA Full timeSpark Architect / SME Contract Role- 6 months to begin with & its extendable Location: Leeds, UK (min 3 days onsite) Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters. Converted code is causing failures/performance issues. Skills: Spark Architecture – component...
-
Spark Architect
4 weeks ago
Leeds, United Kingdom PRACYVA Full timeSpark Architect / SMEContract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.Converted code is causing failures/performance issues.Skills:Spark Architecture – component understanding...
-
Spark Architect
4 weeks ago
Leeds, United Kingdom PRACYVA Full timeSpark Architect / SME Contract Role- 6 months to begin with & its extendable Location: Leeds, UK (min 3 days onsite) Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters. Converted code is causing failures/performance issues. Skills: Spark Architecture – component...
-
Spark Architect
4 weeks ago
Leeds, United Kingdom PRACYVA Full timeSpark Architect / SMEContract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.Converted code is causing failures/performance issues.Skills:Spark Architecture – component understanding...
-
Data Architect
3 weeks ago
Leeds, United Kingdom Damia Group Ltd Full timeSpark/PySpark Architect - 12 months+ -£Inside IR35- Hybrid working of 3 days on site in LeedsMy client are a Global Consultancy who are looking for a number of Spark/PySpark Architects to join them on a Long term programme. As the Spark architect, you will have the opportunity to work with one of the biggest IT landscapes in the world. You can also look...
-
Data Architect
5 days ago
Leeds, United Kingdom Damia Group Ltd Full timeSpark/PySpark Architect - 12 months+ -£Inside IR35- Hybrid working of 3 days on site in LeedsMy client are a Global Consultancy who are looking for a number of Spark/PySpark Architects to join them on a Long term programme. As the Spark architect, you will have the opportunity to work with one of the biggest IT landscapes in the world. You can also look...
-
Data Architect
3 weeks ago
Leeds, United Kingdom Damia Group Ltd Full timeSpark/PySpark Architect - 12 months+ -£Inside IR35- Hybrid working of 3 days on site in Leeds My client are a Global Consultancy who are looking for a number of Spark/PySpark Architects to join them on a Long term programme. As the Spark architect, you will have the opportunity to work with one of the biggest IT landscapes in the world. You can also look...
-
Data Architect
3 weeks ago
Leeds, United Kingdom Damia Group Ltd Full timeSpark/PySpark Architect - 12 months+ -£Inside IR35- Hybrid working of 3 days on site in Leeds My client are a Global Consultancy who are looking for a number of Spark/PySpark Architects to join them on a Long term programme. As the Spark architect, you will have the opportunity to work with one of the biggest IT landscapes in the world. You can also look...
-
Data Architect
3 weeks ago
Leeds, United Kingdom Damia Group Ltd Full timeSpark/PySpark Architect - 12 months+ -£Inside IR35- Hybrid working of 3 days on site in Leeds My client are a Global Consultancy who are looking for a number of Spark/PySpark Architects to join them on a Long term programme. As the Spark architect, you will have the opportunity to work with one of the biggest IT landscapes in the world. You can also look...
-
Spark Architect
4 weeks ago
Leeds, UK, West Yorkshire, United Kingdom PRACYVA Full timeSpark Architect / SMEContract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.Converted code is causing failures/performance issues.Skills:Spark Architecture – component understanding...
-
Data Architect
2 days ago
Leeds, Yorkshire, United Kingdom Damia Group Ltd Full timeSpark/PySpark Architect - 12 months+ -£Inside IR35- Hybrid working of 3 days on site in LeedsConsidering applying for this job Do not delay, scroll down and make your application as soon as possible to avoid missing out.My client are a Global Consultancy who are looking for a number of Spark/PySpark Architects to join them on a Long term programme. As the...
-
Data Architect
2 weeks ago
Leeds, United Kingdom Damia Group Full timeSpark/PySpark Architect - 12 months+ -£Inside IR35- Hybrid working of 3 days on site in Leeds My client are a Global Consultancy who are looking for a number of Spark/PySpark Architects to join them on a Long term programme. As the Spark architect, you will have the opportunity to work with one of the biggest IT landscapes in the world. Drive Data...
-
Data Architect
2 weeks ago
Leeds, United Kingdom Damia Group Full timeSpark/PySpark Architect - 12 months+ -£Inside IR35- Hybrid working of 3 days on site in Leeds My client are a Global Consultancy who are looking for a number of Spark/PySpark Architects to join them on a Long term programme. As the Spark architect, you will have the opportunity to work with one of the biggest IT landscapes in the world. Drive Data...