Spark Architect

1 month ago

Leeds UK, West Yorkshire, United Kingdom PRACYVA Full time

Spark Architect / SME

Contract Role- 6 months to begin with & its extendable

Location: Leeds, UK (min 3 days onsite)


  • Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.
  • Converted code is causing failures/performance issues.


Skills:

  • Spark Architecture – component understanding around Spark Data Integration (PySpark, scripting, variable setting etc.), Spark SQL, Spark Explain plans.
  • Spark SME – Be able to analyse Spark code failures through Spark Plans and make correcting recommendations.
  • Spark SME – Be able to review PySpark and Spark SQL jobs and make performance improvement recommendations.
  • Spark – SME Be able to understand Data Frames / Resilient Distributed Data Sets and understand any memory related problems and make corrective recommendations.
  • Monitoring – Be able to monitor Spark jobs using wider tools such as Grafana to see whether there are Cluster level failures.
  • Cloudera (CDP) – Knowledge of understanding how Cloudera Spark is set up and how the run time libraries are used by PySpark code.
  • Prophecy – High level understanding of Low-Code No-Code prophecy set up and its use to generate PySpark code.

  • Data Architect

    2 weeks ago

    Leeds, UK, West Yorkshire, United Kingdom Damia Group Full time

    Spark/PySpark Architect - 12 months+ -£Inside IR35- Hybrid working of 3 days on site in LeedsMy client are a Global Consultancy who are looking for a number of Spark/PySpark Architects to join them on a Long term programme. As the Spark architect, you will have the opportunity to work with one of the biggest IT landscapes in the world. You can also look...

  • Azure Data Engineer

    2 weeks ago

    Leeds, UK, West Yorkshire, United Kingdom HCLTech Full time

    Job description:hands-on experience in business intelligence development or data engineering experience,Solid experience with data modelling, data warehouse design and data lake concepts and practices; Exposure working in a Microsoft Azure Data Platform environment. Exposer inAzure Data Factory Azure StorageData Ingestion and Storage including Azure Data...

  • Lead GCP Architect

    2 weeks ago

    Sheffield, UK, South Yorkshire, United Kingdom Regal Cloud Full time

    Remote / Flexible to travel Duration till EOY We are seeking an experienced Lead Cloud Architect to join our clients' team within a major financial institution. This role demands robust technical expertise to deliver high-quality, large-scale IT solutions in the Cloud (GCP), aligning with the latest technological advances and on-premise requirements....

  • Machine Learning Engineer

    1 month ago

    Cheshire East, UK, North West England, United Kingdom Wipro Full time

    About Us:Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading global information technology, consulting, and business process services company. We harness the power of cognitive computing, hyper-automation, robotics, cloud, analytics and emerging technologies to help our clients adapt to the digital world and make them successful. A company...

  • Machine Learning Engineer

    4 weeks ago

    Cheshire East, UK, North West England, United Kingdom Wipro Full time

    About Us:Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading global information technology, consulting, and business process services company. We harness the power of cognitive computing, hyper-automation, robotics, cloud, analytics and emerging technologies to help our clients adapt to the digital world and make them successful. A company...

  • Sr. Data Analytics Engineer

    4 weeks ago

    Cheshire East, UK, North West England, United Kingdom Wipro Full time

    Job Title: Sr. Data Analytics EngineerLocation: Cheshire, United KingdomWork Mode: HybridPackage: Competitive + BenefitsStart Date: ASAPPermanent Role: YesResponsibilities:Help customers learn and use AWS services such as Athena, Glue, Lambda, S3, DynamoDB, NoSQL, Relational Database Service (RDS), Amazon EMR and Amazon RedshiftDeliver on-site technical...

  • Sr. Data Analytics Engineer

    4 weeks ago

    Cheshire East, UK, North West England, United Kingdom Wipro Full time

    Job Title: Sr. Data Analytics EngineerLocation: Cheshire, United KingdomWork Mode: HybridPackage: Competitive + BenefitsStart Date: ASAPPermanent Role: YesResponsibilities:Help customers learn and use AWS services such as Athena, Glue, Lambda, S3, DynamoDB, NoSQL, Relational Database Service (RDS), Amazon EMR and Amazon RedshiftDeliver on-site technical...

  • Spark Architect

    4 weeks ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SMEnContract Role- 6 months to begin with & its extendablenLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.nConverted code is causing failures/performance issues.Skills:nSpark Architecture – component...

  • Spark Architect

    1 month ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SMEnContract Role- 6 months to begin with & its extendablenLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.nConverted code is causing failures/performance issues.Skills:nSpark Architecture – component...

  • Spark Architect

    2 weeks ago

    Leeds, Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SMEContract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.Converted code is causing failures/performance issues.Skills:Spark Architecture – component understanding...

  • Spark Architect

    4 weeks ago

    Leeds, United Kingdom PRACYVA Full time

    Job Description Spark Architect / SME Contract Role- 6 months to begin with & its extendable Location: Leeds, UK (min 3 days onsite) Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters. Converted code is causing failures/performance issues. Skills: Spark Architecture...

  • Spark Architect

    4 weeks ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SMEReady to make your application Please do read through the description at least once before clicking on Apply.Contract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available...

  • Spark Architect

    1 month ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SME Contract Role- 6 months to begin with & its extendable Location: Leeds, UK (min 3 days onsite) Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters. Converted code is causing failures/performance issues. Skills: Spark Architecture – component...

  • Spark Architect

    2 months ago

    Leeds, United Kingdom PRACYVA Full time

    Job Description Spark Architect / SME Contract Role- 6 months to begin with & its extendable Location: Leeds, UK (min 3 days onsite) Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters. Converted code is causing failures/performance issues. Skills: Spark Architecture...

  • Spark Architect

    4 weeks ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SMEContract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.Converted code is causing failures/performance issues.Skills:Spark Architecture – component understanding...

  • Spark Architect

    2 months ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SMEReady to make your application Please do read through the description at least once before clicking on Apply.Contract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available...

  • Spark Architect

    2 months ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SMEReady to make your application Please do read through the description at least once before clicking on Apply.Contract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available...

  • Spark Architect

    2 months ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SMEContract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.Converted code is causing failures/performance issues.Skills:Spark Architecture – component understanding...

  • Spark Architect

    2 months ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SMEContract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.Converted code is causing failures/performance issues.Skills:Spark Architecture – component understanding...

  • Spark Architect

    2 months ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SME Contract Role- 6 months to begin with & its extendable Location: Leeds, UK (min 3 days onsite) Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters. Converted code is causing failures/performance issues. Skills: Spark Architecture – component...

  • Spark Architect

    4 weeks ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SME Contract Role- 6 months to begin with & its extendable Location: Leeds, UK (min 3 days onsite) Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters. Converted code is causing failures/performance issues. Skills: Spark Architecture – component...

  • Spark Architect

    4 weeks ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SMEContract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.Converted code is causing failures/performance issues.Skills:Spark Architecture – component understanding...

  • Spark Architect

    4 weeks ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SME Contract Role- 6 months to begin with & its extendable Location: Leeds, UK (min 3 days onsite) Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters. Converted code is causing failures/performance issues. Skills: Spark Architecture – component...

  • Spark Architect

    4 weeks ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SMEContract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.Converted code is causing failures/performance issues.Skills:Spark Architecture – component understanding...

  • Spark Architect

    2 months ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SMEContract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.Converted code is causing failures/performance issues.Skills:Spark Architecture – component understanding...

  • Spark Architect

    4 weeks ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SME Contract Role- 6 months to begin with & its extendable Location: Leeds, UK (min 3 days onsite) Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters. Converted code is causing failures/performance issues. Skills: Spark Architecture – component...

  • Spark Architect

    4 weeks ago

    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SMEReady to make your application Please do read through the description at least once before clicking on Apply.Contract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available...