Spark Architect

2 weeks ago


Leeds, Leeds, United Kingdom PRACYVA Full time

Spark Architect / SME

Contract Role- 6 months to begin with & its extendable

Location: Leeds, UK (min 3 days onsite)

  • Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.
  • Converted code is causing failures/performance issues.

Skills:

  • Spark Architecture – component understanding around Spark Data Integration (PySpark, scripting, variable setting etc.), Spark SQL, Spark Explain plans.
  • Spark SME – Be able to analyse Spark code failures through Spark Plans and make correcting recommendations.
  • Spark SME – Be able to review PySpark and Spark SQL jobs and make performance improvement recommendations.
  • Spark – SME Be able to understand Data Frames / Resilient Distributed Data Sets and understand any memory related problems and make corrective recommendations.
  • Monitoring – Be able to monitor Spark jobs using wider tools such as Grafana to see whether there are Cluster level failures.
  • Cloudera (CDP) – Knowledge of understanding how Cloudera Spark is set up and how the run time libraries are used by PySpark code.
  • Prophecy – High level understanding of Low-Code No-Code prophecy set up and its use to generate PySpark code.

  • Data Architect

    2 weeks ago


    Leeds, Leeds, United Kingdom Damia Group Full time

    Job Description Spark/PySpark Architect - 12 months+ -£Inside IR35- Hybrid working of 3 days on site in Leeds My client are a Global Consultancy who are looking for a number of Spark/PySpark Architects to join them on a Long term programme. As the Spark architect, you will have the opportunity to work with one of the biggest IT landscapes in the world....

  • Solutions Architect

    2 weeks ago


    Leeds, Leeds, United Kingdom Fruition IT Full time

    Solutions Architect - AWS Data PlatformUK Remote (very ad-hoc travel)Market Day Rate - Outside IR35Initial 6 months (high scope for extensions)Fruition IT are looking for an experienced Solutions Architect with extensive experience working across data platforms to join a well-recognised, highly regulated software focused business.As the Solutions Architect,...

  • Scala Developer

    2 weeks ago


    Leeds, Leeds, United Kingdom Osmii Full time

    Spark Architect & Engineer Leeds 6 months initial length month engagement) As the Spark Architect, you will have the opportunity to work with one of the biggest IT landscapes in the world. You can also look forward to collaborating with senior leadership stakeholders, guiding technical teams, and driving overall program objectives. Responsibilities: As a...

  • Scala Developer

    2 weeks ago


    Leeds, Leeds, United Kingdom Osmii Full time

    Job DescriptionSpark Architect & EngineerLeeds6 months initial length month engagement)As the Spark Architect, you will have the opportunity to work with one of the biggest IT landscapes in the world. You can also look forward to collaborating with senior leadership stakeholders, guiding technical teams, and driving overall program...

  • AWS Architect

    2 weeks ago


    Leeds, Leeds, United Kingdom Mastek Full time

    The ideal candidate will possess extensive knowledge and hands-on experience with Palantir Foundry, including its data integration, analytics, and operational decision-making capabilities. As a Palantir Foundry Specialist/Architect, you will be responsible for designing, developing, and maintaining data-driven solutions that leverage Palantir Foundry's...

  • Solution Architect

    2 weeks ago


    Leeds, Leeds, United Kingdom Grant Thornton LLP Full time

    More than you expectedGrant Thornton UK LLP is part of a global network of independent audit, tax and advisory firms, made up of some 58,000 people in over 135 countries. We're a team of independent thinkers who put quality, inclusion and integrity first. All around the world we bring a different experience to our clients. A better experience. One that...


  • Leeds, Leeds, United Kingdom LSA Recruit Full time

    Job DescriptionLocation: LeedsHybrid working 1-2 days in office.Contract- Inside IR35 (As per Market standards)Position Overview:We are seeking a highly skilled and experienced Palantir Foundry Specialist/Architect to join our team. The ideal candidate will possess extensive knowledge and hands-on experience with Palantir Foundry, including its data...

  • Azure Data Engineer

    2 weeks ago


    Leeds, Leeds, United Kingdom HCLTech Full time

    Job description:Please make an application promptly if you are a good match for this role due to high levels of interest.hands-on experience in business intelligence development or data engineering experience,Solid experience with data modelling, data warehouse design and data lake concepts and practices; Exposure working in a Microsoft Azure Data Platform...

  • Lead Data Engineer

    2 weeks ago


    Leeds, Leeds, United Kingdom Asda Full time

    Lead Data Engineer - Leeds Job TitleLead Data EngineerLocationAsda HouseEmployment TypeFull timeContract TypePermanentHours Per Week37.5SalaryCompetitive salary plus benefitsCategorySoftware EngineeringClosing Date6 June 2024Your RoleWe are looking for an Azure Lead Engineer to join our Data Insights and Analytics team. The role will be responsible for...

  • Lead Data Engineer

    4 weeks ago


    Leeds, Leeds, United Kingdom Asda Full time

    Lead Data Engineer - Leeds Job TitleLead Data EngineerLocationAsda HouseEmployment TypeFull timeContract TypePermanentHours Per Week37.5SalaryCompetitive salary plus benefitsCategorySoftware EngineeringClosing Date6 June 2024Your RoleWe are looking for an Azure Lead Engineer to join our Data Insights and Analytics team. The role will be responsible for...


  • Leeds, Leeds, United Kingdom Endeavour Recruitment Solutions Full time

    Endeavour Recruitment has an exciting opportunity for a talented DevOps Engineer to join our client based in Leeds on a long-term contract. Candidates must be eligible for Security Clearance (SC). There is a daily rate in the region of £450.00 plus expenses. As a DevOps engineer you will be working as part of an agile team utilising your Linux...

  • Lead Data Engineer

    2 weeks ago


    Leeds, Leeds, United Kingdom Hunter Bond Full time £160,000

    Job title: Lead Data Engineer Client: Hyper Scaling ML Startup Salary: Up to £160,000 Location: London/Hybrid My client is seeking a Lead Data Engineer to own the delivery of scalable data pipelines that are critical to the entire firm's infrastructure. Being a Lead Data Engineer at a truly elite hedge fund, you will join an environment that prides...

  • Spark Architect

    4 weeks ago


    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SMEnContract Role- 6 months to begin with & its extendablenLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.nConverted code is causing failures/performance issues.Skills:nSpark Architecture – component...

  • Spark Architect

    4 weeks ago


    Leeds, United Kingdom PRACYVA Full time

    Job Description Spark Architect / SME Contract Role- 6 months to begin with & its extendable Location: Leeds, UK (min 3 days onsite) Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters. Converted code is causing failures/performance issues. Skills: Spark Architecture...

  • Spark Architect

    4 weeks ago


    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SMEReady to make your application Please do read through the description at least once before clicking on Apply.Contract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available...

  • Spark Architect

    4 weeks ago


    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SMEContract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.Converted code is causing failures/performance issues.Skills:Spark Architecture – component understanding...

  • Spark Architect

    4 weeks ago


    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SMEReady to make your application Please do read through the description at least once before clicking on Apply.Contract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available...

  • Spark Architect

    4 weeks ago


    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SME Contract Role- 6 months to begin with & its extendable Location: Leeds, UK (min 3 days onsite) Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters. Converted code is causing failures/performance issues. Skills: Spark Architecture – component...

  • Spark Architect

    4 weeks ago


    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SMEContract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.Converted code is causing failures/performance issues.Skills:Spark Architecture – component understanding...

  • Spark Architect

    4 weeks ago


    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SME Contract Role- 6 months to begin with & its extendable Location: Leeds, UK (min 3 days onsite) Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters. Converted code is causing failures/performance issues. Skills: Spark Architecture – component...

  • Spark Architect

    4 weeks ago


    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SMEContract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.Converted code is causing failures/performance issues.Skills:Spark Architecture – component understanding...

  • Spark Architect

    4 weeks ago


    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SME Contract Role- 6 months to begin with & its extendable Location: Leeds, UK (min 3 days onsite) Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters. Converted code is causing failures/performance issues. Skills: Spark Architecture – component...

  • Spark Architect

    4 weeks ago


    Leeds, United Kingdom PRACYVA Full time

    Spark Architect / SMEContract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.Converted code is causing failures/performance issues.Skills:Spark Architecture – component understanding...

  • Data Architect

    3 weeks ago


    Leeds, United Kingdom Damia Group Ltd Full time

    Spark/PySpark Architect - 12 months+ -£Inside IR35- Hybrid working of 3 days on site in LeedsMy client are a Global Consultancy who are looking for a number of Spark/PySpark Architects to join them on a Long term programme. As the Spark architect, you will have the opportunity to work with one of the biggest IT landscapes in the world. You can also look...

  • Data Architect

    5 days ago


    Leeds, United Kingdom Damia Group Ltd Full time

    Spark/PySpark Architect - 12 months+ -£Inside IR35- Hybrid working of 3 days on site in LeedsMy client are a Global Consultancy who are looking for a number of Spark/PySpark Architects to join them on a Long term programme. As the Spark architect, you will have the opportunity to work with one of the biggest IT landscapes in the world. You can also look...

  • Data Architect

    3 weeks ago


    Leeds, United Kingdom Damia Group Ltd Full time

    Spark/PySpark Architect - 12 months+ -£Inside IR35- Hybrid working of 3 days on site in Leeds My client are a Global Consultancy who are looking for a number of Spark/PySpark Architects to join them on a Long term programme. As the Spark architect, you will have the opportunity to work with one of the biggest IT landscapes in the world. You can also look...

  • Data Architect

    3 weeks ago


    Leeds, United Kingdom Damia Group Ltd Full time

    Spark/PySpark Architect - 12 months+ -£Inside IR35- Hybrid working of 3 days on site in Leeds My client are a Global Consultancy who are looking for a number of Spark/PySpark Architects to join them on a Long term programme. As the Spark architect, you will have the opportunity to work with one of the biggest IT landscapes in the world. You can also look...

  • Data Architect

    3 weeks ago


    Leeds, United Kingdom Damia Group Ltd Full time

    Spark/PySpark Architect - 12 months+ -£Inside IR35- Hybrid working of 3 days on site in Leeds My client are a Global Consultancy who are looking for a number of Spark/PySpark Architects to join them on a Long term programme. As the Spark architect, you will have the opportunity to work with one of the biggest IT landscapes in the world. You can also look...

  • Spark Architect

    4 weeks ago


    Leeds, UK, West Yorkshire, United Kingdom PRACYVA Full time

    Spark Architect / SMEContract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.Converted code is causing failures/performance issues.Skills:Spark Architecture – component understanding...

  • Data Architect

    2 days ago


    Leeds, Yorkshire, United Kingdom Damia Group Ltd Full time

    Spark/PySpark Architect - 12 months+ -£Inside IR35- Hybrid working of 3 days on site in LeedsConsidering applying for this job Do not delay, scroll down and make your application as soon as possible to avoid missing out.My client are a Global Consultancy who are looking for a number of Spark/PySpark Architects to join them on a Long term programme. As the...

  • Data Architect

    2 weeks ago


    Leeds, United Kingdom Damia Group Full time

    Spark/PySpark Architect - 12 months+ -£Inside IR35- Hybrid working of 3 days on site in Leeds My client are a Global Consultancy who are looking for a number of Spark/PySpark Architects to join them on a Long term programme. As the Spark architect, you will have the opportunity to work with one of the biggest IT landscapes in the world. Drive Data...

  • Data Architect

    2 weeks ago


    Leeds, United Kingdom Damia Group Full time

    Spark/PySpark Architect - 12 months+ -£Inside IR35- Hybrid working of 3 days on site in Leeds My client are a Global Consultancy who are looking for a number of Spark/PySpark Architects to join them on a Long term programme. As the Spark architect, you will have the opportunity to work with one of the biggest IT landscapes in the world. Drive Data...