Spark Architect
2 weeks ago
Spark Architect / SME
Contract Role- 6 months to begin with & its extendable
Location: Leeds, UK (min 3 days onsite)
- Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.
- Converted code is causing failures/performance issues.
Skills:
- Spark Architecture – component understanding around Spark Data Integration (PySpark, scripting, variable setting etc.), Spark SQL, Spark Explain plans.
- Spark SME – Be able to analyse Spark code failures through Spark Plans and make correcting recommendations.
- Spark SME – Be able to review PySpark and Spark SQL jobs and make performance improvement recommendations.
- Spark – SME Be able to understand Data Frames / Resilient Distributed Data Sets and understand any memory related problems and make corrective recommendations.
- Monitoring – Be able to monitor Spark jobs using wider tools such as Grafana to see whether there are Cluster level failures.
- Cloudera (CDP) – Knowledge of understanding how Cloudera Spark is set up and how the run time libraries are used by PySpark code.
- Prophecy – High level understanding of Low-Code No-Code prophecy set up and its use to generate PySpark code.
-
Data Architect
2 weeks ago
Leeds, Leeds, United Kingdom Damia Group Full timeJob Description Spark/PySpark Architect - 12 months+ -£Inside IR35- Hybrid working of 3 days on site in Leeds My client are a Global Consultancy who are looking for a number of Spark/PySpark Architects to join them on a Long term programme. As the Spark architect, you will have the opportunity to work with one of the biggest IT landscapes in the world....
-
Solutions Architect
2 weeks ago
Leeds, Leeds, United Kingdom Fruition IT Full timeSolutions Architect - AWS Data PlatformUK Remote (very ad-hoc travel)Market Day Rate - Outside IR35Initial 6 months (high scope for extensions)Fruition IT are looking for an experienced Solutions Architect with extensive experience working across data platforms to join a well-recognised, highly regulated software focused business.As the Solutions Architect,...
-
Scala Developer
2 weeks ago
Leeds, Leeds, United Kingdom Osmii Full timeSpark Architect & Engineer Leeds 6 months initial length month engagement) As the Spark Architect, you will have the opportunity to work with one of the biggest IT landscapes in the world. You can also look forward to collaborating with senior leadership stakeholders, guiding technical teams, and driving overall program objectives. Responsibilities: As a...
-
Scala Developer
2 weeks ago
Leeds, Leeds, United Kingdom Osmii Full timeJob DescriptionSpark Architect & EngineerLeeds6 months initial length month engagement)As the Spark Architect, you will have the opportunity to work with one of the biggest IT landscapes in the world. You can also look forward to collaborating with senior leadership stakeholders, guiding technical teams, and driving overall program...
-
AWS Architect
2 weeks ago
Leeds, Leeds, United Kingdom Mastek Full timeThe ideal candidate will possess extensive knowledge and hands-on experience with Palantir Foundry, including its data integration, analytics, and operational decision-making capabilities. As a Palantir Foundry Specialist/Architect, you will be responsible for designing, developing, and maintaining data-driven solutions that leverage Palantir Foundry's...
-
Solution Architect
2 weeks ago
Leeds, Leeds, United Kingdom Grant Thornton LLP Full timeMore than you expectedGrant Thornton UK LLP is part of a global network of independent audit, tax and advisory firms, made up of some 58,000 people in over 135 countries. We're a team of independent thinkers who put quality, inclusion and integrity first. All around the world we bring a different experience to our clients. A better experience. One that...
-
Palantir Foundry Specialist/Architect
2 weeks ago
Leeds, Leeds, United Kingdom LSA Recruit Full timeJob DescriptionLocation: LeedsHybrid working 1-2 days in office.Contract- Inside IR35 (As per Market standards)Position Overview:We are seeking a highly skilled and experienced Palantir Foundry Specialist/Architect to join our team. The ideal candidate will possess extensive knowledge and hands-on experience with Palantir Foundry, including its data...
-
Azure Data Engineer
2 weeks ago
Leeds, Leeds, United Kingdom HCLTech Full timeJob description:Please make an application promptly if you are a good match for this role due to high levels of interest.hands-on experience in business intelligence development or data engineering experience,Solid experience with data modelling, data warehouse design and data lake concepts and practices; Exposure working in a Microsoft Azure Data Platform...
-
Lead Data Engineer
2 weeks ago
Leeds, Leeds, United Kingdom Asda Full timeLead Data Engineer - Leeds Job TitleLead Data EngineerLocationAsda HouseEmployment TypeFull timeContract TypePermanentHours Per Week37.5SalaryCompetitive salary plus benefitsCategorySoftware EngineeringClosing Date6 June 2024Your RoleWe are looking for an Azure Lead Engineer to join our Data Insights and Analytics team. The role will be responsible for...
-
Lead Data Engineer
4 weeks ago
Leeds, Leeds, United Kingdom Asda Full timeLead Data Engineer - Leeds Job TitleLead Data EngineerLocationAsda HouseEmployment TypeFull timeContract TypePermanentHours Per Week37.5SalaryCompetitive salary plus benefitsCategorySoftware EngineeringClosing Date6 June 2024Your RoleWe are looking for an Azure Lead Engineer to join our Data Insights and Analytics team. The role will be responsible for...
-
DevOps Engineer(Engineering)
2 weeks ago
Leeds, Leeds, United Kingdom Endeavour Recruitment Solutions Full timeEndeavour Recruitment has an exciting opportunity for a talented DevOps Engineer to join our client based in Leeds on a long-term contract. Candidates must be eligible for Security Clearance (SC). There is a daily rate in the region of £450.00 plus expenses. As a DevOps engineer you will be working as part of an agile team utilising your Linux...
-
Lead Data Engineer
2 weeks ago
Leeds, Leeds, United Kingdom Hunter Bond Full time £160,000Job title: Lead Data Engineer Client: Hyper Scaling ML Startup Salary: Up to £160,000 Location: London/Hybrid My client is seeking a Lead Data Engineer to own the delivery of scalable data pipelines that are critical to the entire firm's infrastructure. Being a Lead Data Engineer at a truly elite hedge fund, you will join an environment that prides...
-
Spark Architect
4 weeks ago
Leeds, United Kingdom PRACYVA Full timeSpark Architect / SMEnContract Role- 6 months to begin with & its extendablenLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.nConverted code is causing failures/performance issues.Skills:nSpark Architecture – component...
-
Spark Architect
4 weeks ago
Leeds, United Kingdom PRACYVA Full timeJob Description Spark Architect / SME Contract Role- 6 months to begin with & its extendable Location: Leeds, UK (min 3 days onsite) Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters. Converted code is causing failures/performance issues. Skills: Spark Architecture...
-
Spark Architect
4 weeks ago
Leeds, United Kingdom PRACYVA Full timeSpark Architect / SMEReady to make your application Please do read through the description at least once before clicking on Apply.Contract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available...
-
Spark Architect
4 weeks ago
Leeds, United Kingdom PRACYVA Full timeSpark Architect / SMEContract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.Converted code is causing failures/performance issues.Skills:Spark Architecture – component understanding...
-
Spark Architect
4 weeks ago
Leeds, United Kingdom PRACYVA Full timeSpark Architect / SMEReady to make your application Please do read through the description at least once before clicking on Apply.Contract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available...
-
Spark Architect
4 weeks ago
Leeds, United Kingdom PRACYVA Full timeSpark Architect / SME Contract Role- 6 months to begin with & its extendable Location: Leeds, UK (min 3 days onsite) Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters. Converted code is causing failures/performance issues. Skills: Spark Architecture – component...
-
Spark Architect
4 weeks ago
Leeds, United Kingdom PRACYVA Full timeSpark Architect / SMEContract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.Converted code is causing failures/performance issues.Skills:Spark Architecture – component understanding...
-
Spark Architect
4 weeks ago
Leeds, United Kingdom PRACYVA Full timeSpark Architect / SME Contract Role- 6 months to begin with & its extendable Location: Leeds, UK (min 3 days onsite) Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters. Converted code is causing failures/performance issues. Skills: Spark Architecture – component...
-
Spark Architect
4 weeks ago
Leeds, United Kingdom PRACYVA Full timeSpark Architect / SMEContract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.Converted code is causing failures/performance issues.Skills:Spark Architecture – component understanding...
-
Spark Architect
4 weeks ago
Leeds, United Kingdom PRACYVA Full timeSpark Architect / SME Contract Role- 6 months to begin with & its extendable Location: Leeds, UK (min 3 days onsite) Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters. Converted code is causing failures/performance issues. Skills: Spark Architecture – component...
-
Spark Architect
4 weeks ago
Leeds, United Kingdom PRACYVA Full timeSpark Architect / SMEContract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.Converted code is causing failures/performance issues.Skills:Spark Architecture – component understanding...
-
Data Architect
3 weeks ago
Leeds, United Kingdom Damia Group Ltd Full timeSpark/PySpark Architect - 12 months+ -£Inside IR35- Hybrid working of 3 days on site in LeedsMy client are a Global Consultancy who are looking for a number of Spark/PySpark Architects to join them on a Long term programme. As the Spark architect, you will have the opportunity to work with one of the biggest IT landscapes in the world. You can also look...
-
Data Architect
5 days ago
Leeds, United Kingdom Damia Group Ltd Full timeSpark/PySpark Architect - 12 months+ -£Inside IR35- Hybrid working of 3 days on site in LeedsMy client are a Global Consultancy who are looking for a number of Spark/PySpark Architects to join them on a Long term programme. As the Spark architect, you will have the opportunity to work with one of the biggest IT landscapes in the world. You can also look...
-
Data Architect
3 weeks ago
Leeds, United Kingdom Damia Group Ltd Full timeSpark/PySpark Architect - 12 months+ -£Inside IR35- Hybrid working of 3 days on site in Leeds My client are a Global Consultancy who are looking for a number of Spark/PySpark Architects to join them on a Long term programme. As the Spark architect, you will have the opportunity to work with one of the biggest IT landscapes in the world. You can also look...
-
Data Architect
3 weeks ago
Leeds, United Kingdom Damia Group Ltd Full timeSpark/PySpark Architect - 12 months+ -£Inside IR35- Hybrid working of 3 days on site in Leeds My client are a Global Consultancy who are looking for a number of Spark/PySpark Architects to join them on a Long term programme. As the Spark architect, you will have the opportunity to work with one of the biggest IT landscapes in the world. You can also look...
-
Data Architect
3 weeks ago
Leeds, United Kingdom Damia Group Ltd Full timeSpark/PySpark Architect - 12 months+ -£Inside IR35- Hybrid working of 3 days on site in Leeds My client are a Global Consultancy who are looking for a number of Spark/PySpark Architects to join them on a Long term programme. As the Spark architect, you will have the opportunity to work with one of the biggest IT landscapes in the world. You can also look...
-
Spark Architect
4 weeks ago
Leeds, UK, West Yorkshire, United Kingdom PRACYVA Full timeSpark Architect / SMEContract Role- 6 months to begin with & its extendableLocation: Leeds, UK (min 3 days onsite)Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.Converted code is causing failures/performance issues.Skills:Spark Architecture – component understanding...
-
Data Architect
2 days ago
Leeds, Yorkshire, United Kingdom Damia Group Ltd Full timeSpark/PySpark Architect - 12 months+ -£Inside IR35- Hybrid working of 3 days on site in LeedsConsidering applying for this job Do not delay, scroll down and make your application as soon as possible to avoid missing out.My client are a Global Consultancy who are looking for a number of Spark/PySpark Architects to join them on a Long term programme. As the...
-
Data Architect
2 weeks ago
Leeds, United Kingdom Damia Group Full timeSpark/PySpark Architect - 12 months+ -£Inside IR35- Hybrid working of 3 days on site in Leeds My client are a Global Consultancy who are looking for a number of Spark/PySpark Architects to join them on a Long term programme. As the Spark architect, you will have the opportunity to work with one of the biggest IT landscapes in the world. Drive Data...
-
Data Architect
2 weeks ago
Leeds, United Kingdom Damia Group Full timeSpark/PySpark Architect - 12 months+ -£Inside IR35- Hybrid working of 3 days on site in Leeds My client are a Global Consultancy who are looking for a number of Spark/PySpark Architects to join them on a Long term programme. As the Spark architect, you will have the opportunity to work with one of the biggest IT landscapes in the world. Drive Data...