Current jobs related to Data Architect - Leeds - Damia Group

  • Data Architect

    1 week ago

    Leeds, Leeds, United Kingdom Vallum Associates Full time

    Job Title: Data ArchitectVallum Associates is seeking a highly skilled Data Architect to join our team. As a Data Architect, you will be responsible for designing and implementing data systems that meet the needs of our clients.About the RoleThis is a unique opportunity to work with a leading company in the field of data management. As a Data Architect, you...

  • Data Architect

    1 week ago

    Leeds, Leeds, United Kingdom Vallum Associates Full time

    Job Title: Data ArchitectVallum Associates is seeking a highly skilled Data Architect to join our team. As a Data Architect, you will be responsible for designing and implementing data systems that meet the needs of our clients.About the RoleThis is a unique opportunity to work with a leading company in the field of data management. As a Data Architect, you...

  • Data Architect

    1 week ago

    Leeds, Leeds, United Kingdom Vallum Associates Full time

    Job Title: Data ArchitectVallum Associates is seeking a highly skilled Data Architect to join our team. As a Data Architect, you will be responsible for designing and implementing data systems that meet the needs of our clients.About the RoleThis is a unique opportunity to work with a leading company in the field of data management. As a Data Architect, you...

  • Data Architect

    1 week ago

    Leeds, Leeds, United Kingdom Vallum Associates Full time

    Job Title: Data ArchitectVallum Associates is seeking a highly skilled Data Architect to join our team. As a Data Architect, you will be responsible for designing and implementing data systems that meet the needs of our clients.About the RoleThis is a unique opportunity to work with a leading company in the field of data management. As a Data Architect, you...

  • Data Architect

    4 days ago

    Leeds, Leeds, United Kingdom FORT Full time

    {"The Opportunity": "We are seeking a highly skilled Solutions Architect to join our client's team in the pharma industry. As a Solutions Architect, you will be responsible for designing and implementing data-intensive projects, providing leadership and technical consultation on data analysis, data modeling, and designing data structures. Our client is a...

  • Data Architect

    4 days ago

    Leeds, Leeds, United Kingdom FORT Full time

    {"The Opportunity": "We are seeking a highly skilled Solutions Architect to join our client's team in the pharma industry. As a Solutions Architect, you will be responsible for designing and implementing data-intensive projects, providing leadership and technical consultation on data analysis, data modeling, and designing data structures. Our client is a...

  • Data Architect

    35 minutes ago

    Leeds, Leeds, United Kingdom Transition Partners Full time

    Exciting Opportunity for a Solutions Data Architect!Location: Leeds City Centre (Hybrid)We are seeking a highly skilled Solutions Data Architect to join our dynamic team at the forefront of innovation. As a Solutions Data Architect, you will play a key role in designing and delivering technical solutions that enhance data management, processing, and...

  • Data Architect

    5 days ago

    Leeds, Leeds, United Kingdom Vallum Associates Full time

    Job Title: Data ArchitectRole OverviewVallum Associates is seeking a highly skilled Data Architect to join our team. As a Data Architect, you will be responsible for designing and implementing data systems that meet the needs of our clients.Key ResponsibilitiesDeploy, support, and administer Databricks in the Cloud, including memory management, scheduling...

  • Data Architect

    5 days ago

    Leeds, Leeds, United Kingdom Vallum Associates Full time

    Job Title: Data ArchitectRole OverviewVallum Associates is seeking a highly skilled Data Architect to join our team. As a Data Architect, you will be responsible for designing and implementing data systems that meet the needs of our clients.Key ResponsibilitiesDeploy, support, and administer Databricks in the Cloud, including memory management, scheduling...

  • Data Architect

    3 days ago

    Leeds, Leeds, United Kingdom Vallum Associates Full time

    Job Title: Data ArchitectAt Vallum Associates, we are seeking a highly skilled Data Architect to join our team. As a Data Architect, you will play a crucial role in designing and implementing data solutions that meet the needs of our clients.Key Responsibilities:Design and implement data architectures that meet the needs of our clientsDeploy, support, and...

  • Data Architect

    2 days ago

    Leeds, Leeds, United Kingdom Vallum Associates Full time

    Job Title: Data ArchitectAt Vallum Associates, we are seeking a highly skilled Data Architect to join our team. As a Data Architect, you will play a crucial role in designing and implementing data solutions that meet the needs of our clients.Key Responsibilities:Design and implement data architectures that meet the needs of our clientsDeploy, support, and...

  • Data Architect

    3 days ago

    Leeds, Leeds, United Kingdom Vallum Associates Full time

    Role OverviewVallum Associates is seeking a highly skilled Data Architect to join our team. As a Data Architect, you will play a crucial role in designing and implementing data storage solutions for our clients.Key ResponsibilitiesDeploy, support, and administer Databricks in the Cloud, ensuring seamless data storage and processing.Manage cluster and jobs...

  • Data Architect

    3 days ago

    Leeds, Leeds, United Kingdom Vallum Associates Full time

    Role OverviewVallum Associates is seeking a highly skilled Data Architect to join our team. As a Data Architect, you will play a crucial role in designing and implementing data storage solutions for our clients.Key ResponsibilitiesDeploy, support, and administer Databricks in the Cloud, ensuring seamless data storage and processing.Manage cluster and jobs...

  • Data Architect

    1 week ago

    Leeds, Leeds, United Kingdom Vallum Associates Full time

    Role OverviewVallum Associates is seeking a highly skilled Data Architect to join our team. As a Data Architect, you will play a critical role in designing and implementing data solutions that drive business value.Key ResponsibilitiesDeploy, support, and administer Databricks in the Cloud, ensuring seamless data processing and analytics.Manage cluster and...

  • Data Architect

    1 week ago

    Leeds, Leeds, United Kingdom Vallum Associates Full time

    Role OverviewVallum Associates is seeking a highly skilled Data Architect to join our team. As a Data Architect, you will play a critical role in designing and implementing data solutions that drive business value.Key ResponsibilitiesDeploy, support, and administer Databricks in the Cloud, ensuring seamless data processing and analytics.Manage cluster and...

  • Data Architect

    2 weeks ago

    Leeds, Leeds, United Kingdom Vallum Associates Full time

    Role OverviewVallum Associates is seeking a highly skilled Data Architect to join our team. As a Data Architect, you will play a critical role in designing and implementing data solutions that drive business value.Key ResponsibilitiesDeploy, support, and administer Databricks in the Cloud, ensuring seamless data processing and analytics.Manage cluster and...

  • Data Architect

    2 weeks ago

    Leeds, Leeds, United Kingdom Vallum Associates Full time

    Role OverviewVallum Associates is seeking a highly skilled Data Architect to join our team. As a Data Architect, you will play a critical role in designing and implementing data solutions that drive business value.Key ResponsibilitiesDeploy, support, and administer Databricks in the Cloud, ensuring seamless data processing and analytics.Manage cluster and...

  • Data Architect

    2 days ago

    Leeds, Leeds, United Kingdom FORT Full time

    {"h1": "Solutions Architect Opportunity", "p": "FORT, a leading technical search consultancy, is seeking a skilled Solutions Architect to join our client's team. This is a unique opportunity to work with a not-for-profit organization that produces innovative products for the pharma industry, enabling the analysis of safety and effectiveness of life-saving...

  • Data Architect

    2 days ago

    Leeds, Leeds, United Kingdom FORT Full time

    {"h1": "Solutions Architect Opportunity", "p": "FORT, a leading technical search consultancy, is seeking a skilled Solutions Architect to join our client's team. This is a unique opportunity to work with a not-for-profit organization that produces innovative products for the pharma industry, enabling the analysis of safety and effectiveness of life-saving...

  • Data Architect

    1 month ago

    Leeds, United Kingdom PURVIEW Full time

    Data architect Initial 3 month contract with view to extend Hybrid - Leeds based Purview are currently recruiting of a software engineer for a Tier 1 banking client on an initial 3 month contract with view to extend. Responsibilities: Design, deploy, and manage Databricks clusters on Google Cloud Platform (GCP), ensuring optimal performance,...

Data Architect

3 months ago

Leeds, United Kingdom Damia Group Full time

Spark/PySpark Architect - 12 months+ -£Inside IR35- Hybrid working of 3 days on site in Leeds


My client are a Global Consultancy who are looking for a number of Spark/PySpark Architects to join them on a Long term programme. As the Spark architect, you will have the opportunity to work with one of the biggest IT landscapes in the world. You can also look forward to opportunity to collaborate with senior leadership stakeholders, guiding technical team and drive overall program objectives.


Responsibilities:

  • Working on an Enterprise scale Cloud infrastructure and Cloud Services in one of the Clouds (GCP).
  • Drive Data Integration upgrade to PySpark
  • Collaboration with multiple customer stakeholders
  • Knowledge of working with Cloud Databases
  • Excellent communication and solution presentation skills.
  • Able to analyse Spark code failures through Spark Plans and make correcting recommendations
  • Able to review PySpark and Spark SQL jobs and make performance improvement recommendations
  • Able to understand Data Frames / Resilient Distributed Data Sets and understand any memory related problems and make corrective recommendations
  • Able to monitor Spark jobs using wider tools such as Grafana to see whether there are Cluster level failures. As a Spark architect, who can demonstrate deep knowledge of how Cloudera Spark is set up and how the run time libraries are used by PySpark code.


Mandatory Skills

  • At least 12+ Years of IT Experience with Deep understanding of component understanding around Spark Data Integration (PySpark, scripting, variable setting etc.), Spark SQL, Spark Explain plans.
  • Spark SME – Be able to analyse Spark code failures through Spark Plans and make correcting recommendations.
  • To be able to traverse and explain the architecture you have been a part of and why any particular tool/technology was used.
  • Spark SME – Be able to review PySpark and Spark SQL jobs and make performance improvement recommendations.
  • Spark – SME Be able to understand Data Frames / Resilient Distributed Data Sets and understand any memory related problems and make corrective recommendations.
  • Monitoring –Spark jobs using wider tools such as Grafana to see whether there are Cluster level failures.
  • Cloudera (CDP) Spark and how the run time libraries are used by PySpark code.
  • Prophecy – High level understanding of Low-Code No-Code prophecy set up and its use to generate PySpark code.

Spark/PySpark Architect - 12 months+ -£Inside IR35- Hybrid working of 3 days on site in Leeds