Databricks - Gcp Architect

2 days ago

Ledston, United Kingdom Pracyva Full time

Responsibilities: Design, deploy, and manage Databricks clusters on Google Cloud Platform (GCP), ensuring optimal performance, scalability, and reliability.
Provide expertise in Databricks architecture, configuration, and administration, following best practices and industry standards.
Collaborate with data engineering, data science, and analytics teams to understand their requirements and provide technical guidance and solutions.
Optimize Databricks workloads and processes for performance, cost-efficiency, and scalability.
Monitor and troubleshoot Databricks clusters, identifying and resolving issues proactively.
Implement security measures and ensure compliance with data governance and privacy regulations.
Design and implement data pipelines and workflows, integrating Databricks with other GCP services and tools.
Stay up to date with the latest advancements in Databricks, GCP, and data engineering technologies, and evaluate their applicability to our environment.
Mentor junior team members, providing guidance and support in Databricks administration and architecture.
Requirements: Minimum of 5 years of experience as a Databricks Admin/Architect, with a strong focus on Google Cloud Platform (GCP).
Extensive experience in designing, deploying, and managing Databricks clusters, notebooks, jobs, and libraries.
Deep understanding of Databricks architecture, configuration, and performance optimization techniques.
Strong knowledge of GCP services, including Compute Engine, BigQuery, Cloud Storage, Dataflow, and Pub/Sub.
Proficiency in scripting languages like Python or Scala for automation, terraform, and data engineering tasks.
Experience with data engineering principles and tools, such as ETL, data pipelines, and data modeling.
Strong troubleshooting and problem-solving skills, with the ability to identify and resolve complex issues in a timely manner.
Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams.
GCP certifications, such as Google Cloud Certified - Data Engineer or Google Cloud Certified - Professional Cloud Architect, are highly desirable.

  • Gcp Databricks Architect

    1 week ago

    Ledston, United Kingdom Teksystems Full time

    GCP Data Bricks Architect My global client is looking for a GCP Data Bricks Architect to join their growing GCP Platform Team.You will need specific experience within GCP Data Bricks Architecture as well as the below experience:•Designing Databricks clusters within GCP.•Collaborate with various Data & DevOps teams to successfully meet tight...

  • Scaleneworks Inc | Databricks Architect

    2 days ago

    Ledston, United Kingdom Scaleneworks Inc Full time

    At ScaleneWorks People Solutions , we're more than recruiters; we're career architects dedicated to connecting exceptional talent with top-tier opportunities.Backed by industry experts, we prioritize relationships, offer global opportunities, and champion your success every step of the way.Ready to shape your future?Explore opportunities with us today.We are...

  • Gcp | Area Sales Manager

    3 days ago

    Ledston, United Kingdom Gcp Full time

    Why do we need you?At GCP (part of Saint-Gobain Construction Chemicals) we are looking for an Area Sales Manager – in this role you'll be solution selling, advising and pitching our products and systems across our waterproofing products.You'll be helping keep basements and car parks dry as well as structurally sound.Covering Ireland – North, anywhere...

  • Chief Data Architect

    1 week ago

    Ledston, United Kingdom Harnham Full time

    Harnham is seeking a Chief Data Architect to elevate their data infrastructure's reliability and scalability.Reporting to the Data & Analytics Director, you will drive the development of a larger data mesh setup while managing end-to-end DataOps/DevOps processes in a dynamic, small team.The role requires expertise in Azure/Databricks/Delta Lake, proficiency...

  • Data Architect

    3 weeks ago

    Ledston, United Kingdom Transition Partners Full time

    Exciting Opportunity for a Solutions Data Architect!Leeds City Centre (Hybrid) Are you ready to dive into the world of data architecture and shape the future of digital solutions?This is your chance to join a dynamic team at the forefront of innovation, creating impactful initiatives across various domains that touch millions worldwide!As a Solutions Data...

  • Data Architect

    3 weeks ago

    Ledston, United Kingdom Transition Partners Full time

    Exciting Opportunity for a Solutions Data Architect!Location: Leeds City Centre (Hybrid)Are you ready to dive into the world of data architecture and shape the future of digital solutions?This is your chance to join a dynamic team at the forefront of innovation, creating impactful initiatives across various domains that touch millions worldwide!Your...

  • Infrastructure Security Architect

    2 weeks ago

    Ledston, United Kingdom Ersg Ltd Full time

    Security Architect 6 months Inside IR35 This role is for an Infrastructure Security Architect, with primary skills, experience and expertise in the architecting and deployment of infrastructure services, both Public Cloud and traditional on-premises Datacentre with a strong background in security.You will will provide technical leadership, design,...

  • Data Engineer

    12 hours ago

    Ledston, United Kingdom Xpertise Recruitment Full time

    Data Engineer - Consultancy - Leeds (Flexible, hybrid working is encouraged) Xpertise Recruitment is seeking a data engineer to join an established tech consultancy in Leeds.Why should you want to join?You will be representing an award winning consultancy that are well-respected in the industry for taking on the biggest challenges and delivering excellent...

  • Engineer - Back End Developer

    3 weeks ago

    Ledston, United Kingdom Fruition It Full time

    Backend Software Engineer Leeds - 2x a week Fruition IT are working with a well-established tech-first business who are embarking on a complete technical transformation.This client is looking to bring in a Mid-Level Backend Software Engineer to work on a bespoke software platform as part of the business growth.The Backend Software Engineer will be...

  • Data Architect

    3 weeks ago

    Ledston, United Kingdom Bjss Full time

    Do you want to work with cutting edge data and analytics technologies to help our clients unlock their data potential and value?Do you want to lead and mentor teams of expert technologists on exciting data projects?Do you want to work in an environment that embraces your drive to learn?About Us We're an award-winning innovative tech consultancy - a team of...