Databricks Architect

3 weeks ago


London, UK, United Kingdom Insight International Ltd Full time

Responsibilities:

  • Design, deploy, and manage Databricks clusters on Google Cloud Platform (GCP), ensuring optimal performance, scalability, and reliability.
  • Provide expertise in Databricks architecture, configuration, and administration, following best practices and industry standards.
  • Collaborate with data engineering, data science, and analytics teams to understand their requirements and provide technical guidance and solutions.
  • Optimize Databricks workloads and processes for performance, cost-efficiency, and scalability.
  • Monitor and troubleshoot Databricks clusters, identifying and resolving issues proactively.
  • Implement security measures and ensure compliance with data governance and privacy regulations.
  • Design and implement data pipelines and workflows, integrating Databricks with other GCP services and tools.
  • Stay up to date with the latest advancements in Databricks, GCP, and data engineering technologies, and evaluate their applicability to our environment.
  • Mentor junior team members, providing guidance and support in Databricks administration and architecture.

Requirements:

  • Minimum of 5 years of experience as a Databricks Admin/Architect, with a strong focus on Google Cloud Platform (GCP).
  • Extensive experience in designing, deploying, and managing Databricks clusters, notebooks, jobs, and libraries.
  • Deep understanding of Databricks architecture, configuration, and performance optimization techniques.
  • Strong knowledge of GCP services, including Compute Engine, BigQuery, Cloud Storage, Dataflow, and Pub/Sub.
  • Proficiency in scripting languages like Python or Scala for automation, terraform, and data engineering tasks.
  • Experience with data engineering principles and tools, such as ETL, data pipelines, and data modeling.
  • Strong troubleshooting and problem-solving skills, with the ability to identify and resolve complex issues in a timely manner.
  • Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams.
  • GCP certifications, such as Google Cloud Certified - Data Engineer or Google Cloud Certified - Professional Cloud Architect, are highly desirable.



  • London,, UK, United Kingdom CodeVerse Full time

    Our client, a global Technology consultancy are seeking a Senior Data Architect to work within their public sector client base. What We Offer:Generous Salary PackageImpactful Work: Be a key player in driving data transformation and innovation.Professional Growth: Opportunities for continuous learning and development.Flexible Working: A remote working model...


  • London,, UK, United Kingdom Coforge Full time

    Role: Senior Cloud & Data ArchitectSkills: DWBI, Big Data and GCP/AWS/Azure platforms and ETL and Data ModellingLocation: London UKType: PermanentWe are at Coforge hiring for Senior Cloud & Data Architect with DWBI, Big Data and GCP/AWS/Azure platforms and ETL and Data Modelling16-18+ years of total experience in DWBI, Big Data, Cloud...

  • Cloud Architect

    1 month ago


    London,, UK, United Kingdom Middleware Talents Ltd Full time

    - 10 years of experience in big data, database and data warehouse architecture and delivery- Solution/technical architecture in the cloud- Big Data/analytics/information analysis/database management in the cloud- IoT/event-driven/microservices in the cloud- Experience with private and public cloud architectures, pros/cons, and migration considerations.-...


  • London,, UK, United Kingdom Eden Smith Group Full time

    Data Platform Technical ArchitectLondon/HybridSalary up to £90,000 plus generous bonusAn exciting opportunity has arisen to join a well-known organisation in the insurance space, within a Data Platform Technical Lead role. This represents the chance to embark on a greenfield project within a forward thinking company, who are looking to accelerate data...


  • London,, UK, United Kingdom Eden Smith Group Full time

    Data Platform Technical ArchitectLondon/HybridSalary up to £90,000 plus generous bonusAn exciting opportunity has arisen to join a well-known organisation in the insurance space, within a Data Platform Technical Lead role. This represents the chance to embark on a greenfield project within a forward thinking company, who are looking to accelerate data...

  • Lead Architect

    6 days ago


    London, UK, United Kingdom Canada Life Limited Full time

    Canada Life UK looks after the retirement, investment and protection needs of individuals, families and companies. We help to build better futures for our customers, our intermediaries and our employees by operating as a modern, agile and welcoming organisation. Part of our parent company Great-West Lifeco, Canada Life UK has operated in the United Kingdom...

  • Lead Architect

    6 days ago


    London, South East, UK, United Kingdom CANADA LIFE Part time

    Location: London, Potters Bar, Bristol or Isle of Man (Hybrid working options available)Canada Life UK looks after the retirement, investment and protection needs of individuals, families and companies. We help to build better futures for our customers, our intermediaries and our employees by operating as a modern, agile and welcoming organisation.Part of...

  • Azure DevOps Engineer

    1 month ago


    London,, UK, United Kingdom Vallum Associates Full time

    Contract Inside IR35London, UK (Hybrid - 3 days/week onsite)Must-Have:Recent banking/Financial Service experience is a must.Role RequirementsCore DevOps skills - IaC - CI/CD pipelines - Team City, Jenkins, GitLab, TerraformCore Azure skills - PaaS, Azure DevOps, Vault, (AKS nice to have)Microsoft Azure cloud platformSpark / DataBricks / Big Data experience...


  • London,, UK, United Kingdom Vallum Associates Full time

    Key SkillsDuration of assignment: 12 monthsMin days onsite: 3 days/week is mandatory.Location: London, UKRole RequirementsCloudera platform is used with hue, hive, HDFS and spark.Key SkillsTerraform, Shell/Powershell scripting - Strong skill expected!IaC, GitLab, CI/CD pipelinesAzure Data Factory / Azure Data Bricks Role RequirementsCore DevOps skills - IaC...


  • London,, UK, United Kingdom GlobalLogic UK&I Full time

    We are GlobalLogic, a Hitachi Group Company. Based across 23 countries, GlobalLogic is a global leader in digital product engineering. We help our clients design and build innovative products, platforms, and digital experiences for the modern world. By integrating our strategic design, complex engineering, and vertical industry expertise with Hitachi’s...

  • Cloud Engineer

    1 month ago


    London,, UK, United Kingdom HCLTech Full time

    We are hiring for cloud data engineer for the UK location ( not offering sponsorship)Job description:• Building new data pipelines and optimizing data flows using the Azure cloud stack.• Building data products from scratch.• Support Business Analysts and Data Architects with discovery and best practices.• Self-directed and comfortable supporting the...


  • London,, UK, United Kingdom Artefact Full time

    Senior Data Engineer Who we areArtefact is a new generation of data service provider, specialising in data consulting and data-driven digital marketing, dedicated to transforming data into business impact across the entire value chain of organisations. We are proud to say we’re enjoying skyrocketing growth.Our broad range of data-driven solutions in data...

  • Lead Data Engineer

    3 weeks ago


    London,, UK, United Kingdom Finatal Full time

    Job Title: Lead Data EngineerContract: Initial 3 MonthsLocation: London (Hybrid)EM003Company Overview:Join a dynamic, Private Equity-backed IT Services Business experiencing rapid growth and innovation. We are embarking on a greenfield data project and seeking a hands-on Data Engineer to build and deliver a proof of concept for a cutting-edge data solution,...


  • London,, UK, United Kingdom Algo Capital Group Full time

    Quantitative Software Engineer - Data EngineeringOur client is a leading proprietary trading firm that is seeking a Quantitative Software Engineer to join their Front Office Data Engineering team. The firm's team integrates innovative technology and trading strategies while utilizing a sophisticated research platform and development environment to...


  • London,, UK, United Kingdom Algo Capital Group Full time

    Quantitative Software Engineer - Data EngineeringOur client is a leading proprietary trading firm that is seeking a Quantitative Software Engineer to join their Front Office Data Engineering team in London. The firm's team integrates innovative technology and trading strategies while utilizing a sophisticated research platform and development environment...

  • AI Engineer

    1 week ago


    London, UK, United Kingdom Davies Consulting Full time

    AI Engineer Application Deadline: 30 January 2025 Department: IT Employment Type: Permanent - Full Time Location: Home United Kingdom Reporting To: James Sherdel Description The role Reporting into a Lead Developer, the AI Engineer will be responsible for implementing AI solutions for a varying range of clients. If successful, you will join a...


  • London, Greater London, United Kingdom Databricks Full time

    About the PositionWe are seeking a talented Cloud Data Solutions Architect to join our team. As an AV Solutions Engineer, you will work closely with customers to understand their data challenges and develop customized solutions using the Databricks Data Intelligence Platform. The ideal candidate will have excellent technical skills, including proficiency in...


  • London, Greater London, United Kingdom Databricks Full time

    As a Digital Sales Solutions Engineer at Databricks, you will play a pivotal role in shaping the future of data and AI for our clients. With an estimated salary range of $120,000 - $180,000 per year, this position offers a competitive compensation package.About the Role:This is a customer-facing technical sales role that requires expertise in Data Science /...


  • London, Greater London, United Kingdom Databricks Inc. Full time

    Job Title: Digital Solutions ArchitectThe estimated salary for this role is $120,000 - $180,000 per year.At Databricks Inc., we are seeking a highly skilled Digital Solutions Architect to join our team. As a Digital Solutions Architect, you will be responsible for creating excitement from clients about Databricks with our rich offering of 1-many webinars,...


  • London, Greater London, United Kingdom Databricks Inc. Full time

    Databricks Inc. is seeking a Cloud Data Architect to join our team in London, UK. The estimated salary for this role is £100,000 - £120,000 per annum.Job Description:We are looking for an experienced Cloud Data Architect to work with our customers and help them solve their complex data challenges using the Databricks Data Intelligence Platform. As a key...


  • London, United Kingdom Databricks Full time

    FEQ424R285 At Databricks, our core values are at the heart of everything we do; creating a culture of proactiveness and a customer-centric mindset guides us to create a unified platform that makes data science and analytics accessible to everyone. We aim to inspire our customers to make informed decisions that push their business forward. We provide a...


  • London, United Kingdom Databricks Full time

    As a Pre-sales Solutions Architect (aata engineering, analytics, AI, big data, public cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a key part of the sales team, acting as a technical advisor, and working with the product team as an advocate of your customers in the field. You will...


  • London, Greater London, United Kingdom Databricks Inc. Full time

    Job Title: Data Solutions ArchitectAbout the Role:As a Data Solutions Architect at Databricks Inc., you will play a key role in shaping our data and AI strategy. You will be responsible for designing and implementing scalable, secure, and efficient data solutions that meet the evolving needs of our customers.Key Responsibilities:• Collaborate with...


  • London, Greater London, United Kingdom Databricks Inc. Full time

    Job DescriptionWe are seeking a highly skilled Data Science Platform Architect to join our team at Databricks Inc. As a key member of our organization, you will be responsible for developing and implementing data science solutions that drive business growth and innovation.About the RoleYou will work closely with cross-functional teams to design and deploy...


  • London, Greater London, United Kingdom Databricks Inc. Full time

    Job Title: Sales Solutions Architect DirectorLocation: UK&I RegionSalary: £150,000 - £220,000 per annumAbout the RoleWe are seeking an experienced Sales Solutions Architect Director to join our team in the UK&I region. As a key member of our sales leadership team, you will be responsible for developing and executing sales strategies to drive revenue growth...

  • Senior Data Architect

    2 weeks ago


    London, Greater London, United Kingdom Databricks Inc. Full time

    We are seeking a highly skilled Senior Data Architect to join our team at Databricks Inc. This role offers an estimated salary of $150,000 per year.Job DescriptionIn this position, you will be responsible for designing and implementing data architectures that enable customers to leverage the power of big data analytics and AI.Collaborate with...


  • London, Greater London, United Kingdom Databricks Inc. Full time

    Job OverviewAs a Senior Cloud Solutions Architect at Databricks Inc., you will be responsible for guiding customers in building big data solutions on our platform. This role requires hands-on production experience with cloud infrastructure and big data technologies.


  • London, United Kingdom Databricks Inc. Full time

    At Databricks, we are on a mission to empower our customers to solve the world's toughest data problems by utilizing the Databricks Data Intelligence Platform. As a Delivery Solutions Architect (DSA), you will play an important role during this journey. You will collaborate with our sales and field engineering teams to accelerate the adoption and growth of...


  • London, Greater London, United Kingdom Databricks Inc. Full time

    About the Role:We are seeking an experienced Cloud Architect Specialist to join our team at Databricks Inc. in London.Key Responsibilities:Provide technical leadership to guide strategic customers to successful implementations on big data projects, ranging from architectural and security design to development and deployment best practices including...


  • London, Greater London, United Kingdom Databricks Inc. Full time

    About the RoleAs a Senior Field Engineer at Databricks Inc., you will lead a team of pre-sales Solutions Architects in the UK&I region, focusing on complex strategic accounts. Your experience in developing and managing high-performing teams will help drive revenue growth through effective partnerships with sales organisations.Your primary responsibility will...


  • London, Greater London, United Kingdom Insight International (UK) Ltd Full time

    Job SummaryDatabricks Architect is responsible for designing, deploying, and managing Databricks clusters on Google Cloud Platform (GCP) to ensure optimal performance, scalability, and reliability. The ideal candidate will have a strong focus on GCP services, including Compute Engine, BigQuery, Cloud Storage, Dataflow, and Pub/Sub.Responsibilities- Design,...


  • London, United Kingdom Databricks Full time

    **Req ID FEQ125R108** At Databricks, our core values are at the heart of everything we do; creating a culture of proactiveness and a customer-centric mindset guides us to create a unified platform that makes data science and analytics accessible to everyone. We aim to inspire our customers to make informed decisions that push their business forward. We...


  • London, Greater London, United Kingdom Databricks Full time

    We are looking for a Cloud Data Intelligence Specialist to join our team at Databricks. As a specialist, you will be responsible for providing technical and business value to clients throughout their assigned territory, collaborating with an Account Executive and a Senior Solutions Architect to achieve tangible outcomes.Experience working with Big Data...


  • London, United Kingdom Databricks Full time

    At Databricks, the Go-To-Market Sourcer plays an important role which is dynamic and exciting! The Talent Sourcer is an essential part of the organisation, building relationships with recruiters and hiring managers and developing sourcing strategies that ensure we attract some of the worlds best talent. We're looking for someone with a background in...


  • London, Greater London, United Kingdom Databricks Inc. Full time

    Databricks is seeking a cloud-based data intelligence architect to lead our efforts in designing and implementing innovative solutions for our customers. As a key member of our technical team, you will be responsible for developing and delivering high-quality solutions that meet the evolving needs of our customers.Key Responsibilities:Design and implement...


  • London, Greater London, United Kingdom Databricks Inc. Full time

    The estimated salary for this role is $150,000 - $220,000 per year, depending on experience and location.Databricks is the data and AI company, trusted by more than 10,000 organizations worldwide. As a Big Data Solutions Architect (Resident Solutions Architect) in our Professional Services team, you will work with clients on short to medium-term customer...