Current jobs related to Experienced Databricks Unity Catalog Engineer - London, Greater London - Amber Labs

  • Databricks AI Solutions Architect

    3 weeks ago

    London, Greater London, United Kingdom Databricks Full time

    About the Role:We are seeking a highly skilled Databricks AI Solutions Architect to join our team. As a key member of our organization, you will play a crucial role in designing and delivering cloud-based Data Warehousing Solutions for our clients.Key Responsibilities:Design and deliver cloud-based Data Warehousing Solutions in a client or customer...

  • Technical Developer Advocate at Unity

    3 weeks ago

    London, Greater London, United Kingdom Unity Full time

    At Unity, we are seeking a skilled Agile Software Engineer to join our growing team focused on self-service tools and infrastructure. The successful candidate will be responsible for developing, maintaining, and operating application services, systems automation, and monitoring.Key Responsibilities:Design, develop, and deploy high-quality software...

  • Senior Engineering Program Manager

    3 weeks ago

    London, Greater London, United Kingdom Unity Full time

    About UsThe Unity Platform OS teams are seeking a skilled Senior Engineering Program Manager to lead the development of next-generation real-time, 3D content creation tools. This role will drive program success, delivering features and workflows that enable external partners to build once and deploy across multiple platforms.What You'll Be DoingYou will...

  • Staff Data Platform Engineer

    3 weeks ago

    London, Greater London, United Kingdom 1E Full time

    Estimated Salary: £120,000 - £150,000 per annumAbout the Role:We are seeking a highly skilled Staff Data Platform Engineer to join our team at 1E. As a key member of our engineering department, you will play a pivotal role in shaping and executing our data strategy.Company Overview:1E is a leading provider of IT automation solutions that help organizations...

  • Data Engineering Solutions Specialist

    4 weeks ago

    London, Greater London, United Kingdom Databricks Full time

    Databricks is revolutionizing the way businesses solve complex data problems. As a Delivery Solutions Architect, you will play a crucial role in accelerating the adoption and growth of our Intelligence platform.With 7+ years of experience in technical program delivery, you will collaborate with our sales and field engineering teams to ensure customer...

  • Data Engineering Specialist: Unlocking Business Value through Data Science

    3 weeks ago

    London, Greater London, United Kingdom Databricks Full time

    We are seeking a talented Data Engineer to join our team at Databricks, a leading data and AI company. In this role, you will be responsible for demonstrating the capabilities of our Databricks Data Intelligence Platform to customers and helping them solve complex data challenges.About the RoleThis is an excellent opportunity for a seasoned Data Engineer to...

  • Software Engineer Unity

    2 days ago

    London, Greater London, United Kingdom Endeavour Recruitment Solutions Full time

    Job Description:We are seeking a highly skilled and motivated Unity and C# developer to join our team on a contract basis. As part of this exciting opportunity, you will work closely with designers and artists to create engaging front-end experiences and applications in Unity, including 3D environments, menus, and other UI components.Key...

  • Data Analyst and Catalog Engineer

    4 weeks ago

    London, Greater London, United Kingdom Amazon UK Services Ltd. - A10 Full time

    Job SummaryWe are seeking a highly skilled Data Analyst and Catalog Engineer to join our team at Amazon UK Services Ltd. - A10.

  • Delivery Solutions Architect Lead

    4 weeks ago

    London, Greater London, United Kingdom Databricks Full time

    Company OverviewDatabricks is a leading cloud-based data analytics platform that empowers businesses to solve complex data problems. As a key member of our team, you will play a critical role in helping our customers achieve success with our platform.Salary: $140,000 - $180,000 per yearJob Description:We are seeking an experienced Delivery Solutions...

  • Senior Data Engineer

    3 weeks ago

    London, Greater London, United Kingdom The Crown Estate Full time

    We are seeking an experienced Senior Data Engineer to join our team and contribute to the development of cutting-edge data solutions using Azure cloud platform.About The Crown EstateThe Crown Estate is a unique business that operates in the interests of the British monarch. We manage a significant portfolio of properties, including real estate, farmland, and...

  • Contract Unity Programmer

    2 days ago

    London, Greater London, United Kingdom Endeavour Recruitment Solutions Full time

    Job Summary:We are seeking a seasoned Unity and C# developer to join our Endeavour Recruitment Solutions team on a contract basis. As a key member of our gaming division, you will be responsible for delivering high-quality gaming experiences using Unity and C#. This is an excellent opportunity for an experienced developer looking to take their skills to the...

  • Data Intelligence Consultant

    2 weeks ago

    London, Greater London, United Kingdom Databricks Full time

    At Databricks, we are seeking a highly skilled Data Intelligence Consultant to join our team. As a key member of our field engineering organization, you will play a vital role in helping our customers solve complex data challenges using our Databricks Data Intelligence Platform.Estimated salary: $150,000 - $200,000 per year.About the RoleThis is an...

  • Machine Learning Strategy Director

    3 weeks ago

    London, Greater London, United Kingdom Unity Full time

    Unity is a collaborative and fast-growing environment where we solve hard problems and enable the success of our community.The Unity Ads Applied Research team envisions and builds systems that help creators capture the value they build.About the RoleWe are seeking a highly experienced Machine Learning Engineer to drive our applied research and analysis on...

  • Cloud Architecture Expert

    4 weeks ago

    London, Greater London, United Kingdom Databricks Full time

    Unlocking the Power of Mosaic AI with DatabricksWe are seeking an experienced Cloud Architecture Expert to join our team as a Product Specialist for Mosaic AI. This role will involve working closely with customers, sales teams, and product management to drive adoption of Mosaic AI features and ensure a consistent product vision.About the Role:Deliver thought...

  • Senior Software Development Engineer

    3 weeks ago

    London, Greater London, United Kingdom Amazon Full time

    **Job Title:** Senior Software Development Engineer - Amazon Catalog Systems **About Us:We are Amazon, the world's largest e-commerce platform. Our mission is to be Earth's most customer-centric company, where customers can find and discover anything they want to buy online. **Job Description:**We are seeking an experienced Senior Software Development...

  • Cloud Platform Engineer

    4 weeks ago

    London, Greater London, United Kingdom Unity Full time

    At Unity, we're scaling our efforts to increase developer efficiency, ensuring every second of development time is spent on the things that matter.We're partnering with internal development teams to enable increased velocity and enhanced productivity as we grow globally.An important value at Unity is 'Best Idea Wins,' which encourages experimentation and...

  • Backend Developer for Content Catalog

    1 month ago

    London, Greater London, United Kingdom Spotify Full time

    Content Catalog Backend EngineerWe are looking for a Content Catalog Backend Engineer to join one of the teams working with content at Spotify. The team is responsible for designing, developing and deploying backend services with a focus on high availability, low latency and scalability. You will collaborate closely with other engineers in the team and...

  • Senior DevOps Engineer for Developer Efficiency

    4 weeks ago

    London, Greater London, United Kingdom Unity Full time

    Unity A leading company in the game development industry, Unity is dedicated to empowering developers to create immersive experiences.

  • Databricks and SQL Expert

    12 hours ago

    London, Greater London, United Kingdom ADLIB Full time

    **Job Summary:** Senior Data Pipeline DeveloperWe are looking for an experienced Senior Data Pipeline Developer to join our team at ADLIB. The successful candidate will have expertise in designing, implementing, and optimising data pipelines using Databricks, PySpark and SQL.About the Role:Design, implement, and optimise data pipelines using Databricks,...

  • Unity C# Developer Position

    2 days ago

    London, Greater London, United Kingdom Endeavour Recruitment Solutions Full time

    About the Role:Endeavour Recruitment Solutions is proud to offer a unique contract opportunity for an experienced Unity and C# developer. This role involves working with our talented team to deliver top-notch gaming experiences, leveraging cutting-edge technologies such as Unity, C#, and Unreal Engine. If you're passionate about game development and have a...

Experienced Databricks Unity Catalog Engineer

2 months ago

London, Greater London, United Kingdom Amber Labs Full time
About the Role

We are seeking an experienced Databricks Unity Catalog Engineer to join our data engineering team at Amber Labs. As a Unity Catalog Engineer, you will play a key role in enhancing data governance, ensuring compliance, and implementing best practices for managing large-scale data lakes and enterprise data in a multi-cloud environment.

Key Responsibilities
  1. Implement and manage Databricks Unity Catalog, ensuring effective data governance and secure access to sensitive datasets.
  2. Design and establish data governance policies, including role-based access control (RBAC), data lineage, data masking, and metadata management within Unity Catalog.
  3. Collaborate with data engineering and cloud teams to integrate Unity Catalog with data lakes, ETL pipelines, and data warehouse architectures across AWS, Azure, or GCP environments.
  4. Monitor and optimize the performance of Unity Catalog, ensuring that data classification and access policies are applied and enforced correctly.
  5. Work closely with security teams to ensure data governance and security policies align with compliance standards such as GDPR, CCPA, HIPAA, or industry-specific regulations.
  6. Establish best practices for data discovery and cataloging, enabling data scientists and analysts to quickly access the data they need.
  7. Implement data lineage tracking within Unity Catalog to ensure transparency and traceability of data usage across the organization.
  8. Manage access control configurations and ensure smooth integration with existing IAM solutions such as Azure AD, AWS IAM, or other identity providers.
  9. Develop and maintain detailed technical documentation on the configuration and management of Unity Catalog, including processes for onboarding new datasets.
  10. Troubleshoot and resolve issues related to Unity Catalog configurations, data access policies, and integration with other Databricks features such as Delta Lake and MLflow.
  11. Provide training and support to data engineering and analytics teams on utilizing Unity Catalog for their data governance and access needs.
Requirements
  1. Bachelor's or Master's degree in Computer Science, Information Systems, Data Engineering, or related field.
  2. Strong experience with cloud platforms (Azure, AWS, GCP), with a focus on Databricks integration.
  3. In-depth understanding of data governance principles, including data access control, data lineage, and metadata management.
  4. Experience with role-based access control (RBAC), IAM, and cloud security policies to manage secure data access.
  5. Proficiency in working with large-scale data lakes and Delta Lake architectures.
  6. Solid understanding of ETL/ELT processes, data ingestion, and transformation workflows in cloud environments.
  7. Hands-on experience in working with Python, SQL, and other scripting languages for data management and cataloging tasks.
  8. Knowledge of data governance and compliance regulations such as GDPR, CCPA, and HIPAA.
  9. Experience with Databricks notebooks for developing data pipelines and workflows.
  10. Strong problem-solving skills and experience troubleshooting data access issues, performance bottlenecks, and catalog management challenges.
Desirable Skills
  1. Experience with other data cataloging and governance tools, such as AWS Glue, Apache Atlas, or Azure Purview.
  2. Knowledge of machine learning workflows and experience in supporting data science teams with managed datasets.
  3. Experience in multi-cloud environments and data orchestration across Azure, AWS, and GCP.About Amber Labs

    At Amber Labs, we are a cutting-edge UK and European technology consultancy that prioritises empowering autonomy, promoting experimentation, and facilitating rapid learning to provide exceptional value to our clients. Our company culture is centred around collaboration, where all colleagues, regardless of their role, work together to minimise risk and shorten delivery times.

    We are dedicated to fostering an inclusive and equitable workplace for all. Our commitment to diversity, equality, and inclusion includes valuing the unique experiences, perspectives, and backgrounds of all employees and creating an environment where everyone feels welcomed, respected, and valued.