Sr.Databricks Engineer
2 weeks ago
We are a Global Recruitment specialist that provides support to the clients across EMEA, APAC, US and Canada.Role Title: Sr.Databricks Engineer (AWS)Location: GlasgowDuration: 31/12/2026Days on site: 2-3Rate: £402/day on UmbrellaRole Description:We are currently migrating our data pipelines from AWS to Databricks, and are seekinga Senior Databricks Engineer to lead and contribute to this transformation. This is ahands-on engineering role focused on designing, building, and optimizing scalable datasolutions using the Databricks platform.Key Responsibilities:Lead the migration of existing AWS-based data pipelines to Databricks.Design and implement scalable data engineering solutions using Apache Spark onDatabricks.Collaborate with cross-functional teams to understand data requirements and translatethem into efficient pipelines.Optimize performance and cost-efficiency of Databricks workloads.Develop and maintain CI/CD workflows for Databricks using GitLab or similar tools.Ensure data quality and reliability through robust unit testing and validationframeworks.Implement best practices for data governance, security, and access control withinDatabricks.Provide technical mentorship and guidance to junior enginee...