Senior Databricks Engineer
4 days ago
GET THE FUTURE YOU WANT
Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and build a more sustainable, more inclusive world.
YOUR ROLEWe are currently migrating our data pipelines from AWS to Databricks, and are seeking a Senior Databricks Engineer to lead and contribute to this transformation. This is a hands-on engineering role focused on designing, building, and optimizing scalable data solutions using the Databricks platform.
YOUR PROFILELead the migration of existing AWS-based data pipelines to Databricks.
• Design and implement scalable data engineering solutions using Apache Spark on Databricks.
• Collaborate with cross-functional teams to understand data requirements and translate them into efficient pipelines.
• Optimize performance and cost-efficiency of Databricks workloads.
• Develop and maintain CI/CD workflows for Databricks using GitLab or similar tools.
• Ensure data quality and reliability through robust unit testing and validation frameworks.
• Implement best practices for data governance, security, and access control within Databricks.
• Provide technical mentorship and guidance to junior engineers.
• Strong hands-on experience with Databricks and Apache Spark (preferably PySpark).
• Proven track record of building and optimizing data pipelines in cloud environments.
• Experience with AWS services such as S3, Glue, Lambda, Step Functions, Athena, IAM, and VPC.
• Proficiency in Python for data engineering tasks.
• Familiarity with GitLab for version control and CI/CD.
• Strong understanding of unit testing and data validation techniques.
Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 350,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, cloud and data, combined with its deep industry expertise and partner ecosystem. The Group reported 2023 global revenues of €22.5 billion.
Get the future you want |
-
Senior Databricks Engineer
6 days ago
Glasgow, Glasgow City, United Kingdom Capgemini Engineering Full time €60,000 - €120,000 per yearGET THE FUTURE YOU WANTChoosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the...
-
Databricks Engineer
2 weeks ago
Glasgow, Glasgow City, United Kingdom 41be5fc8-f88e-4de6-8a7a-53af905e6da1 Full time £25,000 - £50,000 per yearThis is an exciting contract opportunity for anSC ClearedDatabricks Engineerto join an experienced team in a new customer engagement working at the forefront of data analytics and AI. This role offers the chance to take a key role in the design and delivery of advanced Databricks solutions within the Azure ecosystem.ResponsibilitiesDesign, build, and...
-
Databricks Engineer
6 days ago
Glasgow, Glasgow City, United Kingdom Derisk360 Full time £60,000 - £100,000 per yearHiring Now: Databricks Engineer | AWS | Financial Services | Glasgow (Hybrid)Location:Glasgow, UK (Hybrid — 2 days onsite per week)Availability:Immediate Joiner PreferredDomain:Financial ServicesCertification Advantage:Databricks Certified EngineersAbout the RoleWe're looking for askilled Databricks Engineerto join a leadingfinancial institutionand work on...
-
Senior Data Engineer
2 weeks ago
Glasgow, Glasgow City, United Kingdom Lorien Full time £60,000 - £100,000 per yearRole Title: Sr. Databricks EngineerLocation: GlasgowDuration: 31/12/2026Days on site: 2-3MUST BE PAYE THROUGH UMBRELLARole Description:We are currently migrating our data pipelines from AWS to Databricks, and are seekinga Senior Databricks Engineer to lead and contribute to this transformation. This is ahands-on engineering role focused on designing,...
-
Senior Data Engineer
1 week ago
Glasgow, Glasgow City, United Kingdom RES Full time £60,000 - £120,000 per yearDo you want to work to make Power for Good?We're the world's largest independent renewable energy company. We're driven by a simple yet powerful vision: to create a future where everyone has access to affordable, zero carbon energy.We know that achieving our ambitions would be impossible without our people. Because we're tackling some of the world's toughest...
-
Senior Data Engineer
5 days ago
Glasgow, Glasgow City, United Kingdom Head Resourcing Full time £60,000 - £100,000 per yearSenior Data Engineer - Azure & Databricks LakehouseGlasgow (3/4 days onsite) | Exclusive Role with a Leading UK Consumer BusinessNo sponsorship/ relocation provided sadlyOur incredibly successful client, consumer brand is undertaking a major data modernisation programme-moving away from legacy systems, manual Excel reporting and fragmented data sources into...
-
Senior Lead Software Engineer
5 days ago
Glasgow, Glasgow City, United Kingdom JPMorgan Chase Full time £80,000 - £150,000 per yearWe have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.As a Senior Lead Software Engineer at JPMorgan Chase within the Corporate Technology team, you will serve in a leadership role by providing technical coaching and advisory for multiple agile technical teams. You will anticipate the needs and...
-
Senior Data Engineer
2 weeks ago
Glasgow, Glasgow City, United Kingdom Vanloq - Workforce Solutions Full time £60,000 - £90,000 per yearSenior Data Engineer – ContractLocation:Glasgow (Hybrid – 3 days per week on-site)Duration:6 MonthsDay Rate:CompetitiveSector:Financial ServicesOverview:We're looking for a highly skilled Senior Data Engineer to join a leading financial services organisation on a 6-month contract. You'll be working on a hybrid basis from their Glasgow office (3 days per...
-
Senior Data Engineer
3 days ago
Glasgow, Glasgow City, United Kingdom Infoplus Technologies UK Limited Full time· Job Title: Senior Data Engineer· Location: Glasgow, UK (Hybrid, 3 days onsite)· Duration: 6 months (Inside IR35)Job Description:Role ResponsibilitiesYou will be responsible for:• Collaborating with cross-functional teams to understand data requirements, and design efficient, scalable, and reliable ETL processes using Python and DataBricks•...
-
Senior Date Engineer
2 weeks ago
Glasgow, Glasgow City, United Kingdom Infoplus Technologies UK Limited Full time £60,000 - £90,000 per year· Job Title: Senior Date Engineer· Location: Glasgow, UK (Hybrid, 3 days onsite)· Duration: 6 months (Inside IR35)Job Description:Role ResponsibilitiesYou will be responsible for:• Collaborating with cross-functional teams to understand data requirements, and design efficient, scalable, and reliable ETL processes using Python and DataBricks•...