Azure Databricks Devops Engineer

2 days ago

London, Greater London, United Kingdom iO Associates Full time £60,000 - £90,000 per year

DevOps Engineer (Azure Data Services)

About the Role

We are looking for a
skilled and innovative DevOps Engineer
to join our clients growing team. You'll play a pivotal role in modernising our data operations by designing and implementing
Continuous Integration and Continuous Deployment (CI/CD)
pipelines for
Azure Databricks
and
Azure Data Factory (ADF)
. This is a fantastic opportunity to shape the future of our Azure environment, driving automation, efficiency, and reliability across our data services. This role is remote, with very occassional abroad travel (paid for) and falls inside IR35. It will be an inital 6 month contract with a likelihood of extension. We have interview slots available.

Key Responsibilities

  • Design, build, and maintain CI/CD pipelines for Azure Databricks and ADF
  • Collaborate with data engineers and developers to integrate code changes seamlessly
  • Automate deployment processes to reduce manual intervention and boost efficiency
  • Monitor and troubleshoot CI/CD pipelines, ensuring minimal downtime
  • Implement best practices for asset bundling and version control in Azure DevOps
  • Optimize Azure DevOps environments for scalability and performance
  • Ensure compliance with security standards across all deployment processes
  • Document CI/CD processes, procedures, and configurations

What We're Looking For

  • Proven experience with
    Azure DevOps
    and CI/CD pipeline implementation
  • Proficiency in
    Databricks Asset Bundles (DABs)
  • Strong knowledge of
    Azure Databricks
    and
    Azure Data Factory
  • Hands-on experience with scripting/automation tools (PowerShell, Python)
  • Experience in
    selective deployment for ADF pipelines
  • Familiarity with containerization/orchestration (Docker, Kubernetes) is a plus
  • Excellent problem-solving and troubleshooting skills
  • Strong communication and collaboration abilities
  • Knowledge of CI/CD security best practices
  • Detail-oriented mindset with a focus on high-quality automation solutions
  • Bachelor's degree in Computer Science, IT, or related field
  • Minimum
    5 years' experience
    in DevOps or related roles

  • Azure Devops Engineer

    2 weeks ago

    London, Greater London, United Kingdom Codeconvergence Limited (CCL) Full time £90,000 - £120,000 per year

    Required Skills:Azure, Azure DevOps, Pipeline Troubleshooting, Application Deployment, Databricks, Synapse, ADF, SQL, Azure Security, Azure Networking, Python, PowershellDetails JD:Extensive experience in Azure DevOps , including pipeline development and resource management. Proficient in designing and managing Azure DevOps Release Pipelines  for...

  • Azure Support Engineer

    2 weeks ago

    London, Greater London, United Kingdom SmartCo Consulting Full time £60,000 - £100,000 per year

    Role:Azure Support Engineer (with AI & DevOps Exposure)Location:RemoteEngagement:ContractIndustry:Financial ServicesWe're looking for an experienced Azure Support Engineer, to join an ongoing financial services team, focused on cloud operations, automation, and AI transformation.This role will begin with a strong support focus, managing Azure related...

  • Databricks Engineer

    6 days ago

    London, Greater London, United Kingdom iO Associates Full time £110,000 per year

    Databricks Engineer - SC ClearedFully RemoteDuration: 6 MonthsLocation: LondonRate: £500-£550 per day (Inside IR35)Start Date: ASAPAre you an SC Cleared Databricks Engineer with a passion for building scalable data solutions? Do you have extensive experience in designing and optimising data pipelines, cloud-native platforms, and advanced analytics...

  • Databricks Data Engineer

    1 week ago

    London, Greater London, United Kingdom EXL Full time £60,000 - £120,000 per year

    DescriptionEXL (NASDAQ: EXLS) is a global data and AI company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. Bringing together domain expertise with robust data, powerful analytics, cloud and AI to create agile, scalable solutions and execute complex operations for the world's...

  • Azure DevOps Engineer

    1 week ago

    London, Greater London, United Kingdom Stealth iT Consulting Full time £40,000 - £80,000 per year

    Job Title:Azure DevOps EngineerRate:£400 (Inside IR35)Duration:12 MonthsLocation:RemoteClearance:BPSSMust Have Experience with the below:Azure Data FactoryAzure Synapse AnalyticsAzure Data LakeDemonstrable experience of developing and supporting Azure cloud-based applications.It is highly desirable that they also have recent applied experience of Kafka and...

  • Azure DevOps Engineer

    1 week ago

    London, Greater London, United Kingdom Adapt 365 Full time £65,000 - £85,000 per year

    Job Title: Azure DevOps EngineerLocation: UK-wide (Hybrid)Salary: Up to £85kWe're working with a leading consultancy delivering some of the largest Microsoft cloud transformations in the market — and they're looking for an Azure DevOps/Platform Engineer who can design, build, and lead enterprise-grade solutions.If you're driven by automation, secure cloud...

  • Azure Data Support Engineer

    5 days ago

    London, Greater London, United Kingdom Avanade Full time £60,000 - £120,000 per year

    Job Title:Azure Data Support Engineer Location:Newcastle or London preferredJob Type:Full-time | Contract / PermanentExperience Level:Senior Level (6–8 years of experience)We are looking for a versatile Azure Data & ML Support Engineer with strong expertise in Azure cloud services, DevOps, SQL, and data warehousing to support and optimize ongoing...

  • Azure DevOps Engineer

    2 weeks ago

    London, Greater London, United Kingdom Pioneer Search Full time £72,000 per year

    Role:DevOps EngineerRate:£500 - £600 p/d Outside IR35Location:Remote, with ad-hoc travel to officeLength:3 monthsDevOps Engineer with Active Security Clearance required join a high-profile digitisation programme for a Government Department. The successful candidate will focus on Azure application deployment and environment configuration, working closely...

  • Senior Azure Data Engineer

    1 week ago

    London, Greater London, United Kingdom Primus Connect Full time £55,000 - £60,000 per year

    Senior Azure Data Engineer (Databricks, Delta Live Tables, Unity Catalog)3 - 6 monthsRemote (UK Candidates Only)£550 - £600 per day Outside IR35We are currently recruiting for an experienced Data Engineer skilled in Microsoft Azure and cloud computing concepts.As the Azure Data Engineer, you will work closely with a Microsoft & Databricks partner with...

  • Azure Devops Engineer

    8 hours ago

    London, Greater London, United Kingdom Free-Work UK Full time

    Azure Devops Engineer - SC ClearedOur client has a vacancy for an Azure Devops Engineer available immediately.SkillsTerraformTerragruntTerra TestPackerAnsibleGitlabKafkaAzureActivities IncludeBuild Kafka logging solution based on fluentd/td-agentBuild file transfer solutionBuild Azure based virtual machines with SMB mount support for Azure Data Lake...