Azure Databricks Devops Engineer

4 weeks ago

Sheffield, United Kingdom iO Associates Full time

DevOps Engineer (Azure Data Services)About the RoleWe are looking for a skilled and innovative DevOps Engineer to join our clients growing team. You'll play a pivotal role in modernising our data operations by designing and implementing Continuous Integration and Continuous Deployment (CI/CD) pipelines for Azure Databricks and Azure Data Factory (ADF). This is a fantastic opportunity to shape the future of our Azure environment, driving automation, efficiency, and reliability across our data services. This role is remote, with very occassional abroad travel (paid for) and falls inside IR35. It will be an inital 6 month contract with a likelihood of extension. We have interview slots available.Key ResponsibilitiesDesign, build, and maintain CI/CD pipelines for Azure Databricks and ADFCollaborate with data engineers and developers to integrate code changes seamlesslyAutomate deployment processes to reduce manual intervention and boost efficiencyMonitor and troubleshoot CI/CD pipelines, ensuring minimal downtimeImplement best practices for asset bundling and version control in Azure DevOpsOptimize Azure DevOps environments for scalability and performanceEnsure compliance with security standards across all deployment processesDocument CI/CD processes, procedures, and configurationsWhat We're Looking ForProven experience with Azure DevOps and CI/CD pipeline implementationProficiency in Databricks Asset Bundles (DABs)Strong knowledge of Azure Databricks and Azure Data FactoryHands-on experience with scripting/automation tools (PowerShell, Python)Experience in selective deployment for ADF pipelinesFamiliarity with containerization/orchestration (Docker, Kubernetes) is a plusExcellent problem-solving and troubleshooting skillsStrong communication and collaboration abilitiesKnowledge of CI/CD security best practicesDetail-oriented mindset with a focus on high-quality automation solutionsBachelor's degree in Computer Science, IT, or related fieldMinimum 5 years' experience in DevOps or related roles

  • Data Engineer

    3 weeks ago

    Sheffield, United Kingdom HSBC Full time

    If you're looking to take an exciting new direction with your HSBC career, an internal move can open the door to many opportunities, allowing you to take on a new challenge, and develop your skills. Bring your knowledge of our brand to a new role and grow yourself further. Technology teams in the UK work closely with our global businesses to help design and...

  • Data Engineer

    7 days ago

    Sheffield, United Kingdom HSBC Full time

    If youre looking to take an exciting new direction with your HSBC career an internal move can open the door to many opportunities allowing you to take on a new challenge and develop your skills. Bring your knowledge of our brand to a new role and grow yourself further. Technology teams in the UK work closely with our global businesses to help design and...

  • Data Engineer

    5 days ago

    Sheffield, United Kingdom Hays Full time

    We are seeking a highly skilled Python Data Engineer with hands-on experience in Behave-based unit testing, PySpark development, Delta Lake optimization, and Azure cloud services. This role involves designing, developing, and deploying scalable data processing solutions in a containerized environment, with an emphasis on maintainable, configurable, and...

  • Remote Lead Data Engineer: Azure, Fabric

    2 days ago

    Sheffield, United Kingdom Tenth Revolution Group Full time

    A leading Microsoft partner in the UK seeks a Lead Data Engineer to guide a team while designing innovative data solutions using Microsoft technologies. The ideal candidate will possess strong leadership and hands-on experience with Microsoft Fabric, Azure Synapse, and Databricks. This position offers a competitive salary up to £80,000, remote working...

  • Software Delivery Leader — Azure DevOps Focus

    3 days ago

    Sheffield, United Kingdom RedRock Resourcing Full time

    A leading technology firm in Sheffield is seeking a passionate Software Development Manager to lead dynamic teams, manage the full Software Development Lifecycle, and drive innovation. This mid-senior level role emphasizes strong leadership, stakeholder collaboration, and expertise in Azure DevOps. The successful candidate will be responsible for fostering...

  • Associate DevOps

    2 days ago

    Sheffield, United Kingdom Home Office Full time

    **Details**: **Reference number**: - 413430 **Salary**: - £37,300 - £44,191 - New entrants to the Civil Service will start their role on the salary band minimum: £37,300 for National Roles. £41,300 for London Roles. - A Civil Service Pension with an employer contribution of 28.97% GBP **Job grade**: - Higher Executive Officer **Contract type**: -...

  • DevOps Engineer

    4 weeks ago

    Sheffield, United Kingdom HSBC Full time

    If you're looking for a career that will help you stand out, join HSBC, and fulfil your potential - whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further. HSBC is one of the largest banking and financial services organisations in...

  • DevOps Engineer

    4 weeks ago

    Sheffield, United Kingdom HSBC Full time

    If you're looking for a career that will help you stand out, join HSBC, and fulfil your potential - whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further. HSBC is one of the largest banking and financial services organisations in the...

  • DevSecOps Engineer

    4 weeks ago

    Sheffield, United Kingdom BlueRose Technologies Full time

    Job Title: DevSecOps Engineers - Multiple positionsJob Location: London, UK (Remote)Job Type: Contract job opportunity Job description:• We are looking for multiple Platform Engineering – DevSecOps professionals with management Experience• Azure (e.g., Azure VMs, VNet, Azure AD, Key Vault, Storage, Functions) • Azure Distributed Ledger Technology...

  • Senior Data Consultant

    2 weeks ago

    Sheffield, United Kingdom BJSS Full time

    A leading data consultancy in the UK is looking for a Senior Data Consultant to transform client data processing and enhance data maturity. Ideal candidates should have extensive experience with Databricks, be comfortable in AWS or Azure environments, and possess Infrastructure as Code skills. This role offers hybrid working options along with an extensive...