Databricks Engineer

2 weeks ago

Stretford, United Kingdom VIQU Limited Remote Work Freelance Full time

Databricks Engineer – Remote – Manchester - 6 Months Contract (Initial) – Outside IR35

We are seeking 4 Databricks Engineers on a contract basis to assist our client as they migrate over from legacy to AWS.  The main focus will be to centralise the organisations data warehouses and consolidating / centralising a number of BI tools. 

Databricks Engineers should have extensive experience working with Databricks on recent projects and be exposed to the latest features and toolsets of Databricks

Role Responsibilities:

  • Design and develop scalable data pipelines using Databricks.
  • Implement data processing workflows in Python and SQL.
  • Manage and optimise data storage solutions on AWS.
  • Ensure data quality and integrity across all stages of data processing.
  • Develop and maintain documentation for data engineering processes.
  • Utilise Databricks features, including Delta Live Tables (DLT) to simplify streaming and ensure data quality.
  • Work with asset bundles in Databricks for streamlined data operations.

Key Skills:

  • Proven experience as a Databricks Engineer / Data Engineer with a strong focus on Databricks.
  • Proficiency in Python and SQL for data processing and analysis.
  • Spark Python API / PySpark
  • Hands-on experience with AWS services related to data storage and processing (e.g., S3, Redshift, Glue).
  • In-depth knowledge of Databricks Delta Lake and Light Tables.
  • Familiarity with Databricks Asset Bundles (DAB’s) for streamlining the development of complex data and analytics for the Databricks platform. (IaC)
  • Strong understanding of data warehousing concepts and ETL processes.
  • Excellent problem-solving skills and attention to detail.
  • Ability to work independently in a remote setup with minimal supervision.

Role details:

  • Job role: Databricks Engineer
  • Job Type: Contract
  • Duration: 6 months with view of extension
  • IR35 status: Outside IR35
  • Rate: £450 - £520 per day
  • Location: Remote based with ad hoc travel to Leeds

To discuss this exciting opportunity in more detail, please APPLY NOW for a no obligation chat with your VIQU Consultant. Additionally, you can contact Suzie Stone by exploring the VIQU IT Recruitment website.

To be the first to hear about other exciting opportunities, technology and recruitment news, please also follow us at ‘VIQU IT Recruitment’ on LinkedIn, and Twitter: @VIQU_UK

  • Platform Engineer

    7 days ago

    Stretford, United Kingdom VIQU Limited Remote Work Freelance Full time

    Platform Engineer – 6 - month contract My customer requires an experienced Platform Engineer to join the organisation for an initial 6-month engagement. This Platform Engineer will be responsible for managing and leading the operation of Cloud Infrastructure (Azure) and Cloud Adoption Framework (CAF). You are required to have strong understanding of...

  • Data Engineering Lead

    2 weeks ago

    Stretford, United Kingdom Robert Walters Full time

    Data Engineering Lead - Entertainment Business - Manchester 2 x Per Week - £70K An exciting opportunity has arisen for a talented and experienced Data Engineering Lead to join a dynamic team. The successful candidate will be responsible for implementing the strategy for Data Engineering, overseeing activities required in the delivery and maintenance of...

  • Senior Software Development Engineer

    1 month ago

    Stretford, United Kingdom EMIS Group Plc Full time

    Here at EMIS we are excited to share that we have a fantastic opportunity for an experienced Software Development Engineer to come and join our team on a permanent basis!  Our EMIS X Analytics team have worked hard to build a data platform to help the NHS manage one of the richest healthcare datasets in the world, which currently houses 1 Petabyte of data...

  • Senior Software Development Engineer

    3 weeks ago

    Stretford, United Kingdom EMIS Group Plc Full time

    Here at EMIS we are excited to share that we have a fantastic opportunity for an experienced Software Development Engineer to come and join our team on a permanent basis!  Our EMIS X Analytics team have worked hard to build a data platform to help the NHS manage one of the richest healthcare datasets in the world, which currently houses 1 Petabyte of data...

  • Senior Data Engineer

    2 weeks ago

    Stretford, United Kingdom IPS Group Full time

    Senior Data Engineer - Insurance Manchester OR Liverpool Based Must have Insurance OR Financial Services Industry Experience Paying up to £90,000 Description: A global market leader in re-insurance, global specialty insurance and digital solutions. New technologies are disrupting the insurance value chain. Our innovative minds in IT spearhead the...

  • Senior Data Engineer/ Architect

    2 weeks ago

    Stretford, United Kingdom Hays Specialist Recruitment Limited Full time

    Prestigious opportunity within a pioneering data team for a Senior Data Engineer/ Architect to be based out of Central Manchester offices. Our client are expanding their team following a period of significant growth, we welcome you to join their success story. This role is an essential addition in supporting large data programmes. Work will include, but not...

  • Data Specialist

    6 days ago

    Stretford, United Kingdom Eames Consulting Full time

    I'm partnered with a global market leader in re-insurance, global specialty insurance and digital solutions who are looking to add a Data Specialist to their team. My client is working to become even more digital leveraging the expertise of their IT & Tech specialists, and by using data and insights to support innovation. Role Responsibilities: Working...