Senior Data Engineer

4 weeks ago

United Kingdom Primus Connect Full time

Senior Data Engineer (Databricks, Spark, Python)

Remote (UK based)

3 - 6 months rolling

£550 - £650 per day

Outside IR35


A Senior Data Engineer with broad knowledge of Databricks is needed to join a leading consultancy renowned for its innovative approach and expertise in delivering state-of-the-art data solutions.


As a proud Databricks Partner, our client is at the forefront of driving transformation and excellence in data strategies for businesses across various sectors. This contract role is an exceptional opportunity for a Senior data engineering professional looking to make a substantial impact while enjoying the flexibility of a fully remote, outside IR35 contract.


As the Senior Data Engineer, you will play a pivotal role in designing and implementing cutting-edge data solutions utilising Databricks technologies.


Key Responsibilities:


  • Architect and execute efficient data solutions leveraging Azure Data Factory, Synapse, Databricks, and Azure DevOps.
  • Develop, maintain, and optimise data models and ETL pipelines for premier data processing efficiency.
  • Design and implement processes to ingest data from various sources into Databricks.
  • Use Databricks to integrate, consolidate, and cleanse data to ensure it is accurate and ready for analysis.
  • Develop, test, and maintain robust, scalable data pipelines using Databricks.
  • Utilise Databricks' support for languages like Python, Scala, SQL, and R to process and transform data.
  • Design and implement data models that effectively represent business processes and requirements.
  • Optimise data storage in Databricks for efficient querying and analysis, leveraging Delta Lake for ACID transactions and versioned data management.
  • Translate complex business requirements into technical specifications in collaboration with various teams.
  • Implement and maintain data governance policies and practices, ensuring data quality and consistency.
  • Manage data access and security within Databricks, aligning with organizational policies and compliance requirements.
  • Engage with clients to support architectural designs and solve technical queries.
  • Remain abreast of the latest developments and Databricks technologies, ensuring best practices in data governance and security compliance.


Essential Skills and Qualifications:


  • A minimum 5 years' experience in data engineering
  • Minimum 2-3 projects delivered with hands-on experience in Databricks
  • Expertise in data modeling, ETL development, and data warehousing.
  • Familiarity with Databricks medallion architecture
  • Experience working with Delta Live Tables
  • Familiarity with Unity Catalog
  • Strong programming experience using Python
  • Experience with distributed computing with Spark
  • Streaming experience using technologies such as Kafka
  • Strong problem-solving abilities, capable of adapting quickly in a dynamic environment.
  • Excellent communication skills, with experience in mentoring and collaborative teamwork.
  • Prior experience in client-facing roles is highly advantageous.
  • Proficiency in Agile and DevOps methodologies.
  • Databricks Data Engineering Professional certification is highly desirable


Contract Highlights:


  • Competitive day rate of £550 - £650.
  • Fully remote work, offering unparalleled flexibility.
  • A 6-month contract outside IR35, providing freedom and independence in your professional engagements.
  • An opportunity to engage with innovative projects and leadership roles within a high-growth, value-driven consultancy.


Application Process:

To apply for this opportunity, please click apply or send your CV to CV@primus-connect.com


Primus Connect champions diversity and inclusion, welcoming applications from all qualified individuals. Join us for an enriching contract experience that promises professional growth and a collaborative working environment.

  • Senior Data Engineer

    4 weeks ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients. This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Data Engineer

    4 weeks ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients. This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Data Engineer

    3 weeks ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients.This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Data Engineer

    4 weeks ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients. This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Data Engineer

    4 weeks ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients. This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Data Engineer

    3 weeks ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients.This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Data Engineer

    4 weeks ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients.This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Data Engineer

    3 weeks ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients. This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Engineer, Data Engineering

    4 weeks ago

    United Kingdom Data Science Talent Full time

    Data Engineering in Animal Health 80% remote £60-70k basic salary plus 10% bonus If you’re as much of an animal lover as you are a data engineer, you won’t find a better opportunity to use your skills for good. In this newly created role you’ll be setting up the data infrastructure that will help this thriving veterinary care company to...

  • Process Engineering

    4 weeks ago

    United Kingdom The Chemical Engineer Full time

    Our client develops, engineers, fabricates, supplies, and installs discreet process equipment items and complete process systems for applications within chemical /process engineering. The company’s reputation is well established and founded on its commitment to product innovation, customer service and engineering excellence. On the job training would be...

  • Senior Data Engineer

    2 weeks ago

    united kingdom JR United Kingdom Remote Work Freelance Full time

    Senior Data EngineerUp to £90,000 + BonusFully Remote in UKOVERVIEWMajor FTSE100 retail giant hiring for x2 Senior Data Engineers, to lead small teams of Data Engineers on key projects, directly line managing them and providing technical leadership and guidance to the team. You will be joining a well-established Data function with huge customer data to work...

  • Senior Engineer, Data Engineering

    4 weeks ago

    United Kingdom Premier Group Recruitment Full time

    Role: Senior Data Engineer Skills: - Data Engineer, SQL, Synapse, Bigquery, Snowflake, Databuild Tools. £65,000 – Senior Data Engineer – Fully Remote (UK Based) I have a client who are looking to hire a Senior Data Engineer with experience in SQL, Synapse, Bigquery, Snowflake and Databuild Tools on a permanent basis. The company are a...

  • Senior Engineer, Data Engineering

    4 weeks ago

    United Kingdom Premier Group Recruitment Full time

    Role: Senior Data Engineer Skills: - Data Engineer, SQL, Synapse, Bigquery, Snowflake, Databuild Tools. £65,000 – Senior Data Engineer – Fully Remote (UK Based) I have a client who are looking to hire a Senior Data Engineer with experience in SQL, Synapse, Bigquery, Snowflake and Databuild Tools on a permanent basis. The company are a...

  • Lead Data Engineer-Data Management

    4 weeks ago

    United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer. As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...

  • Lead Data Engineer-Data Management

    4 weeks ago

    United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer. As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...

  • Data Integration Engineer

    4 weeks ago

    United Kingdom Abs Data Full time

    Big Data Integration Engineer Saint-Gobain Position description Are you someone who is passionate about data and transformation? At Saint-Gobain Digital, we are looking for a Big Data Integration Engineer to work remotely to create customer and business value as part of a digital transformation. This Data Engineer will be a part of our enthusiastic...

  • Senior Data Engineer

    3 days ago

    United Kingdom Clearwater People Solutions Ltd Full time

    Our client, a well-known and market-leading Financial Services company, is currently recruiting for a Senior Data Engineer to join their Data engineering team. The Senior Data Engineer will be responsible for designing, developing, and maintaining data pipelines and workflows to support the organisation's data processing needs and facilitate BI...

  • Senior Data Engineer

    4 days ago

    United Kingdom Clearwater People Solutions Ltd Full time

    Our client, a well-known and market-leading Financial Services company, is currently recruiting for a Senior Data Engineer to join their Data engineering team. The Senior Data Engineer will be responsible for designing, developing, and maintaining data pipelines and workflows to support the organisation's data processing needs and facilitate BI...

  • Senior Engineer, Data Engineering

    4 days ago

    United Kingdom Clearwater People Solutions Ltd Full time

    Our client, a well-known and market-leading Financial Services company, is currently recruiting for a Senior Data Engineer to join their Data engineering team. The Senior Data Engineer will be responsible for designing, developing, and maintaining data pipelines and workflows to support the organisation's data processing needs and facilitate BI reporting and...

  • Senior Engineer, Data Engineering

    4 weeks ago

    United Kingdom La Fosse Full time

    Senior Data Engineer - 6 month FTC London (Hybrid Role) £Senior Data Engineer Opportunity An exciting opportunity has arisen for a Senior Data Engineer to join a dynamic team dedicated to shaping effortless, digital-first customer experiences. This role is pivotal in driving value for customers through modelling, sourcing, and data transformation. The...