Senior Engineer, Data Engineering

4 weeks ago

United Kingdom Lorien Full time

Our client within the Education sector are looking for a Senior Data Engineer to join them on a contract basis.
Inside IR35
6 month contract
Hybrid 1 – 2 days per week onsite

Technical Skills:
In depth knowledge of relevant Azure services such as Azure Data Lake Storage, Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Azure SQL Database, Azure Stream Analytics, etc.
Strong Python or Scala with Spark, PySpark experience
Experience with relational databases and NoSQL databases
Significant experience and in-depth knowledge of creating data pipelines and associated design principles, standards, Data modelling concepts, ETL procedures, and all steps of data production process
Experience with unit and integration testing, and data quality frameworks such as Deequ, Great Expectations or Delta Live
Experience working with continuous integration
Good understanding of data modelling (medallion architectures, Kimball architectures), data schemas (Avro Schema, JSON Schema) and data serialisation (Parquet, ORC, Avro)

Azure Services Knowledge:
Azure Data Factory: Advanced knowledge of Azure Data Factory for orchestrating and automating data workflows.
Azure SQL Database: Expertise in SQL and T-SQL for data querying and manipulation.
Azure Synapse Analytics: Ability to design and implement data warehousing solutions using Azure Synapse Analytics.
Azure Databricks: Proficiency in using Azure Databricks for data processing and analytics.
Apache Spark: Deep understanding of Apache Spark for large-scale data processing.
Azure Blob Storage and Azure Data Lake Storage: Expertise in setting up and optimizing Azure Data Lake Storage for storing and managing large volumes of data.

Cloud Experience:
Resource Manager (ARM): Understanding how to deploy, manage, and monitor Azure resources using ARM templates.
Azure Portal and CLI: Proficiency in using the Azure Portal and Command-Line Interface for managing Azure resources.
Azure Security and Compliance: Knowledge of Azure security features and compliance standards.
Monitoring and Logging: Familiarity with Azure Monitor and Azure Log Analytics for monitoring and logging.
Ways of working:
Experience in Data Migration, Data Profiling and Data Quality enhancement.
Experience in Agile (Scrum) way of working
Understanding of CI/CD process & ways of working including Git
Excellent Problem-solving skills
Excellent Communication skills
Strong understanding of software development life cycle
• Knowledge of software engineering best practices for the full software development life cycle, including Agile methodologies, coding standards, code reviews, source control management, build processes, testing, etc

If you believe you have the right skills for this role please submit your CV.

  • Senior Engineer, Data Engineering

    1 month ago

    United Kingdom Data Science Talent Full time

    Data Engineering in Animal Health 80% remote £60-70k basic salary plus 10% bonus If you’re as much of an animal lover as you are a data engineer, you won’t find a better opportunity to use your skills for good. In this newly created role you’ll be setting up the data infrastructure that will help this thriving veterinary care company to...

  • Senior Data Engineer

    1 month ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients. This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Data Engineer

    1 month ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients. This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Data Engineer

    4 weeks ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients.This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Data Engineer

    1 month ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients. This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Data Engineer

    1 month ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients.This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Data Engineer

    3 weeks ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients. This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Data Engineer

    1 month ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients. This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Engineer, Data Engineering

    4 weeks ago

    United Kingdom La Fosse Full time

    Senior Data Engineer - 6 month FTC London (Hybrid Role) £Senior Data Engineer Opportunity An exciting opportunity has arisen for a Senior Data Engineer to join a dynamic team dedicated to shaping effortless, digital-first customer experiences. This role is pivotal in driving value for customers through modelling, sourcing, and data transformation. The...

  • Senior Engineer, Data Engineering

    1 month ago

    United Kingdom La Fosse Full time

    Senior Data Engineer - 6 month FTC London (Hybrid Role) £Senior Data Engineer Opportunity An exciting opportunity has arisen for a Senior Data Engineer to join a dynamic team dedicated to shaping effortless, digital-first customer experiences. This role is pivotal in driving value for customers through modelling, sourcing, and data transformation. The...

  • Process Engineering

    1 month ago

    United Kingdom The Chemical Engineer Full time

    Our client develops, engineers, fabricates, supplies, and installs discreet process equipment items and complete process systems for applications within chemical /process engineering. The company’s reputation is well established and founded on its commitment to product innovation, customer service and engineering excellence. On the job training would be...

  • Senior Engineer, Data Engineering

    1 week ago

    United Kingdom Clearwater People Solutions Ltd Full time

    Our client, a well-known and market-leading Financial Services company, is currently recruiting for a Senior Data Engineer to join their Data engineering team. The Senior Data Engineer will be responsible for designing, developing, and maintaining data pipelines and workflows to support the organisation's data processing needs and facilitate BI reporting and...

  • Senior Data Engineer

    2 weeks ago

    united kingdom JR United Kingdom Remote Work Freelance Full time

    Senior Data EngineerUp to £90,000 + BonusFully Remote in UKOVERVIEWMajor FTSE100 retail giant hiring for x2 Senior Data Engineers, to lead small teams of Data Engineers on key projects, directly line managing them and providing technical leadership and guidance to the team. You will be joining a well-established Data function with huge customer data to work...

  • Senior Engineer, Data Engineering

    2 weeks ago

    United Kingdom La Fosse Full time

    Senior Data Engineer 6 month fixed term contract – 2 x a week in London £We're seeking a talented Senior Data Engineer to join the data engineering team on a 6-month fixed-term contract, with the potential to extend but within a different department in the company. As a Senior Data Engineer, you'll play a pivotal role in maturing the data warehouse....

  • Senior Engineer, Data Engineering

    2 days ago

    United Kingdom Understanding Recruitment NFP Full time

    Data Engineer - Charity A brand new and exciting opportunity has recently arisen for a Data Engineer with excellent knowledge in Azure Data Factory, and SQL to join an international charity. This is an excellent opportunity for a Data Engineer to be heavily involved in the biggest data engineering project this charity has ever done! If you are...

  • Senior Engineer, Data Engineering

    3 days ago

    United Kingdom Understanding Recruitment NFP Full time

    Data Engineer - Charity A brand new and exciting opportunity has recently arisen for a Data Engineer with excellent knowledge in Azure Data Factory, and SQL to join an international charity. This is an excellent opportunity for a Data Engineer to be heavily involved in the biggest data engineering project this charity has ever done! If you are...

  • Senior Engineer, Data Engineering

    3 days ago

    United Kingdom Understanding Recruitment NFP Full time

    Data Engineer - Fully Remote! A brand new and exciting opportunity has recently arisen for a Data Engineer with excellent knowledge in Azure Data Factory, and SQL to join one of the UK's Largest Cancer Charities. This is an excellent opportunity for a Data Engineer to be heavily involved in the biggest data engineering project this charity has ever done!If...

  • Senior Data Engineer

    1 week ago

    United Kingdom Clearwater People Solutions Ltd Full time

    Our client, a well-known and market-leading Financial Services company, is currently recruiting for a Senior Data Engineer to join their Data engineering team. The Senior Data Engineer will be responsible for designing, developing, and maintaining data pipelines and workflows to support the organisation's data processing needs and facilitate BI...

  • Senior Data Engineer

    1 week ago

    United Kingdom Clearwater People Solutions Ltd Full time

    Our client, a well-known and market-leading Financial Services company, is currently recruiting for a Senior Data Engineer to join their Data engineering team. The Senior Data Engineer will be responsible for designing, developing, and maintaining data pipelines and workflows to support the organisation's data processing needs and facilitate BI...

  • Senior Engineer, Data Engineering

    1 day ago

    United Kingdom GradBay Full time

    Job Title: Senior Azure Data Engineer Location: London, UK Our client is a leading insurance broker in the heart of London, seeking to hire a Senior Azure Data Engineer. This is an exceptional opportunity for someone passionate about using data solutions to drive business decisions and enhance client service in the insurance industry. Design,...