Data Engineer

2 weeks ago

Coventry, United Kingdom HCLTech Full time

We are hiring Databricks Engineer for Coventry Location

Below are details of the role

Key Responsibilities:

•Databricks Platform Support:

•Provide daily support for the Databricks platform running on AWS.

•Ensuring data security and access controls are setup and maintained

•Monitor and troubleshoot clusters, workspaces, jobs, and other Databricks resources

•Familiar with setting up and using medallion architecture, and the unity catalog

•Handle incidents, requests, and changes in Databricks environments.

•Collaborate with engineering and DevOps teams to resolve complex platform issues.

•Familiarity with Databricks ML flows and monitoring

•Performance Tuning & Optimization:

•Analyse workloads and optimize Databricks clusters for performance and cost-efficiency.

•Recommend best practices for efficient Spark job execution and data processing.

•AWS Infrastructure Management:

•Manage and configure AWS services (e.g., S3, EC2, IAM, Lambda) that integrate with Databricks.

•Ensure proper security configurations and compliance with AWS standards.

•Manage networking, security groups, and VPCs related to Databricks setup.

•Automation & DevOps:

•Develop and maintain automation scripts for platform maintenance and monitoring.

•Work closely with DevOps teams to automate cluster management, scaling, and infrastructure provisioning.

•Implement CI/CD pipelines for Databricks deployments using tools like Jenkins, Git, or Terraform.

Qualifications:

•Bachelor’s degree in computer science, Information Technology, or related field. and 5+ years of experience supporting Databricks or similar data platforms.

•Strong expertise in Databricks on AWS: cluster management, job execution, Spark optimization.

•Hands-on experience with AWS services like EC2, S3, IAM, Lambda, RDS, VPC.

•Proficiency in Python, Scala, or SQL for data engineering tasks.

•Solid understanding of Apache Spark, ETL pipelines, and big data processing.

•Familiarity with DevOps practices, automation tools (Terraform, Ansible), and CI/CD pipelines.

  • Data Engineer

    1 month ago

    Coventry, Coventry, United Kingdom Coventry Building Society Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our Data Engineering and Data Science capability. As part of our team, you will play a key role in supporting the development of our data capabilities and driving business success.Key ResponsibilitiesDesign and implement data pipelines to support business needsDevelop and maintain data...

  • Data Engineer

    1 month ago

    Coventry, Coventry, United Kingdom Coventry Building Society Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our Data Engineering and Data Science capability. As part of our team, you will play a key role in supporting the development of our data capabilities and driving business success.Key ResponsibilitiesDesign and implement data pipelines to support business needsDevelop and maintain data...

  • Data Engineer

    4 weeks ago

    Coventry, Coventry, United Kingdom Digital Waffle Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Digital Waffle. As a Data Engineer, you will play a key role in designing, implementing, and maintaining our Azure Data Factory pipelines.Key ResponsibilitiesDesign and implement Azure Data Factory pipeline definitions within version control to customer environments.Collaborate...

  • Data Engineer

    4 weeks ago

    Coventry, Coventry, United Kingdom Digital Waffle Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Digital Waffle. As a Data Engineer, you will play a key role in designing, implementing, and maintaining our Azure Data Factory pipelines.Key ResponsibilitiesDesign and implement Azure Data Factory pipeline definitions within version control to customer environments.Collaborate...

  • **Data Engineer**

    1 week ago

    Coventry, Coventry, United Kingdom University Hospitals Coventry and Warwickshire NHS Trust Full time

    We are looking for a skilled Data Engineer to join our team at {company}. The successful candidate will be responsible for designing, developing, and maintaining large-scale data systems to support our business operations.Key responsibilities will include:Designing and implementing data pipelines to ensure data quality and integrityDeveloping and maintaining...

  • Data Engineer

    4 weeks ago

    Coventry, Coventry, United Kingdom CV Library Full time

    Job Title: Data EngineerCadent Gas Ltd is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a critical role in developing high-quality, reusable enterprise-level data that will be utilized for regulatory, operational, and analytic reporting and insights.Key Responsibilities:Apply Enterprise Data Modelling techniques...

  • Data Engineer

    4 weeks ago

    Coventry, Coventry, United Kingdom CV Library Full time

    Job Title: Data EngineerCadent Gas Ltd is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a critical role in developing high-quality, reusable enterprise-level data that will be utilized for regulatory, operational, and analytic reporting and insights.Key Responsibilities:Apply Enterprise Data Modelling techniques...

  • Data Engineer

    4 weeks ago

    Coventry, Coventry, United Kingdom Cadent Gas Limited Full time

    About the RoleCadent Gas Limited is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a critical role in developing high-quality, reusable enterprise-level data that will be utilised for regulatory, operational, and analytic reporting and insights.Key ResponsibilitiesApply Enterprise Data Modelling techniques to...

  • Data Engineer

    4 weeks ago

    Coventry, Coventry, United Kingdom Cadent Gas Limited Full time

    About the RoleCadent Gas Limited is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a critical role in developing high-quality, reusable enterprise-level data that will be utilised for regulatory, operational, and analytic reporting and insights.Key ResponsibilitiesApply Enterprise Data Modelling techniques to...

  • Data Engineer

    4 weeks ago

    Coventry, Coventry, United Kingdom Cadent Full time

    Job Title: Data EngineerCadent is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a critical role in developing high-quality, reusable enterprise-level data that is utilized for regulatory, operational, and analytic reporting and insights.Key Responsibilities:Apply Enterprise Data Modelling techniques to...

  • Data Engineer

    4 weeks ago

    Coventry, Coventry, United Kingdom Cadent Full time

    Job Title: Data EngineerCadent is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a critical role in developing high-quality, reusable enterprise-level data that is utilized for regulatory, operational, and analytic reporting and insights.Key Responsibilities:Apply Enterprise Data Modelling techniques to...

  • Data Engineer

    1 month ago

    Coventry, Coventry, United Kingdom Cadent Gas Full time

    About the RoleCadent Gas is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a critical role in developing high-quality, reusable enterprise-level data that will be utilised for regulatory, operational, and analytic reporting and insights.Key ResponsibilitiesApply Enterprise Data Modelling techniques to conceptualise...

  • Data Engineer

    1 month ago

    Coventry, Coventry, United Kingdom Cadent Gas Full time

    About the RoleCadent Gas is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a critical role in developing high-quality, reusable enterprise-level data that will be utilised for regulatory, operational, and analytic reporting and insights.Key ResponsibilitiesApply Enterprise Data Modelling techniques to conceptualise...

  • Data Engineer

    24 hours ago

    Coventry, United Kingdom CV-Library Full time

    Senior Data Engineer Location: Coventry (4 Days a Week) Salary: To £65,000 + Benefits Job Description Investigo is partnered with a global Automobile organisation. They offer systems that are used by some of the largest brands in the Automobile sector. We are looking to assist them in growing out a new data focused team to ultimate service the...

  • Data Engineer

    1 week ago

    Coventry, United Kingdom HCLTech Full time

    We are hiring Databricks Engineer for Coventry Location Below are details of the role Key Responsibilities: •Databricks Platform Support: •Provide daily support for the Databricks platform running on AWS. •Ensuring data security and access controls are setup and maintained •Monitor and troubleshoot clusters, workspaces, jobs, and other...

  • Data Engineer

    2 weeks ago

    Coventry, United Kingdom HCLTech Full time

    We are hiring Databricks Engineer for Coventry LocationBelow are details of the roleKey Responsibilities: •Databricks Platform Support: •Provide daily support for the Databricks platform running on AWS. •Ensuring data security and access controls are setup and maintained •Monitor and troubleshoot clusters, workspaces, jobs, and other Databricks...

  • Data Engineer

    2 weeks ago

    Coventry, United Kingdom HCLTech Full time

    We are hiring Databricks Engineer for Coventry Location Below are details of the role Key Responsibilities: •Databricks Platform Support: •Provide daily support for the Databricks platform running on AWS. •Ensuring data security and access controls are setup and maintained •Monitor and troubleshoot clusters, workspaces, jobs, and other Databricks...

  • Data Engineer

    2 weeks ago

    Coventry, United Kingdom HCLTech Full time

    We are hiring Databricks Engineer for Coventry LocationBelow are details of the roleKey Responsibilities: •Databricks Platform Support: •Provide daily support for the Databricks platform running on AWS. •Ensuring data security and access controls are setup and maintained •Monitor and troubleshoot clusters, workspaces, jobs, and other Databricks...

  • Data Engineer

    2 weeks ago

    Coventry, United Kingdom HCLTech Full time

    We are hiring Databricks Engineer for Coventry LocationBelow are details of the roleKey Responsibilities: •Databricks Platform Support: •Provide daily support for the Databricks platform running on AWS. •Ensuring data security and access controls are setup and maintained •Monitor and troubleshoot clusters, workspaces, jobs, and other Databricks...

  • Data Engineer

    2 weeks ago

    Coventry, United Kingdom CV-Library Full time

    Your new role As a Data Engineer, you will be working on multiple projects, including the design and implementation, gathering data and integrating into existing model for extension. You will have experience of SSIS, MS SQL, Datawarehouse and cubes. Power BI experience preferred. Whilst this role doesn't involve Azure, there are upcoming clouds projects...