Current jobs related to Data Engineer - Derby - be:technology

  • Data Engineer

    3 weeks ago


    Derby, Derby, United Kingdom Mace Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Mace. As a Data Engineer, you will play a critical role in designing, building, and maintaining our data infrastructure, ensuring that our clients receive accurate and timely insights to inform their business decisions.Key ResponsibilitiesDesign and implement data pipelines to...

  • Data Engineer

    3 weeks ago


    Derby, Derby, United Kingdom Mace Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Mace. As a Data Engineer, you will play a critical role in designing, building, and maintaining our data infrastructure, ensuring that our clients receive accurate and timely insights to inform their business decisions.Key ResponsibilitiesDesign and implement data pipelines to...

  • Data Engineer

    4 weeks ago


    Derby, Derby, United Kingdom ENGINEERINGUK Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at ENGINEERINGUK. As a Data Engineer, you will play a critical role in designing, building, and maintaining our data infrastructure, ensuring that our data is accurate, reliable, and secure.Key ResponsibilitiesDesign and implement data pipelines to extract, transform, and load data...

  • Data Engineer

    4 weeks ago


    Derby, Derby, United Kingdom ENGINEERINGUK Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at ENGINEERINGUK. As a Data Engineer, you will play a critical role in designing, building, and maintaining our data infrastructure, ensuring that our data is accurate, reliable, and secure.Key ResponsibilitiesDesign and implement data pipelines to extract, transform, and load data...

  • Data Engineer

    3 weeks ago


    Derby, Derby, United Kingdom ENGINEERINGUK Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at ENGINEERINGUK. As a Data Engineer, you will play a critical role in designing, building, and maintaining our data infrastructure, ensuring seamless data flow and efficient data management.Key ResponsibilitiesDesign and implement data pipelines to extract, transform, and load data...

  • Data Engineer

    3 weeks ago


    Derby, Derby, United Kingdom ENGINEERINGUK Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at ENGINEERINGUK. As a Data Engineer, you will play a critical role in designing, building, and maintaining our data infrastructure, ensuring seamless data flow and efficient data management.Key ResponsibilitiesDesign and implement data pipelines to extract, transform, and load data...

  • Data Engineer

    3 weeks ago


    Derby, Derby, United Kingdom Mace Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Mace. As a Data Engineer, you will play a critical role in designing, building, and maintaining our data infrastructure, ensuring that our clients receive accurate and timely insights to inform their business decisions.Key ResponsibilitiesDesign and implement data pipelines to...

  • Data Engineer

    3 weeks ago


    Derby, Derby, United Kingdom Mace Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Mace. As a Data Engineer, you will play a critical role in designing, building, and maintaining our data infrastructure, ensuring that our clients receive accurate and timely insights to inform their business decisions.Key ResponsibilitiesDesign and implement data pipelines to...

  • Data Engineer

    3 weeks ago


    Derby, Derby, United Kingdom Mace Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Mace. As a Data Engineer, you will play a critical role in designing, building, and maintaining our data infrastructure, ensuring that our clients receive accurate and timely insights to inform their business decisions.Key ResponsibilitiesDesign and implement data pipelines to...

  • Data Engineer

    3 weeks ago


    Derby, Derby, United Kingdom Mace Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Mace. As a Data Engineer, you will play a critical role in designing, building, and maintaining our data infrastructure, ensuring that our clients receive accurate and timely insights to inform their business decisions.Key ResponsibilitiesDesign and implement data pipelines to...

  • Python Data Engineer

    4 weeks ago


    Derby, Derby, United Kingdom Expleo Full time

    Job Title: Python Data EngineerExpleo is seeking a skilled Python Data Engineer to join our team. As a Python Data Engineer, you will be responsible for designing, developing, and implementing Python and other Azure services.Key Responsibilities:Design and develop data pipelines to extract, transform, and load data into Azure data warehouses.Develop and...

  • Python Data Engineer

    4 weeks ago


    Derby, Derby, United Kingdom Expleo Full time

    Job Title: Python Data EngineerExpleo is seeking a skilled Python Data Engineer to join our team. As a Python Data Engineer, you will be responsible for designing, developing, and implementing Python and other Azure services.Key Responsibilities:Design and develop data pipelines to extract, transform, and load data into Azure data warehouses.Develop and...

  • Python Data Engineer

    3 weeks ago


    Derby, Derby, United Kingdom Expleo Full time

    Job Title: Python Data EngineerExpleo is seeking a skilled Python Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing Python and other Azure services.Responsibilities:Design and develop data pipelines to extract, transform, and load data into Azure data...

  • Python Data Engineer

    3 weeks ago


    Derby, Derby, United Kingdom Expleo Full time

    Job Title: Python Data EngineerExpleo is seeking a skilled Python Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing Python and other Azure services.Responsibilities:Design and develop data pipelines to extract, transform, and load data into Azure data...

  • Python Data Engineer

    4 weeks ago


    Derby, Derby, United Kingdom Expleo Full time

    Job Title: Python Data EngineerAt Expleo, we're seeking a talented Python Data Engineer to join our team. As a key member of our data engineering team, you'll be responsible for designing, developing, and implementing Python and other Azure services to drive business growth and innovation.Responsibilities:Design and develop scalable data pipelines to...

  • Python Data Engineer

    4 weeks ago


    Derby, Derby, United Kingdom Expleo Full time

    Job Title: Python Data EngineerAt Expleo, we're seeking a talented Python Data Engineer to join our team. As a key member of our data engineering team, you'll be responsible for designing, developing, and implementing Python and other Azure services to drive business growth and innovation.Responsibilities:Design and develop scalable data pipelines to...

  • Python Data Engineer

    4 weeks ago


    Derby, Derby, United Kingdom Expleo Full time

    Job Title: Python Data EngineerAt Expleo, we're seeking a skilled Python Data Engineer to join our team. As a key member of our data engineering team, you'll be responsible for designing, developing, and implementing Python and other Azure services.Key Responsibilities:Design and develop data pipelines to extract, transform, and load data into Azure data...

  • Python Data Engineer

    4 weeks ago


    Derby, Derby, United Kingdom Expleo Full time

    Job Title: Python Data EngineerAt Expleo, we're seeking a skilled Python Data Engineer to join our team. As a key member of our data engineering team, you'll be responsible for designing, developing, and implementing Python and other Azure services.Key Responsibilities:Design and develop data pipelines to extract, transform, and load data into Azure data...


  • Derby, Derby, United Kingdom SERVPRO of East Central Cincinnati Full time

    Commercial Data EngineerEast Midlands Railway is seeking a skilled Commercial Data Engineer to join their team in Derby. As a key member of the Commercial team, you will play a crucial role in designing and implementing data solutions to drive business growth and improvement.Key Responsibilities:Identify opportunities for data-driven decision making and...

  • Azure Data Engineer

    1 month ago


    Derby, Derby, United Kingdom Blue Tree Group Full time

    Azure Data Engineer RoleGleeson Recruitment Group is seeking a skilled Azure Data Engineer to join their newly forming team in Derby. This role is pivotal in driving the development and delivery of the company's Digital Portfolio, ensuring the efficiency and reliability of data pipelines and quality monitoring.Key Responsibilities:Monitor and recover Azure...

Data Engineer

2 months ago


Derby, United Kingdom be:technology Full time

Role: Azure Data Engineer

Salary: £40-55k

Location: Derby/Hybrid (3x a week)


I have partnered up with a prolific asset management company who are looking for an experienced Data Engineer to join their team.


Delivering innovative and sustainable stock, they currently have billions of £ worth of investments under asset management.


Benefits:

  • 10% performance based bonus
  • Visa sponsorship
  • 25 days annual leave (increasing with service) + bank holidays
  • Annual leave buy/sell scheme
  • Employer pays 1.5x the employee pension contribution
  • Financial wellbeing support
  • Flexible working around core hours
  • Cycle to work scheme
  • Clear progression opportunities


This position is crucial for supporting the development and delivery of a comprehensive digital portfolio. Leveraging a unified data platform and collaborating with the team, you will be tasked with managing and maintaining data pipelines, overseeing workloads, conducting root cause analysis, ensuring data quality, and escalating technical issues.


Responsibilities

  • Oversee and restore operations for Azure Data Factory and Databricks jobs.
  • Actively monitor data quality.
  • Become an expert on the organisation’s data sources, ingestion methods, and data quality standards.
  • Help develop and adhere to data governance policies and internal procedures.
  • Work closely with the team to understand business needs and enhance data quality.
  • Create and maintain KPIs for digital services data quality.
  • Manage and monitor user-facing dashboards and other internal digital products.
  • Update and patch existing digital software products.
  • Document outcomes of root cause analyses.


General Requirements

  • Extensive experience with Microsoft Azure is essential for this role.
  • Familiarity with Azure components like Azure Data Factory, Azure SQL DB, and Azure Data Lake.
  • Strong proficiency in Python is critical for data manipulation and automation tasks.
  • Experience with Apache Spark and/or Databricks.
  • Proficient in using BI visualisation tools such as Power BI.
  • Experience in managing end-to-end analytics pipelines (both batch and streaming) for data science applications.
  • Skilled in root-cause analysis and post-incident reporting in a production environment.


Knowledge and Qualifications

  • A relevant degree in Computer Science, Engineering, or related fields, and/or relevant certifications such as Azure Data Engineer Associate.
  • Extensive experience with data ingestion methods for both real-time and batch processing.
  • Proficient in PySpark.
  • Skilled in debugging Apache Spark workloads.
  • Experience using BI visualisation tools like Power BI.


Key Skills

  • Strong interpersonal skills.
  • Proficient in report writing, presentation, and record-keeping.
  • Excellent communication and stakeholder management skills.


If you are a talented Data Engineer and are wanting to join a great organisation with excellent people who place emphasis on personal development, then we would love to hear from you.


Send your CV over today to apply