Cloud Data Engineer

4 days ago


Nottingham, Nottingham, United Kingdom Rullion Limited Full time

Job Title: Cloud Data Engineer

 About the Role

We are seeking a talented Cloud Data Engineer to join our team at Rullion Limited, a leading recruitment agency. As a major UK energy provider, the client is committed to 100% renewable energy and sustainability, focusing on delivering exceptional customer experiences.

 

Estimated Salary: £65,000 - £85,000 per annum.

 About the Job

This full-time role involves developing and maintaining scalable, efficient data pipelines within Databricks, continuously evolving them as requirements and technologies change. You will build and manage an enterprise data model within Databricks and integrate new data sources into the platform using batch and streaming processes, adhering to SLAs.

 

You will create and maintain documentation for data pipelines and associated systems, following security and monitoring protocols. Ensuring data quality and reliability processes are effective, maintaining trust in the data, taking ownership of complex data engineering projects, and developing appropriate solutions in accordance with business requirements.

 

Key Skills and Qualifications

  • Extensive experience of Python preferred, including advanced concepts like decorators, protocols, functools, context managers, and comprehensions.
  • Strong understanding of SQL, database design, and data architecture.
  • Experience with Databricks and/or Spark.
  • Knowledgeable in data governance, data cataloguing, data quality principles, and related tools.
  • Skilled in data extraction, joining, and aggregation tasks, especially with big data and real-time data using Spark.
  • Capable of performing data cleansing operations to prepare data for analysis, including transforming data into useful formats.
  • Understand data storage concepts and logical data structures, such as data warehousing.
  • Able to write repeatable, production-quality code for data pipelines, utilizing templating and parameterization where needed.
  • Can make data pipeline design recommendations based on business requirements.
  • Experience with data migration is a plus.
  • Open to new ways of working and new technologies.
  • Self-motivated with the ability to set goals and take initiative.
  • Driven to troubleshoot, deconstruct problems, and build effective solutions.
  • Experience of Git / Version control
  • Experience working with larger, legacy codebases
  • Understanding of unit and integration testing
  • Understanding and experience with CI/CD and general software development best practices
  • A strong attention to detail and a curiosity about the data you will be working with.
  • A strong understanding of Linux based tooling and concepts
  • Knowledge and experience of Amazon Web Services is essential

 

Benefits and Details

This is a hybrid role with one day a week being based in Nottingham, negotiable. The contract is initially 3 months with potential to extend.

 

Please note that any assignment offer with our client will be subject to a satisfactory checking report from the Disclosure Barring Service. We celebrate and support diversity and are committed to ensuring equal opportunities for both employees and applicants.

 

Rullion has been securing exceptional candidates for a range of clients since 1978. Our approach is credible and honest, focused on building long-lasting relationships with both clients and candidates.




  • Nottingham, Nottingham, United Kingdom Data Privacy Full time

    About UsWe are a leading information-based technology company, committed to helping our customers succeed by bringing ingenuity, simplicity, and humanity to banking.About the JobWe are seeking a Cloud Engineering Leader to join our Data team. This is a senior role that requires significant experience in software development, architecture, data, machine...

  • Cloud Data Engineer

    2 weeks ago


    Nottingham, Nottingham, United Kingdom BJSS Full time

    At BJSS, we're an award-winning tech consultancy that's been pushing boundaries since 1993. Our innovative approach has earned us a prestigious Queen's Award for Enterprise in the Innovation category for our Enterprise Agile delivery approach.We're now seeking a skilled Cloud Data Engineer to join our team and help our clients deploy data pipelines and...

  • Cloud Data Engineer

    2 weeks ago


    Nottingham, Nottingham, United Kingdom Velocity Tech Full time

    Velocity Tech seeks a skilled Cloud Data Engineer to play a pivotal role in developing and maintaining data infrastructure that powers advanced analytics and solution development. This is an opportunity to work with a talented team driving impact in the global wind energy space.**Job Responsibilities:**- Design and build high-performance batch and real-time...


  • Nottingham, Nottingham, United Kingdom Data Privacy Full time

    Company OverviewCapital One is a pioneer in the financial technology sector, driven by a vision to revolutionize banking through innovative data solutions. Our mission is to empower customers with intelligent, personalized experiences that transform their lives.SalaryThe estimated annual salary for this role is $180,000 - $230,000, reflecting the company's...


  • Nottingham, Nottingham, United Kingdom UST Global Full time

    Job Summary:We are seeking a skilled Cloud Native Data Engineer to join our team in East Midlands. As a Databricks Native Platform Architect, you will lead cloud-native platform engineering teams and deliver high-quality, scalable cloud solutions on Azure.About the Role:This is a Fixed Term/ Full time employment opportunity with a Hybrid Working model,...


  • Nottingham, Nottingham, United Kingdom Velocity Tech Full time

    Job Overview:Velocity Tech is looking for a Cloud Data Engineering Manager to lead our data engineering efforts. As a key member of our team, you will be responsible for designing and building high-performance data pipelines, creating ETL processes, and transforming raw data into insightful datasets.You'll collaborate with engineering, analytics, and data...

  • Cloud Architect

    2 weeks ago


    Nottingham, Nottingham, United Kingdom Data Privacy Full time

    Company OverviewCapital One is a leader in the financial services industry, dedicated to helping customers succeed through innovative banking solutions. We are committed to delivering exceptional customer experiences and driving business growth through our expertise in data-driven technologies.SalaryThe estimated annual salary for this role is $175,000 -...


  • Nottingham, Nottingham, United Kingdom Velocity Tech Full time

    Velocity Tech is looking for a Cloud Data Engineering Lead to oversee the design and implementation of our data infrastructure. As a subject matter expert in cloud technologies and data engineering tools, you'll develop and maintain high-performance data pipelines, create ETL processes, and deliver actionable insights to stakeholders.We're seeking someone...


  • Nottingham, Nottingham, United Kingdom N Consulting Limited Full time

    N Consulting Limited is hiring a Cloud Data Engineering Lead to oversee the design, creation, and implementation of our data and analytics platform. The successful candidate will be responsible for establishing best practices and standards on data and platform architecture, ensuring solutions are scalable, reliable, well-governed, secure, and compliant.This...


  • Nottingham, Nottingham, United Kingdom E Next Full time

    About the Role:We are looking for an experienced Cloud Data Architect to lead the design and implementation of our cloud-based data platform at E.ON Next.Responsibilities:Design and deploy scalable cloud-based data infrastructure using Databricks and other cloud services.Develop and maintain data architecture standards and best practices.Work closely with...


  • Nottingham, Nottingham, United Kingdom Velocity Tech Full time

    Job Overview:We are looking for a seasoned Cloud Data Architect to lead the design and implementation of our data infrastructure at Velocity Tech.As a key member of our engineering team, you will be responsible for architecting and implementing scalable data pipelines, creating ETL processes, and transforming raw data into consumable datasets for technical...


  • Nottingham, Nottingham, United Kingdom Velocity Tech Full time

    Company Overview: Velocity Tech is a leading provider of innovative solutions for the renewable energy industry. Our mission is to accelerate the transition to a low-carbon economy by harnessing the power of technology.Job Description:We are seeking a Senior Data Infrastructure Specialist to join our team at Velocity Tech. As a key member of our data...


  • Nottingham, Nottingham, United Kingdom ONYX Insight Full time

    Job OverviewAt ONYX Insight, we're seeking a skilled Cloud Data Engineer to develop and maintain our data infrastructure. This role will play a pivotal part in designing and building high-performance batch and real-time data pipelines. You'll collaborate with engineering, analytics, and data science teams to deploy machine learning models, automate...

  • Cloud Data Specialist

    2 weeks ago


    Nottingham, Nottingham, United Kingdom BJSS Full time

    We are a leading tech consultancy, renowned for our innovative approach to solving complex technology problems. Our team of creative problem solvers has been finding better ways to deliver business value to some of the world's leading organisations since 1993.As a Cloud Data Specialist at BJSS, you will be part of a collaborative and open culture that values...


  • Nottingham, Nottingham, United Kingdom Velocity Tech Full time

    Required Skills and Qualifications:To succeed in this role, you will need strong expertise in AWS cloud platforms and data engineering tools. Proficiency in building and maintaining data lake/warehouse solutions is also essential. Additionally, you should have advanced skills in SQL and relational database design, experience with data ingestion and ETL...


  • Nottingham, Nottingham, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Harnham is looking for a talented Cloud Analytics Specialist to join our team.Salary: Up to £65,000 + BenefitsThis is a remote working opportunity, allowing for flexibility and work-life balance.We are seeking an experienced Cloud Analytics Specialist to help us implement and maintain ELT pipelines, ingest data into Snowflake, and transform data using...


  • Nottingham, Nottingham, United Kingdom InfraView - Specialist Cloud & IT Infrastructure Technology Recruitment Full time

    Job OverviewInfraView is seeking an experienced Cloud Infrastructure Engineer to join our team. As a key member of our technical staff, you will be responsible for designing and implementing cloud-based solutions for our clients.The ideal candidate will have extensive experience in cloud technologies, including VMware, Networking, Microsoft Server, HPe...


  • Nottingham, Nottingham, United Kingdom Velocity Tech Full time

    About Velocity Tech: We are a leading global renewable technology business dedicated to harnessing the power of wind energy. Our innovative approach has enabled us to establish a strong presence in the industry, and we continue to push boundaries through cutting-edge research and development.Job Description:As a Senior Data Engineer at Velocity Tech, you...


  • Nottingham, Nottingham, United Kingdom Rullion Limited Full time

    Job DescriptionWe are seeking a Cloud Data Architect to lead our data engineering projects at Rullion Limited. This is a full-time, hybrid role, with one day a week based in our Nottingham office. The initial contract duration is 3 months, with potential for extension.The successful candidate will ensure data quality and reliability processes are effective,...

  • Cloud Data Engineer

    2 weeks ago


    Nottingham, Nottingham, United Kingdom Nimbus Full time

    About Nimbus: Nimbus is a Halma company, a group of life-saving technologies, building a safer, cleaner, and healthier future.Salary: Highly Competitive + Exciting Benefits Package (£80,000 - £120,000 per year)Job Title: Senior Data EngineerJob Description: We're seeking a talented Senior Data Engineer to join our team and play a key role in shaping the...