Cloud Data Engineer
4 days ago
Job Title: Cloud Data Engineer
About the Role
We are seeking a talented Cloud Data Engineer to join our team at Rullion Limited, a leading recruitment agency. As a major UK energy provider, the client is committed to 100% renewable energy and sustainability, focusing on delivering exceptional customer experiences.
Estimated Salary: £65,000 - £85,000 per annum.
About the Job
This full-time role involves developing and maintaining scalable, efficient data pipelines within Databricks, continuously evolving them as requirements and technologies change. You will build and manage an enterprise data model within Databricks and integrate new data sources into the platform using batch and streaming processes, adhering to SLAs.
You will create and maintain documentation for data pipelines and associated systems, following security and monitoring protocols. Ensuring data quality and reliability processes are effective, maintaining trust in the data, taking ownership of complex data engineering projects, and developing appropriate solutions in accordance with business requirements.
Key Skills and Qualifications
- Extensive experience of Python preferred, including advanced concepts like decorators, protocols, functools, context managers, and comprehensions.
- Strong understanding of SQL, database design, and data architecture.
- Experience with Databricks and/or Spark.
- Knowledgeable in data governance, data cataloguing, data quality principles, and related tools.
- Skilled in data extraction, joining, and aggregation tasks, especially with big data and real-time data using Spark.
- Capable of performing data cleansing operations to prepare data for analysis, including transforming data into useful formats.
- Understand data storage concepts and logical data structures, such as data warehousing.
- Able to write repeatable, production-quality code for data pipelines, utilizing templating and parameterization where needed.
- Can make data pipeline design recommendations based on business requirements.
- Experience with data migration is a plus.
- Open to new ways of working and new technologies.
- Self-motivated with the ability to set goals and take initiative.
- Driven to troubleshoot, deconstruct problems, and build effective solutions.
- Experience of Git / Version control
- Experience working with larger, legacy codebases
- Understanding of unit and integration testing
- Understanding and experience with CI/CD and general software development best practices
- A strong attention to detail and a curiosity about the data you will be working with.
- A strong understanding of Linux based tooling and concepts
- Knowledge and experience of Amazon Web Services is essential
Benefits and Details
This is a hybrid role with one day a week being based in Nottingham, negotiable. The contract is initially 3 months with potential to extend.
Please note that any assignment offer with our client will be subject to a satisfactory checking report from the Disclosure Barring Service. We celebrate and support diversity and are committed to ensuring equal opportunities for both employees and applicants.
Rullion has been securing exceptional candidates for a range of clients since 1978. Our approach is credible and honest, focused on building long-lasting relationships with both clients and candidates.
-
Cloud Engineering Leader
2 weeks ago
Nottingham, Nottingham, United Kingdom Data Privacy Full timeAbout UsWe are a leading information-based technology company, committed to helping our customers succeed by bringing ingenuity, simplicity, and humanity to banking.About the JobWe are seeking a Cloud Engineering Leader to join our Data team. This is a senior role that requires significant experience in software development, architecture, data, machine...
-
Cloud Data Engineer
2 weeks ago
Nottingham, Nottingham, United Kingdom BJSS Full timeAt BJSS, we're an award-winning tech consultancy that's been pushing boundaries since 1993. Our innovative approach has earned us a prestigious Queen's Award for Enterprise in the Innovation category for our Enterprise Agile delivery approach.We're now seeking a skilled Cloud Data Engineer to join our team and help our clients deploy data pipelines and...
-
Cloud Data Engineer
2 weeks ago
Nottingham, Nottingham, United Kingdom Velocity Tech Full timeVelocity Tech seeks a skilled Cloud Data Engineer to play a pivotal role in developing and maintaining data infrastructure that powers advanced analytics and solution development. This is an opportunity to work with a talented team driving impact in the global wind energy space.**Job Responsibilities:**- Design and build high-performance batch and real-time...
-
Data Solutions Engineer
2 weeks ago
Nottingham, Nottingham, United Kingdom Data Privacy Full timeCompany OverviewCapital One is a pioneer in the financial technology sector, driven by a vision to revolutionize banking through innovative data solutions. Our mission is to empower customers with intelligent, personalized experiences that transform their lives.SalaryThe estimated annual salary for this role is $180,000 - $230,000, reflecting the company's...
-
Cloud Native Data Engineer
2 weeks ago
Nottingham, Nottingham, United Kingdom UST Global Full timeJob Summary:We are seeking a skilled Cloud Native Data Engineer to join our team in East Midlands. As a Databricks Native Platform Architect, you will lead cloud-native platform engineering teams and deliver high-quality, scalable cloud solutions on Azure.About the Role:This is a Fixed Term/ Full time employment opportunity with a Hybrid Working model,...
-
Cloud Data Engineering Manager
4 days ago
Nottingham, Nottingham, United Kingdom Velocity Tech Full timeJob Overview:Velocity Tech is looking for a Cloud Data Engineering Manager to lead our data engineering efforts. As a key member of our team, you will be responsible for designing and building high-performance data pipelines, creating ETL processes, and transforming raw data into insightful datasets.You'll collaborate with engineering, analytics, and data...
-
Cloud Architect
2 weeks ago
Nottingham, Nottingham, United Kingdom Data Privacy Full timeCompany OverviewCapital One is a leader in the financial services industry, dedicated to helping customers succeed through innovative banking solutions. We are committed to delivering exceptional customer experiences and driving business growth through our expertise in data-driven technologies.SalaryThe estimated annual salary for this role is $175,000 -...
-
Cloud Data Engineering Lead
1 week ago
Nottingham, Nottingham, United Kingdom Velocity Tech Full timeVelocity Tech is looking for a Cloud Data Engineering Lead to oversee the design and implementation of our data infrastructure. As a subject matter expert in cloud technologies and data engineering tools, you'll develop and maintain high-performance data pipelines, create ETL processes, and deliver actionable insights to stakeholders.We're seeking someone...
-
Cloud Data Engineering Lead
1 day ago
Nottingham, Nottingham, United Kingdom N Consulting Limited Full timeN Consulting Limited is hiring a Cloud Data Engineering Lead to oversee the design, creation, and implementation of our data and analytics platform. The successful candidate will be responsible for establishing best practices and standards on data and platform architecture, ensuring solutions are scalable, reliable, well-governed, secure, and compliant.This...
-
Cloud Data Architect
1 day ago
Nottingham, Nottingham, United Kingdom E Next Full timeAbout the Role:We are looking for an experienced Cloud Data Architect to lead the design and implementation of our cloud-based data platform at E.ON Next.Responsibilities:Design and deploy scalable cloud-based data infrastructure using Databricks and other cloud services.Develop and maintain data architecture standards and best practices.Work closely with...
-
Cloud Data Architect
1 week ago
Nottingham, Nottingham, United Kingdom Velocity Tech Full timeJob Overview:We are looking for a seasoned Cloud Data Architect to lead the design and implementation of our data infrastructure at Velocity Tech.As a key member of our engineering team, you will be responsible for architecting and implementing scalable data pipelines, creating ETL processes, and transforming raw data into consumable datasets for technical...
-
Cloud Data Architect
1 week ago
Nottingham, Nottingham, United Kingdom Velocity Tech Full timeCompany Overview: Velocity Tech is a leading provider of innovative solutions for the renewable energy industry. Our mission is to accelerate the transition to a low-carbon economy by harnessing the power of technology.Job Description:We are seeking a Senior Data Infrastructure Specialist to join our team at Velocity Tech. As a key member of our data...
-
Cloud Data Engineer
1 day ago
Nottingham, Nottingham, United Kingdom ONYX Insight Full timeJob OverviewAt ONYX Insight, we're seeking a skilled Cloud Data Engineer to develop and maintain our data infrastructure. This role will play a pivotal part in designing and building high-performance batch and real-time data pipelines. You'll collaborate with engineering, analytics, and data science teams to deploy machine learning models, automate...
-
Cloud Data Specialist
2 weeks ago
Nottingham, Nottingham, United Kingdom BJSS Full timeWe are a leading tech consultancy, renowned for our innovative approach to solving complex technology problems. Our team of creative problem solvers has been finding better ways to deliver business value to some of the world's leading organisations since 1993.As a Cloud Data Specialist at BJSS, you will be part of a collaborative and open culture that values...
-
Cloud Data Architect
1 week ago
Nottingham, Nottingham, United Kingdom Velocity Tech Full timeRequired Skills and Qualifications:To succeed in this role, you will need strong expertise in AWS cloud platforms and data engineering tools. Proficiency in building and maintaining data lake/warehouse solutions is also essential. Additionally, you should have advanced skills in SQL and relational database design, experience with data ingestion and ETL...
-
Cloud Analytics Specialist
2 weeks ago
Nottingham, Nottingham, United Kingdom Harnham - Data & Analytics Recruitment Full timeHarnham is looking for a talented Cloud Analytics Specialist to join our team.Salary: Up to £65,000 + BenefitsThis is a remote working opportunity, allowing for flexibility and work-life balance.We are seeking an experienced Cloud Analytics Specialist to help us implement and maintain ELT pipelines, ingest data into Snowflake, and transform data using...
-
Cloud Infrastructure Engineer
1 week ago
Nottingham, Nottingham, United Kingdom InfraView - Specialist Cloud & IT Infrastructure Technology Recruitment Full timeJob OverviewInfraView is seeking an experienced Cloud Infrastructure Engineer to join our team. As a key member of our technical staff, you will be responsible for designing and implementing cloud-based solutions for our clients.The ideal candidate will have extensive experience in cloud technologies, including VMware, Networking, Microsoft Server, HPe...
-
Cloud-Based Data Architect
1 week ago
Nottingham, Nottingham, United Kingdom Velocity Tech Full timeAbout Velocity Tech: We are a leading global renewable technology business dedicated to harnessing the power of wind energy. Our innovative approach has enabled us to establish a strong presence in the industry, and we continue to push boundaries through cutting-edge research and development.Job Description:As a Senior Data Engineer at Velocity Tech, you...
-
Cloud Data Architect
1 week ago
Nottingham, Nottingham, United Kingdom Rullion Limited Full timeJob DescriptionWe are seeking a Cloud Data Architect to lead our data engineering projects at Rullion Limited. This is a full-time, hybrid role, with one day a week based in our Nottingham office. The initial contract duration is 3 months, with potential for extension.The successful candidate will ensure data quality and reliability processes are effective,...
-
Cloud Data Engineer
2 weeks ago
Nottingham, Nottingham, United Kingdom Nimbus Full timeAbout Nimbus: Nimbus is a Halma company, a group of life-saving technologies, building a safer, cleaner, and healthier future.Salary: Highly Competitive + Exciting Benefits Package (£80,000 - £120,000 per year)Job Title: Senior Data EngineerJob Description: We're seeking a talented Senior Data Engineer to join our team and play a key role in shaping the...