Data Engineer
5 months ago
It is initially a 3-month contract with potential to be extended. The role is Hybrid, with one day a week being based in their Nottingham office, this is negotiable. It is a full-time role, 37 hours per week.
Accountabilities:
Develop and maintain scalable, efficient data pipelines within Databricks, continuously evolving them as requirements and technologies change.
Build and manage an enterprise data model within Databricks.
Integrate new data sources into the platform using batch and streaming processes, adhering to SLAs.
Create and maintain documentation for data pipelines and associated systems, following security and monitoring protocols.
Ensure data quality and reliability processes are effective, maintaining trust in the data.
Knowledge and Skills:
Extensive experience of Python preferred, including advanced concepts like decorators, protocols, functools, context managers, and comprehensions.
Strong understanding of SQL, database design, and data architecture.
Experience with Databricks and/or Spark.
Knowledgeable in data governance, data cataloging, data quality principles, and related tools.
Skilled in data extraction, joining, and aggregation tasks, especially with big data and real-time data using Spark.
Capable of performing data cleansing operations to prepare data for analysis, including transforming data into useful formats.
Understand data storage concepts and logical data structures, such as data warehousing.
Able to write repeatable, production-quality code for data pipelines, utilizing templating and parameterization where needed.
Can make data pipeline design recommendations based on business requirements.
Experience with data migration is a plus.
Open to new ways of working and new technologies.
Self-motivated with the ability to set goals and take initiative.
Driven to troubleshoot, deconstruct problems, and build effective solutions.
Please note:
Should your application be successful, and you are offered the role, a number of pre-employment checks need to be carried out before your appointment can be confirmed. Any assignment offer with our client will be subject to a satisfactory checking report from the Disclosure Barring Service.
This vacancy is being advertised by Rullion Ltd acting as an employment business.
Since 1978, Rullion has been securing exceptional candidates for a range of clients; from large well-known brands, to SMEs and start-ups. As a family-owned business, Rullion's approach is credible and honest, focused on building long-lasting relationships with both clients and candidates.
We celebrate and support diversity and are committed to ensuring equal opportunities for both employees and applicants.
Rullion celebrates and supports diversity and is committed to ensuring equal opportunities for both employees and applicants
-
Distinguished Data Engineer
3 weeks ago
Nottingham, Nottingham, United Kingdom Data Privacy Full timeAbout the RoleWe are seeking a highly experienced technical leader to join our Data team as a Distinguished Data Engineer. As a key member of our engineering organization, you will be responsible for driving innovation and engineering excellence through data solutions across the Data team and wider Engineering organization.Key ResponsibilitiesDevelop and...
-
Distinguished Data Engineer
3 weeks ago
Nottingham, Nottingham, United Kingdom Data Privacy Full timeAbout the RoleWe are seeking a highly experienced technical leader to join our Data team as a Distinguished Data Engineer. As a key member of our engineering organization, you will be responsible for driving innovation and engineering excellence through data solutions across the Data team and wider Engineering organization.Key ResponsibilitiesDevelop and...
-
Distinguished Data Engineer
4 weeks ago
Nottingham, Nottingham, United Kingdom Data Privacy Full timeAbout the RoleWe are seeking a highly experienced technical leader to join our Data team as a Distinguished Data Engineer. As a key member of our engineering organization, you will be responsible for driving innovation and engineering excellence through data solutions across the Data team and wider Engineering organization.Key Responsibilities Serve as an...
-
Distinguished Data Engineer
4 weeks ago
Nottingham, Nottingham, United Kingdom Data Privacy Full timeAbout the RoleWe are seeking a highly experienced technical leader to join our Data team as a Distinguished Data Engineer. As a key member of our engineering organization, you will be responsible for driving innovation and engineering excellence through data solutions across the Data team and wider Engineering organization.Key Responsibilities Serve as an...
-
Distinguished Data Engineer
2 weeks ago
Nottingham, Nottingham, United Kingdom Data Privacy Full timeAbout the RoleWe are seeking a highly experienced technical leader to join our Data team as a Distinguished Data Engineer. As a key member of our engineering organization, you will be responsible for driving innovation and engineering excellence through data solutions across the Data team and wider Engineering organization.Key ResponsibilitiesDevelop and...
-
Distinguished Data Engineer
3 weeks ago
Nottingham, Nottingham, United Kingdom Data Privacy Full timeAbout the RoleWe are seeking a highly experienced technical leader to join our Data team as a Distinguished Data Engineer. As a key member of our engineering organization, you will be responsible for driving innovation and engineering excellence through data solutions across the Data team and wider Engineering organization.Key ResponsibilitiesDevelop and...
-
Distinguished Data Engineer
3 weeks ago
Nottingham, Nottingham, United Kingdom Data Privacy Full timeAbout the RoleWe are seeking a highly experienced technical leader to join our Data team as a Distinguished Data Engineer. As a key member of our engineering organization, you will be responsible for driving innovation and engineering excellence through data solutions across the Data team and wider Engineering organization.Key ResponsibilitiesDevelop and...
-
Big Data Engineering Manager
1 month ago
Nottingham, Nottingham, United Kingdom ON Data Staffing Full timeJob Title:Data Engineering ManagerWe are seeking a seasoned Data Engineering professional to drive the success of our client's Data Engineering practice. As Data Engineering Manager, you will leverage your expertise in presales, technical acumen, consulting skills, and team management to deliver exceptional results.Key Responsibilities:Presales Expertise:...
-
Big Data Engineering Manager
1 month ago
Nottingham, Nottingham, United Kingdom ON Data Staffing Full timeJob Title:Data Engineering ManagerWe are seeking a seasoned Data Engineering professional to drive the success of our client's Data Engineering practice. As Data Engineering Manager, you will leverage your expertise in presales, technical acumen, consulting skills, and team management to deliver exceptional results.Key Responsibilities:Presales Expertise:...
-
Big Data Engineering Manager
3 weeks ago
Nottingham, Nottingham, United Kingdom ON Data Staffing Full timeJob Title: Data Engineering ManagerWe are seeking a seasoned Data Engineering professional to drive the success of our client's Data Engineering practice. As Data Engineering Manager, you will leverage your expertise in presales, technical acumen, consulting skills, and team management to deliver exceptional results.Key Responsibilities:Presales Expertise:...
-
Big Data Engineering Manager
3 weeks ago
Nottingham, Nottingham, United Kingdom ON Data Staffing Full timeJob Title: Data Engineering ManagerWe are seeking a seasoned Data Engineering professional to drive the success of our client's Data Engineering practice. As Data Engineering Manager, you will leverage your expertise in presales, technical acumen, consulting skills, and team management to deliver exceptional results.Key Responsibilities:Presales Expertise:...
-
Senior Data Architect
2 weeks ago
Nottingham, Nottingham, United Kingdom Data Privacy Full timeAbout the Role:We are seeking a highly experienced technical leader to join our Data team as a Distinguished Data Engineer. As a key member of our engineering organization, you will be responsible for driving innovation and engineering excellence through data solutions across the Data team and wider Engineering organization.Key Responsibilities:Develop and...
-
Data Engineer
1 month ago
Nottingham, Nottingham, United Kingdom BJSS Full timeAbout UsWe're a leading tech consultancy that's been pushing the boundaries of innovation since 1993. Our team of creative problem solvers has delivered solutions that millions of people use every day, and we're proud of our award-winning track record.About the RoleWe're seeking a talented Data Engineer to join our team and help us build scalable and...
-
Data Engineer
1 month ago
Nottingham, Nottingham, United Kingdom BJSS Full timeAbout UsWe're a leading tech consultancy that's been pushing the boundaries of innovation since 1993. Our team of creative problem solvers has delivered solutions that millions of people use every day, and we're proud of our award-winning track record.About the RoleWe're seeking a talented Data Engineer to join our team and help us build scalable and...
-
Data Engineer
4 weeks ago
Nottingham, Nottingham, United Kingdom Yü Group Full timeAbout the RoleWe are seeking a highly skilled Data Engineer to join our team at Yü Group. As a Data Engineer, you will play a pivotal role in shaping and delivering our data strategy to drive business insights, enhance operational efficiency, and support strategic decision-making.Key ResponsibilitiesDesign, build, test, and maintain data pipelines to ensure...
-
Data Engineer
4 weeks ago
Nottingham, Nottingham, United Kingdom Yü Group Full timeAbout the RoleWe are seeking a highly skilled Data Engineer to join our team at Yü Group. As a Data Engineer, you will play a pivotal role in shaping and delivering our data strategy to drive business insights, enhance operational efficiency, and support strategic decision-making.Key ResponsibilitiesDesign, build, test, and maintain data pipelines to ensure...
-
Data Engineer
4 weeks ago
Nottingham, Nottingham, United Kingdom Yü Group Full timeAbout the RoleWe are seeking a highly skilled Data Engineer to join our team at Yü Group. As a Data Engineer, you will play a pivotal role in shaping and delivering our data strategy to drive business insights, enhance operational efficiency, and support strategic decision-making.Key ResponsibilitiesDesign, build, test, and maintain data pipelines to ensure...
-
Data Engineer
4 weeks ago
Nottingham, Nottingham, United Kingdom Yü Group Full timeAbout the RoleWe are seeking a highly skilled Data Engineer to join our team at Yü Group. As a Data Engineer, you will play a pivotal role in shaping and delivering our data strategy to drive business insights, enhance operational efficiency, and support strategic decision-making.Key ResponsibilitiesDesign, build, test, and maintain data pipelines to ensure...
-
Data Engineer
4 months ago
Nottingham, United Kingdom Yü Group Full timeDescriptionReports to: Senior Data EngineerLocation: Nottingham NG8 6PYWorking hours: Monday to Friday - 37.5 Hrs Yü Group Plc is a leading energy supplier in the United Kingdom, committed to providing reliable and sustainable energy solutions to our customers. As we continue to grow and innovate in the dynamic energy sector, we are seeking a highly...
-
Data Engineer
3 weeks ago
Nottingham, Nottingham, United Kingdom BJSS Full timeAbout the RoleAt BJSS, we're seeking a talented Data Engineer to join our team of specialist software engineers. As a Data Engineer, you'll play a crucial role in building, optimising, and maintaining data applications, systems, and services that deliver business value.Our Data Engineers work in a fast-paced, agile environment, collaborating with...
