Senior Data Engineer

2 weeks ago

Reading UK, Berkshire, United Kingdom DiverseJobsMatter Full time

DESCRIPTION -


Our Ecommerce CRM enablement team is seeking for its CDP program a proven and hands-on Databricks process architect and engineering leader to drive our Databricks transformation, pipelines architecture, governance and engineering patterns. Our CDP delivers a unified Customer data model across our global CRM operations. In this role, you will be responsible for driving our Databricks migration, designing and executing a comprehensive pipeline architecture strategy that aligns with CDP team's skillsets, business objectives and drives compliant, efficient and effective data management.


RESPONSIBILITIES


  • Drive our AWS Databricks transformation from current relational DB setup.
  • Collaborate with our diverse teams, SQL developers/data engineers/CRM analysts, to develop, implement and maintain sustainable, high-performance, growth-ready data-processing and data integration systems
  • Provide best practice on CI/CD techniques with Git and Databricks
  • Provide best practice on Databricks cluster management.
  • Reviews and evaluates designs and project activities for compliance with privacy, architecture, security and quality guidelines and standards; provides tangible feedback to improve product quality and mitigate failure risk.
  • Design and maintain an appropriate metadata repository to enable the organization to understand its data assets.
  • Builds and manages relationships throughout the organization.
  • Drives innovation and integration of new technologies into projects and activities in the big data space.
  • Collaborates and communicates with project team regarding project progress and issue resolution.
  • Provides guidance and mentoring to less experienced staff members.


REQUIREMENTS


  • Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or equivalent.
  • 10+ years of experience in data architecture, database design, and data management.
  • Expert in AWS Databricks
  • Expert in SQL & relational database systems (PostgreSQL preferred)
  • Proficient knowledge in working with distributed data processing frameworks like Apache Spark.
  • Hands-on experience in Python and Pandas
  • Experience in overall architecture of big data systems within AWS
  • Experience in Global Companies a great advantage.


KNOWLEDGE & SKILLS


  • Extensive experience with designing data engineering solutions to manage data streams in complex, distributed and parallel systems.
  • Excellent analytical and problem-solving skills. Ability to collaborate with and analyze source systems to drive data profiling/cataloging. Can present clear insights to colleagues to support the end use of the data.
  • Extensive experience with data engineering pipelines, frameworks to mine, cleanse and explore data.
  • Strong problem management. Initiating and monitoring actions to investigate patterns and trends to resolve problems. Determining preventative measures.
  • Evaluating forms and processes for database architecture testing and methodology, including writing and execution of test plans, debugging, and testing scripts and tools.
  • Excellent written and verbal communication skills; mastery in English and local language.


COMPLEXITY


  • Applies advanced subject matter knowledge to solve complex business issues and is regarded as a subject matter expert.
  • Frequently contributes to the development of new ideas and methods.
  • Works on complex problems where analysis of situations or data requires an indepth evaluation of multiple factors.
  • Acts as an expert providing direction and guidance to process improvements and establishing policies.
  • Exercises significant independent judgment within broadly defined policies and practices to determine best method for accomplishing work and achieving objectives.
  • Provide mentoring and guidance to lower level employees.

  • Senior Data Engineer

    4 weeks ago

    Reading, UK, Berkshire, United Kingdom Mirus Talent Full time

    We're representing a dynamic business dedicated to extending healthy lifespans and cutting unnecessary medical costs. They're seeking a Senior Data Engineer to propel their Data team forward.Key Responsibilities:Lead Cloud Data Warehouse Project: Oversee the next development phase, ensuring top-notch scalability, reliability, and performance.Data...

  • Data Centre Testing Engineer

    1 month ago

    Reading, UK, Berkshire, United Kingdom Ventula Consulting Full time

    Senior Data Centre Testing Engineer – £65-75k + Excellent Benefits - Reading (Hybrid)Our multinational Renewable Energy Client now requires an experienced Senior Data Centre Testing Engineer responsible for developing new tests and installations.The Data Centre Testing Engineer will be responsible for building effective networks within the Technology...

  • Data Centre Testing Engineer

    4 weeks ago

    Reading, UK, Berkshire, United Kingdom Ventula Consulting Full time

    Senior Data Centre Testing Engineer – £65-75k + Excellent Benefits - Reading (Hybrid)Our multinational Renewable Energy Client now requires an experienced Senior Data Centre Testing Engineer responsible for developing new tests and installations.The Data Centre Testing Engineer will be responsible for building effective networks within the Technology...

  • Senior Engineer

    2 weeks ago

    Reading, UK, Berkshire, United Kingdom Ventula Consulting Full time

    Senior Engineer – £65-75k + Excellent Benefits - Reading (Hybrid)Our multinational Renewable Energy Client now requires an experienced Senior Engineer responsible for developing and test innovative Immersion Cooling solutions for datacentres. The Senior Engineer will be responsible for building effective networks within the Technology Function to help...

  • Senior Engineer

    1 day ago

    Reading, UK, Berkshire, United Kingdom Ventula Consulting Full time

    Senior Engineer – £65-75k + Excellent Benefits - Reading (Hybrid)Our multinational Renewable Energy Client now requires an experienced Senior Engineer responsible for developing and test innovative Immersion Cooling solutions for datacentres.The Senior Engineer will be responsible for building effective networks within the Technology Function to help...

  • Data Engineer

    1 month ago

    Reading, UK, Berkshire, United Kingdom BJSS Full time

    About UsWe’re an award-winning innovative tech consultancy - a team of creative problem solvers. Since 1993 we’ve been finding better, more sustainable ways to solve complex technology problems for some of the world’s leading organisations and delivered solutions that millions of people use every day.In the last 30 years we won several awards,...

  • Data Engineer

    4 weeks ago

    Reading, UK, Berkshire, United Kingdom BJSS Full time

    About UsWe’re an award-winning innovative tech consultancy - a team of creative problem solvers. Since 1993 we’ve been finding better, more sustainable ways to solve complex technology problems for some of the world’s leading organisations and delivered solutions that millions of people use every day.In the last 30 years we won several awards,...

  • Data Engineer

    1 day ago

    Reading, UK, Berkshire, United Kingdom Damia Group Full time

    Data Engineer - Contract - Hybrid - INSIDE IR35We are looking for an SC Cleared Data Engineer to work on a major Oracle to PostgreSQL project working within an AWS cloud environment.Key requirementsDevelopment:Competence in and understanding of coding best practices, clean code, code review and similarDesign, build and assure quality of applicationsSoftware...

  • Lead Marketing Data Scientist

    2 weeks ago

    Reading, UK, Berkshire, United Kingdom DiverseJobsMatter Full time

    JOB DESCRIPTIONWorking within the Advanced Analytics group at our company, you will provide technical expertise and leadership in the development of models and algorithms to provide strategic marketing recommendations. We are looking for a technical leader with mastery of the data science domain for Marketing Science, including strong skills with R and...

  • Senior Mechanical Engineer

    2 weeks ago

    Reading, UK, Berkshire, United Kingdom IC Resources Full time

    An exhilarating opportunity has become available for Senior Mechanical Engineer to join a rapidly growing company to be launching ground-breaking technology into space.As a Senior Mechanical Engineer, you will have a number of core responsibilities that include:Designing and development of next-generation propulsion systemsMechanical simulationMechanical...

  • Senior Data Architect

    1 month ago

    Slough, UK, Berkshire, United Kingdom Mars Full time

    Senior Data ArchitectAbout MarsMars is a family-owned business with more than $35 billion in global sales. We produce some of the world’s best-loved brands: M&M’s®, SNICKERS®, TWIX®, MILKY WAY®, DOVE®, PEDIGREE®, ROYAL CANIN®, WHISKAS®, EXTRA®, ORBIT®, 5™, SKITTLES®, BEN’S ORIGINAL®, and COCOAVIA®. Alongside our consumer brands, we...

  • Senior Data Architect

    4 weeks ago

    Slough, UK, Berkshire, United Kingdom Mars Full time

    Senior Data ArchitectAbout MarsMars is a family-owned business with more than $35 billion in global sales. We produce some of the world’s best-loved brands: M&M’s®, SNICKERS®, TWIX®, MILKY WAY®, DOVE®, PEDIGREE®, ROYAL CANIN®, WHISKAS®, EXTRA®, ORBIT®, 5™, SKITTLES®, BEN’S ORIGINAL®, and COCOAVIA®. Alongside our consumer brands, we...

  • Senior Mechanical Engineer

    1 month ago

    Reading, UK, Berkshire, United Kingdom NewOrbit Space Full time

    Senior Mechanical EngineerRole SummaryThis is an exhilarating opportunity to join a rapidly growing space company and contribute to pioneering, cutting-edge propulsion technology unmatched anywhere in the world. As a vital member of our team, you will play a crucial role in launching the world's first air-breathing ion propulsion system into orbit. Your...

  • Senior Mechanical Engineer

    4 weeks ago

    Reading, UK, Berkshire, United Kingdom NewOrbit Space Full time

    Senior Mechanical EngineerRole SummaryThis is an exhilarating opportunity to join a rapidly growing space company and contribute to pioneering, cutting-edge propulsion technology unmatched anywhere in the world. As a vital member of our team, you will play a crucial role in launching the world's first air-breathing ion propulsion system into orbit. Your...

  • People / HR Generalist - HR Systems & Data

    1 month ago

    Reading, UK, Berkshire, United Kingdom Project People Full time

    People / HR Generalist - HR Systems & Data - 18 month FTC Greater Reading Area - Hybrid with 3 days/week in officeRole:Responsible for proactively managing the people systems in order to maintain integrity and confidentiality of employee and organisational data.Key interface to ensure consistent system provision and that any system improvements are managed...

  • Senior Legal Counsel

    1 month ago

    Reading, UK, Berkshire, United Kingdom Project People Full time

    Senior Legal Counsel: Marketing Media & Intellectual PropertyReading, United Kingdom6 month FTC or Day RateWe are looking to recruit an experienced and Qualified Senior Legal Counsel for a leading telecom company to join the Marketing, Media and Brand legal team on a 6 months contract.Areas will include:Trading – Advising on retail, online and distance...

  • Senior Legal Counsel

    4 weeks ago

    Reading, UK, Berkshire, United Kingdom Project People Full time

    Senior Legal Counsel: Marketing Media & Intellectual PropertyReading, United Kingdom6 month FTC or Day RateWe are looking to recruit an experienced and Qualified Senior Legal Counsel for a leading telecom company to join the Marketing, Media and Brand legal team on a 6 months contract.Areas will include:Trading – Advising on retail, online and distance...

  • Senior Legal Counsel

    1 month ago

    Reading, UK, Berkshire, United Kingdom Three UK Full time

    6 month Contract - Senior Legal Counsel: Marketing Media & Intellectual PropertyReading, United KingdomWe are looking to recruit an Experienced and Qualified Senior Legal Counsel to join the Marketing, Media and Brand legal team on a 6 month FTC. Areas will include:Trading – Advising on retail, online and distance sales, promotions, competitions, special...

  • Senior Legal Counsel

    4 weeks ago

    Reading, UK, Berkshire, United Kingdom Three UK Full time

    6 month Contract - Senior Legal Counsel: Marketing Media & Intellectual PropertyReading, United KingdomWe are looking to recruit an Experienced and Qualified Senior Legal Counsel to join the Marketing, Media and Brand legal team on a 6 month FTC. Areas will include:Trading – Advising on retail, online and distance sales, promotions, competitions, special...

  • Senior Procurement Coordinator

    4 weeks ago

    Reading, UK, Berkshire, United Kingdom Navartis Full time

    This is a great opportunity for an experienced Senior Procurement Coordinator to join a Tier One Fibre Telecommunications company on a 12-month Fixed Term Contract to provide subject matter expert support for business purchasing activities managed within the Finance and Procurement functions.Your role as Senior Procurement Coordinator will give you the...