Principal Data Engineer

4 days ago


UK, UK, United Kingdom DiverseJobsMatter Full time

Job Description


About The Role


We are recruiting for a Principal Data Engineer to join our team. Principal Data Engineers work in multi-disciplinary teams that build, support & maintain User-Centred digital solutions that offer real value and work for everyone.


Our Principal Data Engineers are experts in their field. You will act as a principal consultant providing technical expertise in data engineering practices both internally and to our clients. You will drive the team's technical deliverables, maintain client relationships and be passionate about developing and upskilling others.


Your role in nutshell:


  • Act as a technical SME within our engineering community to produce and ensure user-centred software is developed based on business requirements and following best practice
  • Work collaboratively with colleagues to explore, design and deliver solutions to client problems
  • Maintain client relationships and troubleshoot issues through collaboration
  • Design and manage software development and deployment pipelines resolving issues and potential bottlenecks before they occur
  • Continuously reviews and prioritises the delivery teams workload and can anticipate the need for realignment with evolving operational prioritise and complex work-streams and assignments
  • Be a strong communicator and presenter, presenting prototypes, solutions and progress to internal/external stakeholders in a clear concise manner
  • Build great relationships with your team and stakeholders, identifying and ensuring that challenges are overcome
  • Lead in the recruitment of other engineers, and support other consultants in their professional development
  • Ensure our Data and Engineering communities contribute to our business at a strategic level
  • Lead on new business opportunities, writing technical bids and proposals
  • Promote our Data team externally (for example through writing Blogs, Workshops, Seminars or Conferences)


About the Candidate:


  • Excellent experience delivering in Python and experience with at least one other core language
  • Excellent experience of SQL and relational databases. NoSQL databases is also desirable.
  • Solid experience of at least one Cloud provider such as AWS, Azure or GCP.
  • Experience of working in a Consultancy environment as well as working with/in the Public Sector.
  • Strong experience of working with different data formats, e.g., CSV, JSON and XML
  • Building reliable Data Pipelines
  • Broader knowledge of IT — e.g., Security and Networking
  • Working in an Agile Environment
  • Test-Driven Development and/or Behaviour Driven Development
  • Continuous Integration and Continuous Deployment (CI/CD)
  • Experience of operating as a technical leader on complex projects and able to manage stakeholder expectations and influencing decisions
  • Coaching and guiding others on the best way to achieve an optimal solution
  • Excellent verbal/written communication skills, able to articulate in both technical/non-technical terms depending on audience
  • Technical leadership and/or mentoring
  • Define working procedures and methodologies for the team


  • UK, UK, United Kingdom G.Digital Full time

    Principal Data Engineer | Azure MVP SQL Python Databricks | Up to £95k + Bonus & Shares | Remote with occasional onsite travel to UK based clientsG.Digital are now working with a growing Data consultancy who provide end to end deliverables for end clients in the retail, fintech and construction industries A little bit about them ♀️ G.Digital stamp of...


  • UK, UK, United Kingdom Primus Connect Full time

    Databricks, Apache Spark, SQL, Python, Azure Data PlatformA fast growing and start up Data Consultancy have engaged Primus Connect to source an excellent Principal Data Engineering Consultant on an exclusive basis.These guys have grown rapidly since their formation and have strong pipeline and relationships with Databricks and Microsoft that is allowing them...


  • UK, UK, United Kingdom Oliver Bernard Full time

    Lead/Principal Software Engineer - Java/Kotlin, TDD, ETL, Data Warehousing A long term client of OB's who are a cutting edge consultancy who specialise in delivering innovative solutions to large enterprises have a brand new project starting with a client in the investment banking industry and a large number of engineers are needed to complete this...

  • Senior Data Engineer

    3 months ago


    UK, UK, United Kingdom ON Data Staffing Full time

    Our client, a Data & AI firm in London is actively seeking a Senior Data Engineer to play a pivotal role in delivering innovative big data solutions to their end clients.This client-facing role requires a unique blend of technical prowess in Databricks/Snowflake and exceptional communication skills to understand and address clients' diverse data...

  • Principal QA Engineer

    2 weeks ago


    UK, UK, United Kingdom Client Server Full time

    Principal QA Test Engineer Nottingham / WFH to £80kAre you a senior QA Test Engineer with experience of testing modern cloud based software at scale?You could be progressing your career in an impactful role at a tech company that provides a range of software solutions to energy suppliers from small start-ups through to major household names, covering...


  • UK, UK, United Kingdom Primaire Consulting Ltd Full time

    Our client is a leader in Industrial Automation and Process Control technology. With a focus on temperature control and data acquisition our client offers innovative solutions to the Industrial, Pharmaceutical, Biotechnology and Healthcare organisations globally.A bit about the roleMy client is looking for a highly motivated & qualified Electronics...


  • UK, UK, United Kingdom ON Data Staffing Full time

    Our client is a renowned Data & AI Consultancy, providing advanced data transformation, cloud solutions, and AI-driven decision-making strategies to businesses across various industries. They specialize in delivering modern data platforms and engineering solutions, leveraging technologies like Snowflake, Databricks, and the latest cloud data...


  • UK, UK, United Kingdom Fourblue Full time

    Principal Electrical Design Engineer Lincolnshire – Home working Open Salary + car/car allowance Fourblue has teamed up with an accredited ICP (independent connection provider) who are experts in managing and delivering connections ranging from LV (low voltage) up to 132kV. Working to connect clients to the grid and covering all aspects of design, building...


  • UK, UK, United Kingdom Peregrine Full time

    What you’ll be doing: Providing expert Mechanical Engineering support for the design and development of new innovative designs encompassing fault finding, diagnostics and salvage of existing products. As a Principal Mechanical Engineer, you will have the ability to lead and provide technical direction to other Engineers/Technicians to develop innovative...

  • Lead Data Engineer

    4 weeks ago


    UK, UK, United Kingdom ON Data Staffing Full time

    Our client, a Data & AI firm in London is actively seeking a Lead Data Engineer to play a pivotal role in delivering innovative big data solutions to their end clients.This client-facing role requires a unique blend of technical prowess in Databricks/Snowflake and exceptional communication skills to understand and address clients' diverse data...


  • UK, UK, United Kingdom Matchtech Full time

    ⚡Principal Geotechnical Engineer - Offshore Wind Renewables⚡Key Information:Location - LondonOverview:We are a global leader in advanced technological and engineering solutions for the design, construction, and operation of safe and sustainable complex infrastructure and plants. With a commitment to excellence and innovation, we are at the forefront of...


  • UK, UK, United Kingdom Insight Global Full time

    Insight Global are looking for a Principal Electrical Engineer, you will support and deliver designs for various Data Centres, Mission Critical and healthcare project types and sizes. You will work within a multidisciplinary team of engineers and support staff delivering a consistent high-quality service for clients, ensuring that repeat and new business...


  • UK, UK, United Kingdom Rebel Recruiters Full time

    Role: Principal Software Engineer (C#, .NET 8, Angular)Location: Derbyshire office. Hybrid- twice per week in the office (ideally Mondays and Wednesdays)Salary: up to £80k plus benefits.You know your way around C#, .NET and the Microsoft ecosystem like the back of your hand. You know Angular like the back of your other hand.You have had a lot of commercial...


  • UK, UK, United Kingdom Client Server Full time

    Principal QA Test Automation Engineer (C# AWS) Nottingham / WFH to £80kAre you a senior QA Test Engineer with experience of testing modern cloud based software at scale?You could be progressing your career in an impactful role at a tech company that provides a range of software solutions to energy suppliers from small start-ups through to major household...


  • UK, UK, United Kingdom NDC Tek Full time

    Principal Research Engineer (LLM's) We are currently working with the #1 AI platform For creators! A cutting-edge AI platform that allows influencers, celebrities, and content creators to make AI twins of themselves that their fans can interact with 24/7 in any language.They are looking for a Principal Research Engineer with Open source LLM experience to...


  • UK, UK, United Kingdom TechShack Full time

    Principal Frontend Engineer - £120K - £150K + BonusAre you interested in joining one of the most tech-driven e-commerce brands, where engineering plays a pivotal role in delivering the best customer experience?This company’s website handles over 7,000 requests per second, and your expertise in performance, accessibility, and scalability will be...


  • UK, UK, United Kingdom ECOM Full time

    Principal Frontend Engineer - Manchester - 80kAre you a Senior/Principal Frontend Engineer ready to lead and inspire? Here's a fantastic opportunity at an award-winning SaaS client located in central Manchester.I'm seeking a Principal Frontend Engineer to take the helm and make a lasting impact on a high performing team. The right candidate could...


  • UK, UK, United Kingdom Matchtech Full time

    ⚡Principal Structural Analysis Engineer⚡About Us: We are an advanced technological and engineering platform dedicated to the design, construction, and operation of safe and sustainable complex infrastructure and plants.Position Available:Principal Structural Analysis EngineerLocation: London, United KingdomResponsibilities:As a Principal Structural...


  • UK, UK, United Kingdom Matchtech Full time

    ⚡Principal Geophysical Engineer⚡LondonAre you a seasoned geophysical engineer passionate about offshore wind? We're looking for a Principal Geophysical Engineer to lead our geophysical operations in this dynamic sector. Join us and help shape the future of offshore wind energy.Key Responsibilities:Leadership & Management:Lead and mentor a team of...


  • UK, UK, United Kingdom Oliver Bernard Full time

    Principal Java Engineers - 3 days a week in London - £135k We are looking for 10 x Principal Java Engineers to work for a financial client of oursStack - Java, TDD, CI/CD, Kubernetes/Docker.Candidates must ideally have lead experience, whilst remaining hands on coding wise. Candidates who have worked in Investment Banking would be highly desirable, but no...