Senior Data Engineer

3 months ago


Cramlington, United Kingdom Printed.com Full time

You will play a crucial role in designing, building, and maintaining our data platform, with a strong emphasis on streaming data, cloud infrastructure, and machine learning operations.

Key Responsibilities:

  • Architect and Implement Data Pipelines:
    • Design, develop, and maintain scalable and efficient data pipelines.
    • Optimize ETL processes to ensure seamless data ingestion, processing, and integration across various systems.
  • Streaming Data Platform Development:
    • Lead the development and maintenance of a real-time data streaming platform using tools like Apache Kafka, Databricks, Kinesis.
    • Ensure the integration of streaming data with batch processing systems for comprehensive data management.
  • Cloud Infrastructure Management:
    • Utilize AWS data engineering services (including S3, Redshift, Glue, Kinesis, Lambda, etc.) to build and manage our data infrastructure.
    • Continuously optimize the platform for performance, scalability, and cost-effectiveness.
  • Communications:
    • Collaborate with cross-functional teams, including data scientists and BI developers, to understand data needs and deliver solutions.
    • Leverage the project management team to coordinate project, requirements, timelines and deliverables, allowing you to concentrate on technical excellence.
  • ML Ops and Advanced Data Engineering:
    • Establish ML Ops practices within the data engineering framework, focusing on automation, monitoring, and optimization of machine learning pipelines.
  • Data Quality and Governance:
    • Implement and maintain data quality frameworks, ensuring the accuracy, consistency, and reliability of data across the platform.
    • Drive data governance initiatives, including data cataloguing, lineage tracking, and adherence to security and compliance standards.

Requirements

Experience:

  • 3+ years of experience in data engineering, with a proven track record in building and maintaining data platforms, preferably on AWS.
  • Strong proficiency in Python, experience in SQL and PostgreSQL. PySpark, Scala or Java is a plus.
  • Familiarity with Databricks and the Delta Lakehouse concept.
  • Experience mentoring or leading junior engineers is highly desirable.

Skills:

  • Deep understanding of cloud-based data architectures and best practices.
  • Proficiency in designing, implementing, and optimizing ETL/ELT workflows.
  • Strong database and data lake management skills.
  • Familiarity with ML Ops practices and tools, with a desire to expand skills in this area.
  • Excellent problem-solving abilities and a collaborative mindset.

Nice to Have:

  • Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes).
  • Knowledge of machine learning pipelines and their integration with data platforms.

Benefits

  • 22 days holiday Plus 8 days bank holidays
  • Staff discounts & Friends and Family discounts
  • Cycle to work scheme and Tech Scheme
  • Breakfast and drinks provided
  • Charity day per annum supported
  • Summer and Christmas Parties
  • Street food days
  • Perkbox membership
  • Enhanced Maternity & Paternity leave
  • Employee referral scheme


  • Cramlington, Northumberland, United Kingdom Printed Full time

    We are seeking a skilled Senior Data Platform Engineer to join our team at Printed. This is a unique opportunity to work on designing, building, and maintaining our data platform, with a strong emphasis on streaming data, cloud infrastructure, and machine learning operations.Key ResponsibilitiesData Pipeline Architecture: Design, develop, and maintain...


  • Cramlington, Northumberland, United Kingdom Printed Full time

    About the JobWe're looking for a talented Cloud Native Data Solutions Expert to help us design, build, and maintain our cloud-based data platform at Printed. As an AWS Data Platform Engineer, you'll be responsible for architecting and implementing scalable and efficient data pipelines, designing real-time data streaming platforms, and collaborating with...


  • Cramlington, Northumberland, United Kingdom Printed Full time

    Job DescriptionWe are seeking a highly skilled Senior Data Engineer to join our team at Printed. As a key member of our data engineering team, you will play a critical role in designing, building, and maintaining our data platform.Key ResponsibilitiesData Pipeline Architecture and ImplementationDesign, develop, and maintain scalable and efficient data...


  • Cramlington, Northumberland, United Kingdom Printed Full time

    About the RoleWe are seeking an experienced AWS Data Platform Engineer to join our team at Printed. The successful candidate will play a crucial role in designing, building, and maintaining our cloud-based data platform with a strong emphasis on streaming data, cloud infrastructure, and machine learning operations.ResponsibilitiesArchitect and implement...

  • Data Scientist

    3 months ago


    Cramlington, United Kingdom Printed.com Full time

    Job Summary: We are seeking a Data Scientist with a strong technical background in machine learning and data analysis. In this role, you will be responsible for building and fine-tuning machine learning models that drive key business outcomes. These models will be integrated into various systems, including our website, reporting tools, and analytics...


  • Cramlington, Northumberland, United Kingdom Printed Full time

    Job Summary:We are seeking a highly skilled Data Scientist to join our team at Printed. In this role, you will be responsible for developing and deploying machine learning models that drive key business outcomes.Key Responsibilities:Model Development:Design, develop, and optimize machine learning models to solve complex business challenges such as customer...


  • Cramlington, Northumberland, United Kingdom Printed Full time

    About the CompanyWe're Printed, a dynamic company seeking a skilled AWS Data Platform Engineer to join our team. As a key member of our data engineering team, you'll play a vital role in designing, building, and maintaining our cloud-based data platform, with a focus on streaming data, cloud infrastructure, and machine learning...


  • Cramlington, United Kingdom Baker Hughes Full time

    Senior Physicist -Magnetics Would you like to shape our strategy for data? Are you passionate about leading a successful team?   Join our Team! Would you like to be part of a team delivering cutting edge physics concepts and algorithms for intelligent systems solutions to a global audience? Would you like to work with well-established...


  • Cramlington, Northumberland, United Kingdom Baltic Recruitment Services Ltd Full time

    We are currently looking for a Senior Electrical Engineer to join our team in Cramlington. As a key member of our maintenance team, you will be responsible for diagnosing and resolving electrical faults, ensuring minimal downtime and maintaining the highest standards of quality.Your primary focus will be on maintaining and repairing electrical systems,...

  • Senior Specialist

    6 months ago


    Cramlington, United Kingdom Organon Full time

    **The position** The Senior Specialist, Supplier Resiliency will report directly to the Director Third Party Risk & Compliance and will be responsible for leading the Third Party Resilience program for Organon. Responsibilities will include re-defining the model for Product Risk mapping, N-Tier suppliers mapping, suppliers risk identification and reporting...


  • Cramlington, United Kingdom CV-Library Full time

    Electrical Maintenance Engineer  £41,000 + training + career progression pathways  A leading FM provider, with a global presence, are currently looking for an Electrical Maintenance Engineer for one of their sites based in the Newcastle area.  This is a fantastic opportunity to join a talented engineering team on a well operated site...


  • Cramlington, United Kingdom Organon Full time

    **The Position** **Locations**: U.S. - East Coast or Central time zones Europe - UK, Ireland, Netherlands or Lisbon, Portugal only. We show up every day to take the promise of Organon and turn it into a reality, with a call to create what has been missing in women's healthcare. We're here hoping to make a difference in improving everyday health for women...


  • Cramlington, United Kingdom CV-Library Full time

    Electrical Maintenance Engineer - Shifts Cramlington £44,000 - £54,000 + Employee Benefits Are you looking for an Electrical Maintenance Engineer role for a global company with a modern shift pattern which allows for work-life balance? This is a great role working for a global specialist in plastics manufacturing, with a shift pattern that...


  • Cramlington, United Kingdom Baker Hughes Full time

    include: Flowing down product requirements and identifying system and subsystem requirements.  Designing, development and test activities Managing design review Supervising commercialization and operationalization including field support for product introduction Producing technical documentation & records Managing work package definition, planning and...


  • Cramlington, United Kingdom Organon Full time

    **The Position** The C&B Senior specialist will provide local HR with guidance and assistance regarding alignment with Organon’s global C&B standards and programs and will support local benchmarking, compensation trends and analytics, job evaluation, salary survey administration, and communication for total reward policies and programs. The Senior...


  • Cramlington, Northumberland, United Kingdom NHS Full time

    We are seeking an experienced and skilled Senior Research Midwife to join our team at Northumbria Healthcare NHS Foundation Trust.About the RoleThis is a unique opportunity for a dynamic individual with strong leadership skills to take on the challenge of managing clinical trials across our trust. As a Senior Research Midwife, you will be responsible for...


  • Cramlington, Northumberland, United Kingdom MTrec Commercial Full time

    About the RoleMTrec Commercial is seeking a highly skilled Management Accountant to join their team on a permanent basis. The successful candidate will have excellent technical accounting knowledge and practical experience of standard costing, as well as strong analytical skills.Job DescriptionThe Management Accountant will be responsible for managing the...


  • Cramlington, Northumberland, United Kingdom Enerpac Tool Group Full time

    About Enerpac Tool GroupWe're on a journey to build a culture that celebrates diversity and inclusivity. A culture where everyone feels accepted, valued, and equal.Our unique perspectives, experiences, and backgrounds hold the key to unlocking innovative solutions that drive our business forward.Job SummaryThis is an exciting opportunity to join our team as...


  • Cramlington, Northumberland, United Kingdom MTrec Technical Full time

    About the RoleWe are seeking an experienced Software Engineer with a strong background in Artificial Intelligence and Machine Learning to join our team. The successful candidate will design, develop, and deploy AI and ML models to solve complex problems and improve business outcomes.Key ResponsibilitiesDevelop and implement AI and ML algorithms to drive...


  • Cramlington, Northumberland, United Kingdom KinTec Recruitment Ltd Full time

    We are looking for a highly skilled Mechanical Renewable Engineer to join our team at KinTec Recruitment Ltd.The ideal candidate will have expertise in Gas Turbine Aux Equipment, including air intake, cab, and exhaust systems. They must be able to conduct site surveys and provide recommendations for improving aux equipment performance.The estimated salary...