Senior Data Engineer

1 week ago

BerwickuponTweed, United Kingdom Tech 4 Full time

Senior Data Engineer - Python / Data Pipelines / Data Platform / AWS - is required by fast growing, highly successful and tech focused organisation.
About the job You will play a crucial role in designing, building, and maintaining their data platform, with a strong emphasis on streaming data, cloud infrastructure, and machine learning operations.
Key Responsibilities: Architect and Implement Data Pipelines: Design, develop, and maintain scalable and efficient data pipelines Optimize ETL processes to ensure seamless data ingestion, processing, and integration across various systems Streaming Data Platform Development: Lead the development and maintenance of a real-time data streaming platform using tools like Apache Kafka, Databricks, Kinesis.
Ensure the integration of streaming data with batch processing systems for comprehensive data management Cloud Infrastructure Management: Utilize AWS data engineering services (including S3, Redshift, Glue, Kinesis, Lambda, etc.)
to build and manage our data infrastructure Continuously optimize the platform for performance, scalability, and cost-effectiveness Communications: Collaborate with cross-functional teams, including data scientists and BI developers, to understand data needs and deliver solutions Leverage the project management team to coordinate project, requirements, timelines and deliverables, allowing you to concentrate on technical excellence ML Ops and Advanced Data Engineering: Establish ML Ops practices within the data engineering framework, focusing on automation, monitoring, and optimization of machine learning pipelines Data Quality and Governance: Implement and maintain data quality frameworks, ensuring the accuracy, consistency, and reliability of data across the platform Drive data governance initiatives, including data cataloguing, lineage tracking, and adherence to security and compliance standards Requirements Experience: 3+ years of experience in data engineering, with a proven track record in building and maintaining data platforms, preferably on AWS Strong proficiency in Python, experience in SQL and PostgreSQL.
PySpark, Scala or Java is a plus Familiarity with Databricks and the Delta Lakehouse concept Experience mentoring or leading junior engineers is highly desirable Skills: Deep understanding of cloud-based data architectures and best practices Proficiency in designing, implementing, and optimizing ETL/ELT workflows Strong database and data lake management skills Familiarity with ML Ops practices and tools, with a desire to expand skills in this area Excellent problem-solving abilities and a collaborative mindset Nice to Have: Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes) Knowledge of machine learning pipelines and their integration with data platforms Great training and career development opportunities exist for the right candidate.
Basic salary £60-65,000 + excellent benefits Office based in Northumberland.
Fully remote working available TPBN1_UKTJ

  • Data Engineering Specialist

    1 day ago

    Stratford-upon-Avon, Warwickshire, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Data Engineer OpportunityWe are seeking a highly skilled Senior Data Engineer to join our innovative team at Harnham.**Company Overview:** A well-established brand in the property industry is driven by an ambitious vision, investing in their data team and looking to expand its services.**Job Description:** As a Senior Data Engineer, you will oversee...

  • Cloud Data Engineer

    2 days ago

    Stratford-upon-Avon, Warwickshire, United Kingdom Harnham - Data & Analytics Recruitment Full time

    About the RoleHarnham is seeking a proactive Senior Data Engineer to join their innovative team. The successful candidate will be responsible for overseeing end-to-end processes and ensuring scalability of pipelines.As a key member of the data team, you will work closely with stakeholders across the business to implement best practices in data governance and...

  • Senior Data Infrastructure Specialist

    2 days ago

    Stratford-upon-Avon, Warwickshire, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Data Engineer Job DescriptionA leading digital platform in the property industry requires a highly skilled Senior Data Engineer to enhance its services. The ideal candidate will have prior experience working with Pyspark and understanding of IaC/Terraform.Responsibilities include:Working closely with stakeholders to ensure seamless collaborationImplementing...

  • Cloud Native Data Architect

    1 day ago

    Stratford-upon-Avon, Warwickshire, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Senior Data Engineer PositionWe are looking for a Senior Data Engineer to join our team at Harnham.**Company Background:** A well-established brand in the property industry is seeking a proactive Senior Data Engineer to join their innovative team.**Job Responsibilities:** As a Senior Data Engineer, you will oversee end-to-end processes, ensuring scalability...

  • Senior Engineer, Data Engineering

    4 months ago

    Newcastle upon Tyne, United Kingdom Oliver Bernard Full time €85,000 - €110,000

    Senior Data Engineer - Python, SQL A key client of OB, who are a pioneering venture, providing the financial and investment markets with technology consulting services are looking to hire a Senior Data Engineer to their best in class engineering team. This is an incredibly exciting time to join a venture backed by two industry leaders in their...

  • Senior Engineer, Data Engineering

    4 months ago

    Newcastle upon Tyne, United Kingdom Oliver Bernard Full time €85,000 - €110,000

    Senior Data Engineer - Python, SQL A key client of OB, who are a pioneering venture, providing the financial and investment markets with technology consulting services are looking to hire a Senior Data Engineer to their best in class engineering team. This is an incredibly exciting time to join a venture backed by two industry leaders in their...

  • Senior Engineer, Data Engineering

    3 weeks ago

    Newcastle upon Tyne, United Kingdom Oliver Bernard Full time

    Senior Data Engineer - Python, SQL A key client of OB, who are a pioneering venture, providing the financial and investment markets with technology consulting services are looking to hire a Senior Data Engineer to their best in class engineering team. This is an incredibly exciting time to join a venture backed by two industry leaders in their respective...

  • Senior Engineer, Data Engineering

    1 month ago

    Newcastle upon Tyne, United Kingdom Oliver Bernard Full time

    Senior Data Engineer - Python, SQL A key client of OB, who are a pioneering venture, providing the financial and investment markets with technology consulting services are looking to hire a Senior Data Engineer to their best in class engineering team. This is an incredibly exciting time to join a venture backed by two industry leaders in their respective...

  • Senior Data Engineer

    4 months ago

    Newcastle upon Tyne, United Kingdom Oliver Bernard Full time €85,000 - €110,000

    Senior Data Engineer - Python, SQL A key client of OB, who are a pioneering venture, providing the financial and investment markets with technology consulting services are looking to hire a Senior Data Engineer to their best in class engineering team. This is an incredibly exciting time to join a venture backed by two industry leaders in their respective...

  • Senior Data Engineer

    3 weeks ago

    Newcastle upon Tyne, United Kingdom Oliver Bernard Full time

    Senior Data Engineer - Python, SQL A key client of OB, who are a pioneering venture, providing the financial and investment markets with technology consulting services are looking to hire a Senior Data Engineer to their best in class engineering team. This is an incredibly exciting time to join a venture backed by two industry leaders in their...

  • Senior Data Engineer

    1 month ago

    Newcastle upon Tyne, United Kingdom Oliver Bernard Full time

    Senior Data Engineer - Python, SQL A key client of OB, who are a pioneering venture, providing the financial and investment markets with technology consulting services are looking to hire a Senior Data Engineer to their best in class engineering team. This is an incredibly exciting time to join a venture backed by two industry leaders in their...

  • Senior Data Engineer

    4 months ago

    Newcastle upon Tyne, United Kingdom Oliver Bernard Full time €85,000 - €110,000

    Senior Data Engineer - Python, SQL A key client of OB, who are a pioneering venture, providing the financial and investment markets with technology consulting services are looking to hire a Senior Data Engineer to their best in class engineering team. This is an incredibly exciting time to join a venture backed by two industry leaders in their respective...

  • Senior Data Engineer

    4 months ago

    Newcastle Upon Tyne, United Kingdom Oliver Bernard Full time

    Senior Data Engineer - Python, SQLA key client of OB, who are a pioneering venture, providing the financial and investment markets with technology consulting services are looking to hire a Senior Data Engineer to their best in class engineering team.This is an incredibly exciting time to join a venture backed by two industry leaders in their respective...

  • Senior Data Engineer

    1 month ago

    Newcastle upon Tyne, United Kingdom Oliver Bernard Full time

    Senior Data Engineer - Python, SQLA key client of OB, who are a pioneering venture, providing the financial and investment markets with technology consulting services are looking to hire a Senior Data Engineer to their best in class engineering team.This is an incredibly exciting time to join a venture backed by two industry leaders in their respective...

  • Senior Data Engineer

    1 month ago

    Newcastle Upon Tyne, United Kingdom Oliver Bernard Full time

    Senior Data Engineer - Python, SQLA key client of OB, who are a pioneering venture, providing the financial and investment markets with technology consulting services are looking to hire a Senior Data Engineer to their best in class engineering team.This is an incredibly exciting time to join a venture backed by two industry leaders in their respective...

  • Senior Data Engineer

    2 months ago

    Newcastle Upon Tyne, United Kingdom Oliver Bernard Full time

    Senior Data Engineer - Python, SQLA key client of OB, who are a pioneering venture, providing the financial and investment markets with technology consulting services are looking to hire a Senior Data Engineer to their best in class engineering team.This is an incredibly exciting time to join a venture backed by two industry leaders in their respective...

  • Senior Data Engineer

    4 months ago

    Newcastle Upon Tyne, United Kingdom Oliver Bernard Full time

    Senior Data Engineer - Python, SQLA key client of OB, who are a pioneering venture, providing the financial and investment markets with technology consulting services are looking to hire a Senior Data Engineer to their best in class engineering team.This is an incredibly exciting time to join a venture backed by two industry leaders in their respective...

  • Senior Data Engineer

    4 months ago

    Newcastle Upon Tyne, United Kingdom Oliver Bernard Full time

    Senior Data Engineer - Python, SQL A key client of OB, who are a pioneering venture, providing the financial and investment markets with technology consulting services are looking to hire a Senior Data Engineer to their best in class engineering team. This is an incredibly exciting time to join a venture backed by two industry leaders in their respective...

  • Senior Data Engineer

    2 months ago

    Newcastle upon Tyne, United Kingdom Oliver Bernard Full time

    Senior Data Engineer - Up to £120,000 - Financial Services Salary: Paying Up to £120,000 Working Arrangements: Hybrid, Tyneside Area Willing to wait for people to relocate if needed Experience: Highly Proficient with SQL & Python Degree Required Financial Services experience is welcomed Overview: Two industry leaders have formed a joint venture...

  • Senior Engineer, Data Engineering

    4 months ago

    Newcastle upon Tyne, United Kingdom Oliver Bernard Full time €120,000

    Senior Data Engineer - Up to £120,000 - Financial Services Salary: Paying Up to £120,000 Working Arrangements: Hybrid, Tyneside Area Willing to wait for people to relocate if needed Experience: Highly Proficient with SQL & Python Degree Required Financial Services experience is welcomed Overview: Two industry leaders have formed a joint...