Senior Data Engineer

1 week ago

Cardiff, Cardiff, United Kingdom Creditsafe Full time

About Creditsafe: As a leading provider of business intelligence and risk management solutions, Creditsafe is seeking a highly skilled Data Engineer to join our Data Cloud team. Our company is built on a foundation of innovation, scalability, and customer satisfaction, and we're committed to delivering high-quality data solutions to our clients.

About the Opportunity: This is an exciting opportunity to join a team of experienced engineers who are redesigning Creditsafe's data platform with a focus on high throughput and scalability. The data delivery platform is built on AWS Redshift and S3 cloud storage, and the team is working on building highly available and low-latency APIs to enable our clients with faster data delivery.

Key Responsibilities:

  • Contribute to the design and development of our data processing platform using technologies such as Python, Airflow, Redshift, DynamoDB, AWS Glue, and S3.
  • Design and build metadata-driven, event-based distributed data processing platforms.
  • Play a critical role in the design, development, and deployment of our business-critical system.
  • Build and scale Creditsafe's data pipeline primarily moving data between Redshift and S3.
  • Execute practices such as continuous integration and deployment using test-driven development where applicable.

Requirements:

  • Proven experience in development within a commercial environment creating production-grade data pipelines in Python.
  • Understanding of data engineering best practices and ability to implement them.
  • Excellent communication skills and ability to explain technical views clearly to the team.
  • Proven track record of technical expertise and ability to mentor engineers.

Why Creditsafe:

  • Career Progression: Clearly defined career progression path with opportunities to grow as a technical leader or move into adjacent roles.
  • Learning & Development: Access to a plethora of learning resources and courses to enhance your skills.
  • Work-Life Balance: Committed to promoting a balanced lifestyle with flexible working hours and hybrid work options.
  • Innovation: Engage in exciting projects, harnessing the power of the latest technologies in cloud computing and data management.

Our Technology Stack: Python, Linux, Airflow, AWS DynamoDB, S3, Glue, Athena, Redshift, Lambda, API Gateway, Terraform, CI/CD

Benefits:

  • Competitive Salary.
  • Company Laptop supplied.
  • 25 Days Annual Leave (plus bank holidays).
  • Hybrid working model.
  • Healthcare & Company Pension.
  • Cycle to work and Wellbeing Programme.
  • Global Company gatherings and events.
  • E-learning and excellent career progression opportunities.

  • Senior Data Engineer

    5 days ago

    Cardiff, Cardiff, United Kingdom BJSS Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at BJSS. As a Senior Data Engineer, you will play a key role in designing, building, and maintaining large-scale data systems and applications.Key ResponsibilitiesDesign and implement data pipelines and processes in a production-safe manner using the latest technologies.Work...

  • Senior Data Engineer

    5 days ago

    Cardiff, Cardiff, United Kingdom BJSS Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at BJSS. As a Senior Data Engineer, you will play a key role in designing, building, and maintaining large-scale data systems and applications.Key ResponsibilitiesDesign and implement data pipelines and processes in a production-safe manner using the latest technologies.Work...

  • Senior Data Engineer

    3 days ago

    Cardiff, Cardiff, United Kingdom Creditsafe Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our Data Engineering team in Cardiff. As a Senior Data Engineer, you will play a key role in designing and building data pipelines that enable faster, better, data-informed decision-making within the business and for our customers.Key ResponsibilitiesDesign and build metadata-driven...

  • Senior Data Engineer

    3 days ago

    Cardiff, Cardiff, United Kingdom Creditsafe Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our Data Engineering team in Cardiff. As a Senior Data Engineer, you will play a key role in designing and building data pipelines that enable faster, better, data-informed decision-making within the business and for our customers.Key ResponsibilitiesDesign and build metadata-driven...

  • Senior Data Engineer

    7 days ago

    Cardiff, Cardiff, United Kingdom Creditsafe Full time

    About CreditsafeCreditsafe is a leading provider of business intelligence and risk management solutions. With a vast database of over 320 million companies across 100 countries, we empower our clients to make informed decisions and drive business growth.About the OpportunityWe are seeking an experienced Senior Data Engineer to join our Data Cloud team. As a...

  • Senior Data Engineer

    5 days ago

    Cardiff, Cardiff, United Kingdom Creditsafe Full time

    About CreditsafeCreditsafe is a leading provider of business intelligence and risk management solutions. With a vast database of over 320 million companies across 100 countries, we empower our clients to make informed decisions and drive business growth.About the OpportunityWe are seeking an experienced Senior Data Engineer to join our Data Cloud team. As a...

  • Senior Data Engineer

    1 week ago

    Cardiff, Cardiff, United Kingdom Creditsafe Full time

    About CreditsafeCreditsafe is a leading provider of business intelligence and risk management solutions. With a vast database of over 320 million companies across 100 countries, we empower our clients to make informed decisions and drive business growth.About the OpportunityWe are seeking an experienced Senior Data Engineer to join our Data Cloud team. As a...

  • Senior Data Engineer

    2 days ago

    Cardiff, Cardiff, United Kingdom Creditsafe Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our Data Engineering team in Cardiff. As a key member of our team, you will be responsible for designing and building high-quality data processing systems that meet the needs of our business.Key ResponsibilitiesDesign and develop data pipelines using Python and SQL to extract and transform...

  • Senior Data Engineer

    2 days ago

    Cardiff, Cardiff, United Kingdom Creditsafe Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our Data Engineering team in Cardiff. As a key member of our team, you will be responsible for designing and building high-quality data processing systems that meet the needs of our business.Key ResponsibilitiesDesign and develop data pipelines using Python and SQL to extract and transform...

  • Senior Data Engineer

    1 week ago

    Cardiff, Cardiff, United Kingdom BJSS Full time

    About BJSSWe're a leading tech consultancy that's been innovating for over 25 years. Our team of creative problem solvers has delivered solutions that millions of people use every day.Our ApproachWe're DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions. Our clients don't engage us for straightforward...

  • Senior Data Engineer

    3 weeks ago

    Cardiff, Cardiff, United Kingdom Confused Full time

    About Us We are a dynamic group of online brands dedicated to empowering consumers by providing them with tools and information to make informed decisions about their financial products and services. The Role We are seeking a highly skilled and experienced Data Engineer to join our growing team. In this role, you will play a crucial part in designing,...

  • Data Engineer in City

    1 month ago

    Cardiff, Cardiff, United Kingdom yolk recruitment Full time

    Data Engineer - Up to 45,500 - Hybrid (Cardiff Based One Day A Month) The OpportunityYolk Recruitment Public Sector & Not-for-Profit team is working with an essential not-for-profit organisation to recruit a Data Engineer. This role is ideal if you have experience building a variety of ETL pipelines, especially in Azure. If you can code effectively in T-SQL...

  • Mechanical Engineer

    7 days ago

    Cardiff, Cardiff, United Kingdom Hydrock Full time

    About the RoleWe are seeking a highly skilled Senior Mechanical Engineer to join our team at Hydrock, a leading engineering consultancy. As a Senior Mechanical Engineer, you will play a critical part in the planning, design, and maintenance of world-class data centres.Key ResponsibilitiesDesign and Planning: Collaborate with senior engineers to contribute to...

  • Mechanical Engineer

    6 days ago

    Cardiff, Cardiff, United Kingdom Hydrock Full time

    About the RoleWe are seeking a highly skilled Senior Mechanical Engineer to join our team at Hydrock, a leading engineering consultancy. As a Senior Mechanical Engineer, you will play a critical part in the planning, design, and maintenance of world-class data centres.Key ResponsibilitiesDesign and Planning: Collaborate with senior engineers to contribute to...

  • Data Engineer

    20 hours ago

    Cardiff, Cardiff, United Kingdom Creditsafe Full time

    {"title": "Data Engineer Role at Creditsafe", "description": "About the RoleWe are seeking a skilled Data Engineer to join our team in Cardiff. As a Data Engineer, you will play a key role in designing and building data pipelines that enable faster, better decision-making within the business and for our customers.Key ResponsibilitiesDesign and develop...

  • Data Engineer

    17 hours ago

    Cardiff, Cardiff, United Kingdom Creditsafe Full time

    {"title": "Data Engineer Role at Creditsafe", "description": "About the RoleWe are seeking a skilled Data Engineer to join our team in Cardiff. As a Data Engineer, you will play a key role in designing and building data pipelines that enable faster, better decision-making within the business and for our customers.Key ResponsibilitiesDesign and develop...

  • Senior Data Engineer

    7 days ago

    Cardiff, Cardiff, United Kingdom Creditsafe Full time

    About CreditsafeCreditsafe is a leading provider of business intelligence and risk management solutions, offering a comprehensive database of over 320 million companies across 100 countries.Our mission is to empower businesses with actionable insights, enabling them to make informed decisions and drive growth.About the OpportunityWe are seeking a highly...

  • Senior Data Engineer

    6 days ago

    Cardiff, Cardiff, United Kingdom Creditsafe Full time

    About CreditsafeCreditsafe is a leading provider of business intelligence and risk management solutions, offering a comprehensive database of over 320 million companies across 100 countries.Our mission is to empower businesses with actionable insights, enabling them to make informed decisions and drive growth.About the OpportunityWe are seeking a highly...

  • Senior Data Engineer

    1 week ago

    Cardiff, Cardiff, United Kingdom developrec Full time

    About the RoleWe are seeking an experienced Data Engineering Team Lead to join our team at developrec. As a key member of our data engineering team, you will be responsible for leading the design, development, and maintenance of our data pipelines and products.Key ResponsibilitiesLead Data Pipeline Development: Oversee the design and development of data...

  • Senior Data Engineer

    6 days ago

    Cardiff, Cardiff, United Kingdom developrec Full time

    About the RoleWe are seeking an experienced Data Engineering Team Lead to join our team at developrec. As a key member of our data engineering team, you will be responsible for leading the design, development, and maintenance of our data pipelines and products.Key ResponsibilitiesLead Data Pipeline Development: Oversee the design and development of data...