AWS Data Engineer

23 hours ago

Edinburgh, Edinburgh, United Kingdom Society of Research Software Engineering Full time
About the Role

We are seeking a highly skilled Data Engineer to join our team at Smart Data Foundry. As a Data Engineer, you will play a critical role in developing tools and processes that improve data quality and reduce manual effort.

Key Responsibilities
  • Design and develop data processing architecture and pipelines to ensure high-quality data.
  • Collaborate with data scientists, product owners, and other stakeholders to understand and deliver team commitments.
  • Work with customers and partners to integrate data from multiple sources, including APIs, sftp, and manual file transfers.
  • Monitor system performance and contribute to infrastructure optimisation.
  • Test and mentor less experienced software engineers and quality engineers.
Requirements
  • Proven programming experience with Python in a Linux environment.
  • Good understanding of software development practices, including code reviews, unit testing, data validation, and continuous integration.
  • Knowledge of large-scale data processing technology, including batch ETL, data warehousing, and database querying.
  • Experience with modern software architecture paradigms, such as microservices and serverless.
  • Ability to deal with ambiguity and react quickly in an evolving and fast-paced environment.
What We Offer

As a Data Engineer at Smart Data Foundry, you will have the opportunity to work on a wide range of projects, including data processing, architecture, and infrastructure optimisation. You will also have the chance to collaborate with a talented team of data scientists, product owners, and other stakeholders to deliver high-quality results.

We are committed to providing a supportive and inclusive work environment, with opportunities for professional growth and development. If you are a motivated and experienced Data Engineer looking for a new challenge, we encourage you to apply for this exciting opportunity.

  • AWS Data Enterprise Architect

    2 weeks ago

    Edinburgh, Edinburgh, United Kingdom ECF Data, LLC Full time

    Are you passionate about data architecture and eager to lead the digital transformation of a global company? We're looking for an innovative and strategic Enterprise Data Architect to join our team at ECF Data, LLC.Your Role:As an Enterprise Data Architect, you'll be at the forefront of our digital transformation. You'll lead the architecture and design of...

  • AWS Data Enterprise Architect

    2 weeks ago

    Edinburgh, Edinburgh, United Kingdom ECF Data, LLC Full time

    Are you passionate about data architecture and eager to lead the digital transformation of a global company? We're looking for an innovative and strategic Enterprise Data Architect to join our team at ECF Data, LLC.Your Role:As an Enterprise Data Architect, you'll be at the forefront of our digital transformation. You'll lead the architecture and design of...

  • AWS Data Engineer

    1 week ago

    Edinburgh, Edinburgh, United Kingdom Society of Research Software Engineering Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at the Society of Research Software Engineering. As a Data Engineer, you will play a critical role in developing and maintaining our data processing architecture and ensuring the quality of our data.Key ResponsibilitiesDesign and develop data processing pipelines and architectures...

  • AWS Data Engineer

    1 week ago

    Edinburgh, Edinburgh, United Kingdom Society of Research Software Engineering Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at the Society of Research Software Engineering. As a Data Engineer, you will play a critical role in developing and maintaining our data processing architecture and ensuring the quality of our data.Key ResponsibilitiesDesign and develop data processing pipelines and architectures...

  • Data Engineer

    2 days ago

    Edinburgh, Edinburgh, United Kingdom Smart Data Foundry Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Smart Data Foundry. As a Data Engineer, you will play a critical role in ensuring the quality of our data and reducing manual effort involved in our work as we scale.Key Responsibilities:Design and develop data processing architecture and optimize ongoing...

  • Data Engineer

    2 days ago

    Edinburgh, Edinburgh, United Kingdom Smart Data Foundry Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Smart Data Foundry. As a Data Engineer, you will play a critical role in ensuring the quality of our data and reducing manual effort involved in our work as we scale.Key Responsibilities:Design and develop data processing architecture and optimize ongoing...

  • Senior Data Engineer

    2 weeks ago

    Edinburgh, Edinburgh, United Kingdom Smart Data Foundry Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Smart Data Foundry. As a key member of our data engineering team, you will play a critical role in designing and developing our data processing architecture and ensuring the quality of our data.Key ResponsibilitiesDesign and develop data processing architecture and pipelines to...

  • Data Engineer

    2 days ago

    Edinburgh, Edinburgh, United Kingdom Smart Data Foundry Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Smart Data Foundry. As a Data Engineer, you will play a critical role in developing and maintaining our data processing architecture, ensuring the quality and integrity of our data.Key ResponsibilitiesDesign and develop data processing pipelines and architectures to meet business...

  • Data Engineer

    2 days ago

    Edinburgh, Edinburgh, United Kingdom Smart Data Foundry Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Smart Data Foundry. As a Data Engineer, you will play a critical role in developing and maintaining our data processing architecture, ensuring the quality and integrity of our data.Key ResponsibilitiesDesign and develop data processing pipelines and architectures to meet business...

  • AWS Data Engineer

    2 weeks ago

    Edinburgh, Edinburgh, United Kingdom Nine Twenty Recruitment Full time

    Job Title: Data Engineer - Cloud SpecialistCompany: Nine Twenty RecruitmentJob Type: Full-timeLocation: RemoteAbout Us:Nine Twenty Recruitment is a leading recruitment agency specializing in placing top talent in the tech industry. We're passionate about connecting innovative companies with exceptional professionals who drive growth and success.Job...

  • Senior Data Engineer

    1 week ago

    Edinburgh, Edinburgh, United Kingdom Smart Data Foundry Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Smart Data Foundry. As a Senior Data Engineer, you will play a key role in developing and maintaining our data processing architecture, ensuring the quality and integrity of our data.Key ResponsibilitiesDesign and develop data processing architecture and pipelines to...

  • Senior Data Engineer

    1 week ago

    Edinburgh, Edinburgh, United Kingdom Smart Data Foundry Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Smart Data Foundry. As a Senior Data Engineer, you will play a key role in developing and maintaining our data processing architecture, ensuring the quality and integrity of our data.Key ResponsibilitiesDesign and develop data processing architecture and pipelines to...

  • Data Engineer

    5 days ago

    Edinburgh, Edinburgh, United Kingdom Smart Data Foundry Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Smart Data Foundry. As a Data Engineer, you will play a critical role in developing tools and processes that ensure the quality of our data and reduce manual effort involved in our work as we scale.Key ResponsibilitiesDesign and develop data processing architecture and optimize...

  • Data Engineer

    5 days ago

    Edinburgh, Edinburgh, United Kingdom Smart Data Foundry Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Smart Data Foundry. As a Data Engineer, you will play a critical role in developing tools and processes that ensure the quality of our data and reduce manual effort involved in our work as we scale.Key ResponsibilitiesDesign and develop data processing architecture and optimize...

  • Senior Data Engineer

    2 weeks ago

    Edinburgh, Edinburgh, United Kingdom Smart Data Foundry Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Smart Data Foundry. As a Senior Data Engineer, you will play a key role in developing and maintaining our data processing architecture and ensuring the quality of our data.Key ResponsibilitiesDesign and develop data processing architecture and pipelines to ensure data...

  • Data Engineer

    2 weeks ago

    Edinburgh, Edinburgh, United Kingdom Smart Data Foundry Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Smart Data Foundry. As a Data Engineer, you will play a critical role in developing tools and processes that ensure the quality of our financial data, reduce manual effort, and enable the research ecosystem to flourish.Key ResponsibilitiesDesign and Development: Contribute to the...

  • Data Engineer

    2 weeks ago

    Edinburgh, Edinburgh, United Kingdom Smart Data Foundry Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Smart Data Foundry. As a Data Engineer, you will play a critical role in developing tools and processes that ensure the quality of our financial data, reduce manual effort, and enable the research ecosystem to flourish.Key ResponsibilitiesDesign and Development: Contribute to the...

  • Data Engineer

    2 weeks ago

    Edinburgh, Edinburgh, United Kingdom Smart Data Foundry Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Smart Data Foundry. As a Data Engineer, you will play a critical role in ensuring the quality of our financial data and reducing manual effort involved in our work as we scale.Key ResponsibilitiesDesign and Development: Contribute to the design and development of data processing...

  • Data Engineer

    2 weeks ago

    Edinburgh, Edinburgh, United Kingdom Smart Data Foundry Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Smart Data Foundry. As a Data Engineer, you will play a critical role in ensuring the quality of our financial data and reducing manual effort involved in our work as we scale.Key ResponsibilitiesDesign and Development: Contribute to the design and development of data processing...

  • Data Architect

    2 weeks ago

    Edinburgh, Edinburgh, United Kingdom Smart Data Foundry Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Smart Data Foundry. As a key member of our data engineering team, you will play a critical role in designing and developing our data processing architecture and ensuring the quality of our data.Key ResponsibilitiesDesign and develop data processing architecture and pipelines to...