Current jobs related to Data Engineer - Edinburgh - Smart Data Foundry

  • Data Engineer

    1 month ago

    Edinburgh, Edinburgh, United Kingdom Home Technology Solutions Full time

    Unlock Your Potential as a Data EngineerAt Home Technology Solutions, we're on a mission to revolutionize the way we interact with technology. As a Data Engineer, you'll play a crucial role in shaping our digital future.About the RoleWe're seeking a talented Data Engineer to join our team and help us build innovative data-driven solutions. In this role,...

  • Data Engineer

    1 month ago

    Edinburgh, Edinburgh, United Kingdom MBN Solutions Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our Data and Analytics team at MBN Solutions. As a Data Engineer, you will play a key role in building and maintaining our data platform, working closely with stakeholders to develop and support new projects and deployments.Key ResponsibilitiesDesign, build, and maintain data pipelines, data...

  • Data Engineer

    3 weeks ago

    Edinburgh, Edinburgh, United Kingdom Blend360 Full time

    Job DescriptionAt Blend360, we're seeking a talented Data Engineer to join our team. As a Data Engineer, you'll play a crucial role in driving high delivery standards and innovation within the company.Key Responsibilities:Design, develop, deploy, and maintain ingestion, transformation, and storage solutions.Analyze and organize raw data to deliver actionable...

  • Data Engineer

    3 weeks ago

    Edinburgh, Edinburgh, United Kingdom Blend360 Full time

    Job DescriptionAt Blend360, we're seeking a talented Data Engineer to join our team. As a Data Engineer, you'll play a crucial role in driving high delivery standards and innovation within the company.Key Responsibilities:Design, develop, deploy, and maintain ingestion, transformation, and storage solutions.Analyze and organize raw data to deliver actionable...

  • Data Engineer

    4 weeks ago

    Edinburgh, Edinburgh, United Kingdom Blend360 Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Blend360. As a Data Engineer, you will play a critical role in driving high delivery standards and innovation in our company.Reporting to a Senior Data Engineer and working closely with the Data Science and Business Development teams, this role will be responsible for delivering...

  • Data Engineer

    4 weeks ago

    Edinburgh, Edinburgh, United Kingdom Blend360 Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Blend360. As a Data Engineer, you will play a critical role in driving high delivery standards and innovation in our company.Reporting to a Senior Data Engineer and working closely with the Data Science and Business Development teams, this role will be responsible for delivering...

  • Data Engineer

    2 weeks ago

    Edinburgh, Edinburgh, United Kingdom Blend360 Full time

    Job Title: Data EngineerAbout the Role:We are seeking a skilled Data Engineer to join our team at Blend360. As a Data Engineer, you will be responsible for designing, developing, and deploying data solutions to support the provision of actionable insights for stakeholders.Key Responsibilities:Preparing and presenting data-driven solutions to...

  • Data Engineer

    1 week ago

    Edinburgh, Edinburgh, United Kingdom Blend360 Full time

    Job Title: Data EngineerAbout the Role:We are seeking a highly skilled Data Engineer to join our team at Blend360. As a Data Engineer, you will be responsible for designing, developing, and deploying data solutions to support the provision of actionable insights for stakeholders.Key Responsibilities:Preparing and presenting data-driven solutions to...

  • Data Engineer

    1 month ago

    Edinburgh, Edinburgh, United Kingdom MBN Solutions Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our Data and Analytics team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems, ensuring data quality, and developing data pipelines to support business decisions.Key ResponsibilitiesDesign and implement data pipelines using Azure...

  • Data Engineer

    3 weeks ago

    Edinburgh, Edinburgh, United Kingdom BJSS Full time

    About UsBJSS is a leading tech consultancy that has been delivering innovative solutions to top organisations for over 30 years. We pride ourselves on our collaborative culture and commitment to world-class delivery.We're a team of creative problem solvers who use software engineering best practices to build scalable and reusable data solutions. Our clients...

  • Data Engineer

    3 weeks ago

    Edinburgh, Edinburgh, United Kingdom BJSS Full time

    About UsBJSS is a leading tech consultancy that has been delivering innovative solutions to top organisations for over 30 years. We pride ourselves on our collaborative culture and commitment to world-class delivery.We're a team of creative problem solvers who use software engineering best practices to build scalable and reusable data solutions. Our clients...

  • Data Engineer

    3 weeks ago

    Edinburgh, Edinburgh, United Kingdom Blend360 Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Blend360. As a Data Engineer, you will play a critical role in driving high delivery standards and innovation in our company.Responsibilities:Design, develop, deploy, and maintain ingestion, transformation, and storage solutions.Analyze and organize raw data to deliver actionable...

  • Data Engineer

    3 weeks ago

    Edinburgh, Edinburgh, United Kingdom Blend360 Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Blend360. As a Data Engineer, you will play a critical role in driving high delivery standards and innovation in our company.Responsibilities:Design, develop, deploy, and maintain ingestion, transformation, and storage solutions.Analyze and organize raw data to deliver actionable...

  • Data Engineer

    4 weeks ago

    Edinburgh, Edinburgh, United Kingdom MBN Solutions Full time

    Transformative Data Engineer RoleWe're seeking a highly skilled Data Engineer to join our Data and Analytics team at MBN Solutions. As a key member of our team, you will be responsible for designing, building, and maintaining our data platform, ensuring seamless data ingestion, processing, and storage.Key Responsibilities:Develop and implement data pipelines...

  • Data Engineer

    4 weeks ago

    Edinburgh, Edinburgh, United Kingdom MBN Solutions Full time

    Transformative Data Engineer RoleWe're seeking a highly skilled Data Engineer to join our Data and Analytics team at MBN Solutions. As a key member of our team, you will be responsible for designing, building, and maintaining our data platform, ensuring seamless data ingestion, processing, and storage.Key Responsibilities:Develop and implement data pipelines...

  • Data Engineer

    2 weeks ago

    Edinburgh, Edinburgh, United Kingdom newscientist - Jobboard Full time

    About UsWe're a pioneering enterprise software company with a strong track record of growth and innovation. Our team has been recognized for its excellence, having won the ScotlandIS Digital Tech Enterprise Business of the Year award and being named Scotland's fastest-growing tech company in the Deloitte Technology Fast 50 for three consecutive years.We're...

  • Data Engineer

    4 weeks ago

    Edinburgh, United Kingdom Blend360 Full time

    Job DescriptionLife as a Data Engineer at BlendWe are looking for someone who is ready for the next step in their career and is excited by the idea of solving problems and designing best in class. However, they also need to be aware of the practicalities of making a difference in the real world – whilst we love innovative advanced solutions, we also...

  • Data Engineer

    4 weeks ago

    Edinburgh, Edinburgh, United Kingdom MBN Solutions Full time

    Transforming Data into InsightsWe're seeking a highly skilled Data Engineer to join our Data and Analytics team at MBN Solutions. As a key member of our team, you will be responsible for designing, building, and maintaining our data platform using Azure Databricks and Python.About the RoleYou will work closely with stakeholders across the business to develop...

  • Data Engineer

    4 weeks ago

    Edinburgh, Edinburgh, United Kingdom MBN Solutions Full time

    Transforming Data into InsightsWe're seeking a highly skilled Data Engineer to join our Data and Analytics team at MBN Solutions. As a key member of our team, you will be responsible for designing, building, and maintaining our data platform using Azure Databricks and Python.About the RoleYou will work closely with stakeholders across the business to develop...

  • Data Engineer

    3 weeks ago

    Edinburgh, Edinburgh, United Kingdom Financial Conduct Authority Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our Data Strategy & Services department. As a Data Engineer, you will play a key role in delivering the FCA's Data Strategy agenda across the organisation.Key ResponsibilitiesDesign, build, test, and deploy data products based on feeds from multiple systems, using a range of different...

Data Engineer

2 months ago

Edinburgh, United Kingdom Smart Data Foundry Full time

To apply, please submit your CV and a cover letter (we would like to know about your experience in developing tools and processes which improve data quality and reduces manual effort).



Please double check you have the right level of experience and qualifications by reading the full overview of this opportunity below.

About Smart Data Foundry

Smart Data Foundry has a purpose to unlock the power of financial data as a force to improve people’s lives.


What we do

We enable the research ecosystem to flourish through the provision of research ready real financial data.


We create data-driven insights based on real financial data, that identify areas to inform policy change and enhance regulation.


Inspire financial innovation with aizle™, Smart Data Foundry’s synthetic data engine, creating high utility synthetic data with no privacy issues when real-world data doesn’t exist or cannot be safely shared.


Role Purpose

Our Data Engineer develops tools and processes which ensure the quality of our data, reduces the manual effort involved in our work as we scale.


Responsibilities

  • Contributing to the design and development of data processing architecture and ongoing pipeline optimisation.
  • Developing and owning data cleaning, quality and validation processes.
  • Creating and explaining overviews and diagrams of processes and infrastructure to technical, semi-technical and non-technical users.
  • Working with data scientists, product owners, data partners and other internal and external customers to understand and deliver team commitments.
  • Undertaking development and evaluation of rapid prototypes to test features with end users and support tool selection.
  • Working with customers and partners to integrate data from multiple data sources, e.g. APIs (Application Programming Interfaces), sftp, manual file transfers, etc.
  • Monitoring system performance and contributing to infrastructure optimisation, considering utility and cost.
  • Testing and mentoring of less experienced software engineers and quality engineers.
  • Creating documentation, operating procedures and diagrams.
  • Working with the synthetic data, product and engineering teams to build a cloud-based, data driven SaaS platform.


Skills and Experience

Essential Technical Skills

  • Proven programming experience with Python in a Linux environment.
  • Good understanding of software development practices such as code reviews, unit testing, data validation, TDD, source management, continuous integration, and releasing software to live environments.
  • Knowledge of large-scale data processing technology, for example: Arrow, Hadoop, Cassandra, Spark, Hive, or Databricks.
  • Strong experience of batch ETL, data warehousing, database querying and building secure and scalable applications in a cloud-based environment, preferably AWS (Amazon Web Services).


Beneficial Technical Skills

  • Experience of working with infrastructure and container tools such as Terraform, Kubernetes and Docker/Podman.
  • Experience with modern software architecture paradigms such as microservices, event-driven, & serverless.
  • Experience of using Jira Software or similar project management tools.


Additional Attributes

  • Ability to deal with ambiguity and react quickly in an evolving and fast paced environment
  • Ability to work autonomously, under pressure and with conflicting and changing priorities
  • Excellent verbal and written communication skills
  • Personable approach with ability to develop positive working relationships at all levels within an organisation
  • Self-motivated and proactive
  • Collaborative, highly curious, with a desire to understand how Smart Data Foundry delivers its’ services
  • There may be a requirement to work on data partners sites, directly with data partner teams to build pipeline to make it easy to share data with us
  • Appreciation of the sensitive nature of the financial data held by Smart Data Foundry and the need to abide by information governance best practices


Location

This role is based in our office in Edinburgh Futures Institute in Edinburgh, therefore, candidates must be within commutable distance or willing to relocate.


Right to Work in the UK

Applicants must have the existing and ongoing right to work in the U.K. without restrictions as sponsorship for visas is not provided.

If invited for interview you will be required to evidence your right to work in the UK.


Benefits

A collaborative, innovative and impactful place to work. We give you support, nurture your talent and reward success. You will benefit from a competitive reward package, 40 days annual leave (including 6 bank hols), a defined contribution pension scheme (14% employer and 4.5% minimum employee contribution rates), family friendly initiatives and flexible working.