Current jobs related to Data Engineer - Edinburgh, Edinburgh - Smart Data Foundry

  • Data Engineer

    1 month ago


    Edinburgh, Edinburgh, United Kingdom Blend360 Full time

    Job DescriptionAt Blend360, we're seeking a talented Data Engineer to join our team. As a Data Engineer, you'll play a crucial role in driving high delivery standards and innovation within the company.Key Responsibilities:Design, develop, deploy, and maintain ingestion, transformation, and storage solutions.Analyze and organize raw data to deliver actionable...

  • Data Engineer

    1 month ago


    Edinburgh, Edinburgh, United Kingdom Blend360 Full time

    Job DescriptionAt Blend360, we're seeking a talented Data Engineer to join our team. As a Data Engineer, you'll play a crucial role in driving high delivery standards and innovation within the company.Key Responsibilities:Design, develop, deploy, and maintain ingestion, transformation, and storage solutions.Analyze and organize raw data to deliver actionable...

  • Data Engineer

    3 weeks ago


    Edinburgh, Edinburgh, United Kingdom Blend360 Full time

    Job Title: Data EngineerAbout the Role:We are seeking a highly skilled Data Engineer to join our team at Blend360. As a Data Engineer, you will be responsible for designing, developing, and deploying data solutions to support the provision of actionable insights for stakeholders.Key Responsibilities:Preparing and presenting data-driven solutions to...

  • Data Engineer

    3 weeks ago


    Edinburgh, Edinburgh, United Kingdom Blend360 Full time

    Job Title: Data EngineerAbout the Role:We are seeking a skilled Data Engineer to join our team at Blend360. As a Data Engineer, you will be responsible for designing, developing, and deploying data solutions to support the provision of actionable insights for stakeholders.Key Responsibilities:Preparing and presenting data-driven solutions to...

  • Data Engineer

    4 weeks ago


    Edinburgh, Edinburgh, United Kingdom BJSS Full time

    About UsBJSS is a leading tech consultancy that has been delivering innovative solutions to top organisations for over 30 years. We pride ourselves on our collaborative culture and commitment to world-class delivery.We're a team of creative problem solvers who use software engineering best practices to build scalable and reusable data solutions. Our clients...

  • Data Engineer

    4 weeks ago


    Edinburgh, Edinburgh, United Kingdom BJSS Full time

    About UsBJSS is a leading tech consultancy that has been delivering innovative solutions to top organisations for over 30 years. We pride ourselves on our collaborative culture and commitment to world-class delivery.We're a team of creative problem solvers who use software engineering best practices to build scalable and reusable data solutions. Our clients...

  • Data Engineer

    4 weeks ago


    Edinburgh, Edinburgh, United Kingdom newscientist - Jobboard Full time

    About UsWe're a pioneering enterprise software company with a strong track record of growth and innovation. Our team has been recognized for its excellence, having won the ScotlandIS Digital Tech Enterprise Business of the Year award and being named Scotland's fastest-growing tech company in the Deloitte Technology Fast 50 for three consecutive years.We're...

  • Data Engineer

    4 weeks ago


    Edinburgh, Edinburgh, United Kingdom Financial Conduct Authority Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our Data Strategy & Services department. As a Data Engineer, you will play a key role in delivering the FCA's Data Strategy agenda across the organisation.Key ResponsibilitiesDesign, build, test, and deploy data products based on feeds from multiple systems, using a range of different...

  • Data Engineer

    4 weeks ago


    Edinburgh, Edinburgh, United Kingdom Financial Conduct Authority Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our Data Strategy & Services department. As a Data Engineer, you will play a key role in delivering the FCA's Data Strategy agenda across the organisation.Key ResponsibilitiesDesign, build, test, and deploy data products based on feeds from multiple systems, using a range of different...

  • Data Engineer

    4 weeks ago


    Edinburgh, Edinburgh, United Kingdom newscientist - Jobboard Full time

    About UsWe're a pioneering tech consultancy that's been pushing the boundaries of innovation since 1993. Our team of creative problem solvers has delivered solutions that millions of people use every day, and we're proud of our reputation for excellence.About the RoleWe're seeking a talented Data Engineer to join our team of experts. As a Data Engineer,...

  • Data Engineer

    4 weeks ago


    Edinburgh, Edinburgh, United Kingdom newscientist - Jobboard Full time

    About UsWe're a pioneering tech consultancy that's been pushing the boundaries of innovation since 1993. Our team of creative problem solvers has delivered solutions that millions of people use every day, and we're proud of our reputation for excellence.About the RoleWe're seeking a talented Data Engineer to join our team of experts. As a Data Engineer,...

  • Data Engineer

    4 weeks ago


    Edinburgh, Edinburgh, United Kingdom Blend360 Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Blend360. As a Data Engineer, you will play a critical role in driving high delivery standards and innovation in our company.Key Responsibilities:Design, develop, deploy, and maintain ingestion, transformation, and storage solutions.Analyze and organize raw data to deliver...

  • Data Engineer

    4 weeks ago


    Edinburgh, Edinburgh, United Kingdom Blend360 Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Blend360. As a Data Engineer, you will play a critical role in driving high delivery standards and innovation in our company.Key Responsibilities:Design, develop, deploy, and maintain ingestion, transformation, and storage solutions.Analyze and organize raw data to deliver...

  • Data Engineer

    1 month ago


    Edinburgh, Edinburgh, United Kingdom Blend360 Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Blend360. As a Data Engineer, you will play a critical role in driving high delivery standards and innovation in our company.Responsibilities:Design, develop, deploy, and maintain ingestion, transformation, and storage solutions.Analyze and organize raw data to deliver actionable...

  • Data Engineer

    1 month ago


    Edinburgh, Edinburgh, United Kingdom Blend360 Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Blend360. As a Data Engineer, you will play a critical role in driving high delivery standards and innovation in our company.Responsibilities:Design, develop, deploy, and maintain ingestion, transformation, and storage solutions.Analyze and organize raw data to deliver actionable...

  • Data Engineer

    3 weeks ago


    Edinburgh, Edinburgh, United Kingdom MBN Solutions Full time

    Data EngineerWe're seeking a skilled Data Engineer to join our Data and Analytics team. As a key member, you'll be responsible for designing, building, and maintaining our data platform using Azure Databricks and Python. Your expertise in data ingestion, processing, and storage will help us unlock valuable insights that inform our business decisions.Key...


  • Edinburgh, Edinburgh, United Kingdom Cathcart Technology Full time £70,000 - £80,000

    Job Title: Data Engineering ManagerAbout the Role:We are seeking an experienced Data Engineering Manager to join our team at Cathcart Technology. As a Data Engineering Manager, you will be responsible for leading a team of Data Engineers in the development and maintenance of our data infrastructure. You will work closely with our engineering teams to design...

  • Data Engineering Lead

    2 weeks ago


    Edinburgh, Edinburgh, United Kingdom Cathcart Technology Full time

    Data Engineering LeadCathcart Technology is seeking an experienced Data Engineering Lead to join their team in Edinburgh. As a Data Engineering Lead, you will be responsible for managing a team of Data Engineers and overseeing the development of world-class products and services.The company is a globally known software business with a strong focus on...

  • Data Engineer

    4 weeks ago


    Edinburgh, Edinburgh, United Kingdom newscientist - Jobboard Full time

    About UsWe're a pioneering tech consultancy that's been pushing the boundaries of innovation since 1993. Our team of creative problem solvers has been delivering cutting-edge solutions to some of the world's leading organisations, with millions of people using our work every day.We've won numerous awards, including a prestigious Queen's Award for Enterprise...


  • Edinburgh, Edinburgh, United Kingdom Cathcart Technology Full time

    About the Role: We are seeking a highly skilled Data Engineering Manager to join our team at Cathcart Technology. As a Data Engineering Manager, you will be responsible for leading a small team of Data Engineers in the development and maintenance of our data infrastructure. The ideal candidate will have a strong background in data engineering, experience in...

Data Engineer

2 months ago


Edinburgh, Edinburgh, United Kingdom Smart Data Foundry Full time
About the Role

We are seeking a highly skilled Data Engineer to join our team at Smart Data Foundry. As a Data Engineer, you will play a critical role in developing tools and processes that ensure the quality of our data and reduce manual effort involved in our work as we scale.

Key Responsibilities
  • Design and develop data processing architecture and ongoing pipeline optimisation.
  • Develop and own data cleaning, quality and validation processes.
  • Create and explain overviews and diagrams of processes and infrastructure to technical, semi-technical and non-technical users.
  • Work with data scientists, product owners, data partners and other internal and external customers to understand and deliver team commitments.
  • Undertake development and evaluation of rapid prototypes to test features with end users and support tool selection.
  • Work with customers and partners to integrate data from multiple data sources, e.g. APIs, sftp, manual file transfers, etc.
  • Monitor system performance and contribute to infrastructure optimisation, considering utility and cost.
  • Test and mentor less experienced software engineers and quality engineers.
  • Create documentation, operating procedures and diagrams.
  • Work with the synthetic data, product and engineering teams to build a cloud-based, data driven SaaS platform.
Requirements
  • Proven programming experience with Python in a Linux environment.
  • Good understanding of software development practices such as code reviews, unit testing, data validation, TDD, source management, continuous integration, and releasing software to live environments.
  • Knowledge of large-scale data processing technology, for example: Arrow, Hadoop, Cassandra, Spark, Hive, or Databricks.
  • Strong experience of batch ETL, data warehousing, database querying and building secure and scalable applications in a cloud-based environment, preferably AWS (Amazon Web Services).
Desirable Skills
  • Experience of working with infrastructure and container tools such as Terraform, Kubernetes and Docker/Podman.
  • Experience with modern software architecture paradigms such as microservices, event-driven, & serverless.
  • Experience of using Jira Software or similar project management tools.
About Us

Smart Data Foundry has a purpose to unlock the power of financial data as a force to improve people's lives. We enable the research ecosystem to flourish through the provision of research ready real financial data. We create data-driven insights based on real financial data, that identify areas to inform policy change and enhance regulation. We inspire financial innovation with aizleTM, Smart Data Foundry's synthetic data engine, creating high utility synthetic data with no privacy issues when real-world data doesn't exist or cannot be safely shared.

What We Offer

A collaborative, innovative and impactful place to work. We give you support, nurture your talent and reward success. You will benefit from a competitive reward package, 40 days annual leave (including 6 bank hols), a defined contribution pension scheme (14% employer and 4.5% minimum employee contribution rates), family friendly initiatives and flexible working.