Data Engineer

5 days ago

Edinburgh, Edinburgh, United Kingdom Smart Data Foundry Full time
About the Role

We are seeking a highly skilled Data Engineer to join our team at Smart Data Foundry. As a Data Engineer, you will play a critical role in ensuring the quality of our financial data and reducing manual effort involved in our work as we scale.

Key Responsibilities
  • Design and Development: Contribute to the design and development of data processing architecture and ongoing pipeline optimization.
  • Data Cleaning and Quality: Develop and own data cleaning, quality, and validation processes.
  • Process Documentation: Create and explain overviews and diagrams of processes and infrastructure to technical, semi-technical, and non-technical users.
  • Collaboration: Work with data scientists, product owners, data partners, and other internal and external customers to understand and deliver team commitments.
  • Prototyping: Undertake development and evaluation of rapid prototypes to test features with end users and support tool selection.
  • Data Integration: Work with customers and partners to integrate data from multiple data sources, e.g. APIs, sftp, manual file transfers, etc.
  • System Monitoring: Monitor system performance and contribute to infrastructure optimization, considering utility and cost.
  • Mentorship: Test and mentor less experienced software engineers and quality engineers.
  • Documentation: Create documentation, operating procedures, and diagrams.
  • Cloud-Based Platform: Work with the synthetic data, product, and engineering teams to build a cloud-based, data-driven SaaS platform.
Requirements
  • Technical Skills: Proven programming experience with Python in a Linux environment, good understanding of software development practices, knowledge of large-scale data processing technology, and strong experience of batch ETL, data warehousing, database querying, and building secure and scalable applications in a cloud-based environment, preferably AWS.
  • Beneficial Skills: Experience of working with infrastructure and container tools, experience with modern software architecture paradigms, and experience of using Jira Software or similar project management tools.
Additional Attributes
  • Problem-Solving: Ability to deal with ambiguity and react quickly in an evolving and fast-paced environment.
  • Autonomy: Ability to work autonomously, under pressure, and with conflicting and changing priorities.
  • Communication: Excellent verbal and written communication skills.
  • Collaboration: Personable approach with ability to develop positive working relationships at all levels within an organization.
  • Self-Motivation: Self-motivated and proactive.
  • Curiosity: Collaborative, highly curious, with a desire to understand how Smart Data Foundry delivers its services.
  • Data Sensitivity: Appreciation of the sensitive nature of the financial data held by Smart Data Foundry and the need to abide by information governance best practices.
Location and Benefits

This role is based in our office in Edinburgh Futures Institute in Edinburgh, therefore, candidates must be within commutable distance or willing to relocate. We offer a competitive reward package, 40 days annual leave (including 6 bank hols), a defined contribution pension scheme, family-friendly initiatives, and flexible working.

  • Data Engineer

    5 days ago

    Edinburgh, Edinburgh, United Kingdom Smart Data Foundry Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Smart Data Foundry. As a Data Engineer, you will play a critical role in developing tools and processes that ensure the quality of our financial data, reduce manual effort, and enable the research ecosystem to flourish.Key ResponsibilitiesDesign and Development: Contribute to the...

  • Data Engineer

    5 days ago

    Edinburgh, Edinburgh, United Kingdom Smart Data Foundry Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Smart Data Foundry. As a Data Engineer, you will play a critical role in developing tools and processes that ensure the quality of our financial data, reduce manual effort, and enable the research ecosystem to flourish.Key ResponsibilitiesDesign and Development: Contribute to the...

  • Senior Data Engineer

    7 days ago

    Edinburgh, Edinburgh, United Kingdom Smart Data Foundry Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Smart Data Foundry. As a key member of our data engineering team, you will play a critical role in designing and developing our data processing architecture and ensuring the quality of our data.Key ResponsibilitiesDesign and develop data processing architecture and pipelines to...

  • Senior Data Engineer

    1 day ago

    Edinburgh, Edinburgh, United Kingdom Smart Data Foundry Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Smart Data Foundry. As a Senior Data Engineer, you will play a key role in developing and maintaining our data processing architecture, ensuring the quality and integrity of our data.Key ResponsibilitiesDesign and develop data processing architecture and pipelines to...

  • Senior Data Engineer

    23 hours ago

    Edinburgh, Edinburgh, United Kingdom Smart Data Foundry Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Smart Data Foundry. As a Senior Data Engineer, you will play a key role in developing and maintaining our data processing architecture, ensuring the quality and integrity of our data.Key ResponsibilitiesDesign and develop data processing architecture and pipelines to...

  • Senior Data Engineer

    6 days ago

    Edinburgh, Edinburgh, United Kingdom Smart Data Foundry Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Smart Data Foundry. As a Senior Data Engineer, you will play a key role in developing and maintaining our data processing architecture and ensuring the quality of our data.Key ResponsibilitiesDesign and develop data processing architecture and pipelines to ensure data...

  • Data Architect

    7 days ago

    Edinburgh, Edinburgh, United Kingdom Smart Data Foundry Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Smart Data Foundry. As a key member of our data engineering team, you will play a critical role in designing and developing our data processing architecture and ensuring the quality of our data.Key ResponsibilitiesDesign and develop data processing architecture and pipelines to...

  • Data Engineer

    6 days ago

    Edinburgh, Edinburgh, United Kingdom BJSS Full time

    About the RoleWe're seeking a skilled Data Engineer to join our team at BJSS, a leading tech consultancy. As a Data Engineer, you'll play a key role in designing, building, and maintaining data applications, systems, and services that deliver business value to our clients.Key Responsibilities:Design and implement data pipelines and processes in a...

  • Data Engineer

    5 days ago

    Edinburgh, Edinburgh, United Kingdom addepar Full time

    About AddeparAddepar is a leading technology and data company that empowers investment professionals to provide informed guidance to their clients. With a global presence and a platform that aggregates portfolio, market, and client data for over $6 trillion in assets, Addepar is a trusted partner for firms and use cases worldwide.The RoleAs a Portfolio Data...

  • Data Engineer

    6 days ago

    Edinburgh, Edinburgh, United Kingdom addepar Full time

    About AddeparAddepar is a leading technology and data company that empowers investment professionals to provide informed guidance to their clients. With a global presence and a platform that aggregates portfolio, market, and client data for over $6 trillion in assets, Addepar is a trusted partner for firms and use cases worldwide.The RoleAs a Portfolio Data...

  • AWS Data Engineer

    2 days ago

    Edinburgh, Edinburgh, United Kingdom Society of Research Software Engineering Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at the Society of Research Software Engineering. As a Data Engineer, you will play a critical role in developing and maintaining our data processing architecture and ensuring the quality of our data.Key ResponsibilitiesDesign and develop data processing pipelines and architectures...

  • AWS Data Engineer

    2 days ago

    Edinburgh, Edinburgh, United Kingdom Society of Research Software Engineering Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at the Society of Research Software Engineering. As a Data Engineer, you will play a critical role in developing and maintaining our data processing architecture and ensuring the quality of our data.Key ResponsibilitiesDesign and develop data processing pipelines and architectures...

  • Data Engineer

    20 hours ago

    Edinburgh, Edinburgh, United Kingdom addepar Full time

    About AddeparAddepar is a leading technology and data company that empowers investment professionals to provide informed guidance to their clients. With a global presence and a platform that aggregates portfolio, market, and client data for over $6 trillion in assets, Addepar is a trusted partner for firms and use cases worldwide.The RoleAs a Data Engineer...

  • Data Engineer

    17 hours ago

    Edinburgh, Edinburgh, United Kingdom addepar Full time

    About AddeparAddepar is a leading technology and data company that empowers investment professionals to provide informed guidance to their clients. With a global presence and a platform that aggregates portfolio, market, and client data for over $6 trillion in assets, Addepar is a trusted partner for firms and use cases worldwide.The RoleAs a Data Engineer...

  • Senior Data Engineer

    2 hours ago

    Edinburgh, Edinburgh, United Kingdom BJSS Full time

    About UsBJSS is a leading tech consultancy that helps organizations solve complex technology problems. We're a team of creative problem solvers who use software engineering best practices to build scalable and reusable data solutions.Job SummaryWe're looking for a Senior Data Engineer to join our team. As a Senior Data Engineer, you'll help our clients...

  • Data Engineer Specialist

    4 days ago

    Edinburgh, Edinburgh, United Kingdom Iconic Resourcing Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our dynamic team at Iconic Resourcing. As a key member of our organization, you will have the opportunity to work on cutting-edge data projects, shaping the future of data architecture within our client's organization.Key ResponsibilitiesDesign, develop, and maintain robust data pipelines...

  • Data Engineer Specialist

    4 days ago

    Edinburgh, Edinburgh, United Kingdom Iconic Resourcing Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our dynamic team at Iconic Resourcing. As a key member of our organization, you will have the opportunity to work on cutting-edge data projects, shaping the future of data architecture within our client's organization.Key ResponsibilitiesDesign, develop, and maintain robust data pipelines...

  • Data Integration Engineer

    5 days ago

    Edinburgh, Edinburgh, United Kingdom addepar Full time

    Who We Are Addepar is a global technology and data company dedicated to empowering investment professionals with the most informed and precise guidance for their clients. With a presence in over 45 countries, Addepar's platform aggregates portfolio, market, and client data for over $6 trillion in assets. Our open platform integrates with more than 100...

  • Data Integration Engineer

    3 weeks ago

    Edinburgh, Edinburgh, United Kingdom addepar Full time

    Who We Are Addepar is a global technology and data company dedicated to empowering investment professionals with the most informed and precise guidance for their clients. With a presence in over 45 countries, Addepar's platform aggregates portfolio, market, and client data for over $6 trillion in assets. Our open platform integrates with more than 100...

  • Data Engineer

    3 days ago

    Edinburgh, Edinburgh, United Kingdom Lane Clark & Peacock LLP. Full time

    Job DescriptionLane Clark & Peacock LLP is a leading specialist energy transition practice, dedicated to supporting the energy sector in driving the transition to a more sustainable future. We are a diverse team with a strong commitment to furthering the transition across the entire value chain, with key focus areas including power market modeling and...