Data Engineer

5 days ago

Edinburgh, Edinburgh, United Kingdom Smart Data Foundry Full time
About the Role

We are seeking a highly skilled Data Engineer to join our team at Smart Data Foundry. As a Data Engineer, you will play a critical role in developing tools and processes that ensure the quality of our financial data, reduce manual effort, and enable the research ecosystem to flourish.

Key Responsibilities
  • Design and Development: Contribute to the design and development of data processing architecture and ongoing pipeline optimization.
  • Data Cleaning and Quality: Develop and own data cleaning, quality, and validation processes.
  • Process Documentation: Create and explain overviews and diagrams of processes and infrastructure to technical, semi-technical, and non-technical users.
  • Collaboration: Work with data scientists, product owners, data partners, and other internal and external customers to understand and deliver team commitments.
  • Prototyping and Testing: Undertake development and evaluation of rapid prototypes to test features with end users and support tool selection.
  • Data Integration: Work with customers and partners to integrate data from multiple data sources, e.g., APIs, sftp, manual file transfers, etc.
  • System Performance: Monitor system performance and contribute to infrastructure optimization, considering utility and cost.
  • Mentorship and Training: Test and mentor less experienced software engineers and quality engineers.
  • Documentation and Procedures: Create documentation, operating procedures, and diagrams.
  • Cloud-Based Platform: Work with the synthetic data, product, and engineering teams to build a cloud-based, data-driven SaaS platform.
Requirements
  • Technical Skills: Proven programming experience with Python in a Linux environment, good understanding of software development practices, knowledge of large-scale data processing technology, and strong experience of batch ETL, data warehousing, database querying, and building secure and scalable applications in a cloud-based environment, preferably AWS.
  • Beneficial Skills: Experience of working with infrastructure and container tools, experience with modern software architecture paradigms, and experience of using Jira Software or similar project management tools.
  • Additional Attributes: Ability to deal with ambiguity and react quickly in an evolving and fast-paced environment, ability to work autonomously, under pressure, and with conflicting and changing priorities, excellent verbal and written communication skills, personable approach, self-motivated, and proactive.
What We Offer

We offer a collaborative, innovative, and impactful place to work, with a competitive reward package, 40 days annual leave, a defined contribution pension scheme, family-friendly initiatives, and flexible working.

  • Senior Data Engineer

    7 days ago

    Edinburgh, Edinburgh, United Kingdom Smart Data Foundry Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Smart Data Foundry. As a key member of our data engineering team, you will play a critical role in designing and developing our data processing architecture and ensuring the quality of our data.Key ResponsibilitiesDesign and develop data processing architecture and pipelines to...

  • Senior Data Engineer

    1 day ago

    Edinburgh, Edinburgh, United Kingdom Smart Data Foundry Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Smart Data Foundry. As a Senior Data Engineer, you will play a key role in developing and maintaining our data processing architecture, ensuring the quality and integrity of our data.Key ResponsibilitiesDesign and develop data processing architecture and pipelines to...

  • Senior Data Engineer

    23 hours ago

    Edinburgh, Edinburgh, United Kingdom Smart Data Foundry Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Smart Data Foundry. As a Senior Data Engineer, you will play a key role in developing and maintaining our data processing architecture, ensuring the quality and integrity of our data.Key ResponsibilitiesDesign and develop data processing architecture and pipelines to...

  • Senior Data Engineer

    6 days ago

    Edinburgh, Edinburgh, United Kingdom Smart Data Foundry Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Smart Data Foundry. As a Senior Data Engineer, you will play a key role in developing and maintaining our data processing architecture and ensuring the quality of our data.Key ResponsibilitiesDesign and develop data processing architecture and pipelines to ensure data...

  • Data Engineer

    5 days ago

    Edinburgh, Edinburgh, United Kingdom Smart Data Foundry Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Smart Data Foundry. As a Data Engineer, you will play a critical role in ensuring the quality of our financial data and reducing manual effort involved in our work as we scale.Key ResponsibilitiesDesign and Development: Contribute to the design and development of data processing...

  • Data Engineer

    7 days ago

    Edinburgh, Edinburgh, United Kingdom Smart Data Foundry Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Smart Data Foundry. As a Data Engineer, you will play a critical role in ensuring the quality of our financial data and reducing manual effort involved in our work as we scale.Key ResponsibilitiesDesign and Development: Contribute to the design and development of data processing...

  • Data Architect

    7 days ago

    Edinburgh, Edinburgh, United Kingdom Smart Data Foundry Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Smart Data Foundry. As a key member of our data engineering team, you will play a critical role in designing and developing our data processing architecture and ensuring the quality of our data.Key ResponsibilitiesDesign and develop data processing architecture and pipelines to...

  • Data Engineer

    6 days ago

    Edinburgh, Edinburgh, United Kingdom BJSS Full time

    About the RoleWe're seeking a skilled Data Engineer to join our team at BJSS, a leading tech consultancy. As a Data Engineer, you'll play a key role in designing, building, and maintaining data applications, systems, and services that deliver business value to our clients.Key Responsibilities:Design and implement data pipelines and processes in a...

  • Data Engineer

    5 days ago

    Edinburgh, Edinburgh, United Kingdom addepar Full time

    About AddeparAddepar is a leading technology and data company that empowers investment professionals to provide informed guidance to their clients. With a global presence and a platform that aggregates portfolio, market, and client data for over $6 trillion in assets, Addepar is a trusted partner for firms and use cases worldwide.The RoleAs a Portfolio Data...

  • Data Engineer

    6 days ago

    Edinburgh, Edinburgh, United Kingdom addepar Full time

    About AddeparAddepar is a leading technology and data company that empowers investment professionals to provide informed guidance to their clients. With a global presence and a platform that aggregates portfolio, market, and client data for over $6 trillion in assets, Addepar is a trusted partner for firms and use cases worldwide.The RoleAs a Portfolio Data...

  • AWS Data Engineer

    2 days ago

    Edinburgh, Edinburgh, United Kingdom Society of Research Software Engineering Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at the Society of Research Software Engineering. As a Data Engineer, you will play a critical role in developing and maintaining our data processing architecture and ensuring the quality of our data.Key ResponsibilitiesDesign and develop data processing pipelines and architectures...

  • AWS Data Engineer

    2 days ago

    Edinburgh, Edinburgh, United Kingdom Society of Research Software Engineering Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at the Society of Research Software Engineering. As a Data Engineer, you will play a critical role in developing and maintaining our data processing architecture and ensuring the quality of our data.Key ResponsibilitiesDesign and develop data processing pipelines and architectures...

  • Data Engineer

    20 hours ago

    Edinburgh, Edinburgh, United Kingdom addepar Full time

    About AddeparAddepar is a leading technology and data company that empowers investment professionals to provide informed guidance to their clients. With a global presence and a platform that aggregates portfolio, market, and client data for over $6 trillion in assets, Addepar is a trusted partner for firms and use cases worldwide.The RoleAs a Data Engineer...

  • Data Engineer

    17 hours ago

    Edinburgh, Edinburgh, United Kingdom addepar Full time

    About AddeparAddepar is a leading technology and data company that empowers investment professionals to provide informed guidance to their clients. With a global presence and a platform that aggregates portfolio, market, and client data for over $6 trillion in assets, Addepar is a trusted partner for firms and use cases worldwide.The RoleAs a Data Engineer...

  • Senior Data Engineer

    2 hours ago

    Edinburgh, Edinburgh, United Kingdom BJSS Full time

    About UsBJSS is a leading tech consultancy that helps organizations solve complex technology problems. We're a team of creative problem solvers who use software engineering best practices to build scalable and reusable data solutions.Job SummaryWe're looking for a Senior Data Engineer to join our team. As a Senior Data Engineer, you'll help our clients...

  • Data Engineer Specialist

    4 days ago

    Edinburgh, Edinburgh, United Kingdom Iconic Resourcing Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our dynamic team at Iconic Resourcing. As a key member of our organization, you will have the opportunity to work on cutting-edge data projects, shaping the future of data architecture within our client's organization.Key ResponsibilitiesDesign, develop, and maintain robust data pipelines...

  • Data Engineer Specialist

    4 days ago

    Edinburgh, Edinburgh, United Kingdom Iconic Resourcing Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our dynamic team at Iconic Resourcing. As a key member of our organization, you will have the opportunity to work on cutting-edge data projects, shaping the future of data architecture within our client's organization.Key ResponsibilitiesDesign, develop, and maintain robust data pipelines...

  • Data Integration Engineer

    5 days ago

    Edinburgh, Edinburgh, United Kingdom addepar Full time

    Who We Are Addepar is a global technology and data company dedicated to empowering investment professionals with the most informed and precise guidance for their clients. With a presence in over 45 countries, Addepar's platform aggregates portfolio, market, and client data for over $6 trillion in assets. Our open platform integrates with more than 100...

  • Data Integration Engineer

    3 weeks ago

    Edinburgh, Edinburgh, United Kingdom addepar Full time

    Who We Are Addepar is a global technology and data company dedicated to empowering investment professionals with the most informed and precise guidance for their clients. With a presence in over 45 countries, Addepar's platform aggregates portfolio, market, and client data for over $6 trillion in assets. Our open platform integrates with more than 100...

  • Data Engineer

    3 days ago

    Edinburgh, Edinburgh, United Kingdom Lane Clark & Peacock LLP. Full time

    Job DescriptionLane Clark & Peacock LLP is a leading specialist energy transition practice, dedicated to supporting the energy sector in driving the transition to a more sustainable future. We are a diverse team with a strong commitment to furthering the transition across the entire value chain, with key focus areas including power market modeling and...