Data Solutions Engineer

2 weeks ago

London, Greater London, United Kingdom Methods Analytics Full time
About Methods Analytics

We exist to drive positive change by empowering organisations to make informed decisions with data. Our team of passionate experts combines sector-specific insight and technical expertise to deliver end-to-end data solutions.

Salary and Benefits

We offer a competitive salary of £60,000 - £80,000 per annum, depending on experience, as well as a comprehensive benefits package that includes:

  • A pension salary exchange scheme with 4% employer contribution and 5% employee contribution
  • Discretionary company bonus based on company and individual performance
  • Life assurance of 4 times base salary
  • Private medical insurance which is non-contributory (spouse and dependants included)
  • Worldwide travel insurance which is non-contributory (spouse and dependants included)
Job Description

We are seeking an experienced Data Solutions Engineer to join our team within the Public Sector Business unit on a permanent basis. This role will be mainly remote but require flexibility to travel to client sites, and our offices based in London, Sheffield, and Bristol.

About the Role

As a Data Solutions Engineer, you will work closely with cross-functional teams to translate complex technical concepts into clear, accessible language for non-technical audiences. You will collaborate with a dynamic delivery team on innovative projects, transforming raw data into powerful insights that shape strategic decisions and drive business transformation.

Key Responsibilities
  1. Design and implement efficient ETL and ELT pipelines, ensuring seamless integration and transformation of data from various sources to deliver clean, reliable data.
  2. Develop and maintain sophisticated data models, employing dimensional modelling techniques to support comprehensive data analysis and reporting.
  3. Implement and uphold best practices in data governance, security, and compliance, using tools like Azure Purview, Unity Catalog, and Apache Atlas to maintain data integrity and trust.
  4. Ensure data quality and integrity through meticulous attention to detail and rigorous QA processes, continually refining and optimising data queries for performance and cost-efficiency.
  5. Develop intuitive and visually compelling Power BI dashboards that provide actionable insights to stakeholders across the organisation.
  6. Monitor and tune solution performance, identifying opportunities for optimisation to enhance the reliability, speed, and functionality of data systems.
  7. Stay ahead of industry trends and advancements, continuously enhancing your skills and incorporating the latest Data Engineering tools, languages, and methodologies into your work.
Requirements

To succeed in this role, you will need:

  • Proficiency in SQL and Python: You are highly proficient in SQL and Python, enabling you to handle complex data problems with ease.
  • Understanding of Data Lakehouse Architecture: You have a strong grasp of the principles and implementation of Data Lakehouse architecture.
  • Hands-On Experience with Spark-Based Solutions: You possess experience with Spark-based platforms like Azure Synapse, Databricks, Microsoft Fabric, or even on-premise Spark clusters, using PySpark or Spark SQL to manage and process large datasets.
  • Expertise in Building ETL and ELT Pipelines: You are skilled in building robust ETL and ELT pipelines, mostly in Azure, utilising Azure Data Factory and Spark-based solutions to ensure efficient data flow and transformation.
  • Efficiency in Query Writing: You can craft and optimise queries to be both cost-effective and high-performing, ensuring fast and reliable data retrieval.
  • Experience in Power BI Dashboard Development: You possess experience in creating insightful and interactive Power BI dashboards that drive business decisions.
  • Proficiency in Dimensional Modelling: You are adept at applying dimensional modelling techniques, creating efficient and effective data models tailored to business needs.
  • CI/CD Mindset: You naturally work within Continuous Integration and Continuous Deployment (CI/CD) environments, ensuring automated builds, deployments, and unit testing are integral parts of your development workflow.
  • Business Requirements Translation: You have a knack for understanding business requirements and translating them into precise technical specifications that guide data solutions.
  • Strong Communication Skills: Ability to effectively translate complex technical topics into clear, accessible language for non-technical audiences
  • Continuous Learning and Development: Commitment to continuous learning and professional development, staying up to date with the latest industry trends, tools, and technologies.

This role will require you to have or be willing to go through Security Clearance. As part of the onboarding process candidates will be asked to complete a Baseline Personnel Security Standard; details of the evidence required to apply may be found on the government website Gov.UK.

  • Data Engineer

    4 weeks ago

    London, Greater London, United Kingdom Data Idols Full time

    Job Opportunity:The company Data Idols is seeking a skilled Full-stack Data Engineer to assist in modernising data pipelines, data standards and data reports for a national software company that helps the public sector build better data solutions.The Opportunity:As a Full-stack Engineer, you will be responsible for improving data structures, pipelines and...

  • Data Solutions Architect

    4 weeks ago

    London, Greater London, United Kingdom Data Intellect Full time

    Job Title: Data Solutions ArchitectJob Summary:Data Intellect is seeking an experienced Data Solutions Architect to lead our Databricks practice. The ideal candidate will have a strong background in data engineering, architecture, and cloud-based data processing.Key Responsibilities:Develop and lead the Databricks practice, establishing it as a key offering...

  • Data Solutions Engineer

    1 week ago

    London, Greater London, United Kingdom Data Science Festival Full time

    About Data Science FestivalData Science Festival is a renowned organization that harnesses the power of data to drive business decisions. We are seeking a highly skilled Data Solutions Architect to join our team and contribute to the design and architecture of our data solutions.The OpportunityAs a Data Solutions Architect, you will play a critical role in...

  • Data Solutions Architect

    4 weeks ago

    London, Greater London, United Kingdom Data Idols Full time £80,000 - £100,000

    Data Solutions ArchitectAt Data Idols, we're seeking a skilled Data Solutions Architect to join our team. As a key member of our data architecture team, you will be responsible for designing and implementing data solutions that drive business decisions.The OpportunityYou will collaborate with our partners to develop future roadmaps for data tools and...

  • Data Solutions Architect Lead

    2 weeks ago

    London, Greater London, United Kingdom NTT DATA Full time

    NTT DATA seeks a seasoned professional to spearhead its data architecture efforts.Job OverviewA unique opportunity has arisen for an experienced Data Solutions Architect Lead to join our dynamic team in a remote-first environment. This role entails designing and delivering cloud-based data solutions utilizing best-in-class RDBMS, ETL/ELT, and Cloud platforms...

  • IDAM Solutions Engineer

    3 weeks ago

    London, Greater London, United Kingdom NTT DATA Full time

    About the RoleWe're seeking an experienced IDAM Solutions Engineer to join our team at NTT DATA. As an IDAM Solutions Engineer, you will be responsible for designing, implementing, and managing identity and access management solutions for our clients.Key Responsibilities- Design and implement IDAM solutions to meet client requirements- Collaborate with...

  • Data Engineer Specialist

    1 month ago

    London, Greater London, United Kingdom Data Idols Full time

    Data Engineer Role OverviewData Idols is working with a national software company that helps the public sector build better data solutions. They are looking for a Full-stack Data Engineer contractor to join them for an initial three months to assist in modernising data pipelines, data standards and data reports.As a Full-stack Engineer, you will be...

  • Data Science Engineer

    1 week ago

    London, Greater London, United Kingdom Applied Data Science Partners Full time

    At Applied Data Science Partners, we're pushing the boundaries of data science and AI consultancy. As a Senior Software Engineer, you'll play a pivotal role in driving our clients' success.The OpportunityWe're seeking a seasoned professional with a passion for delivering high-quality data engineering solutions. Your duties will include:Developing and...

  • Senior Data Engineer

    4 weeks ago

    London, Greater London, United Kingdom Data Idols Full time

    About the RoleData Idols is seeking a highly skilled Senior Data Engineer to join their team. As a key member of the data team, you will be responsible for designing and implementing data pipelines and data warehousing solutions using Azure and Spark.The OpportunityThis is an exciting opportunity for a talented Data Engineer to play a key role in driving...

  • Data Solutions Architect

    3 weeks ago

    London, Greater London, United Kingdom Monte Carlo Data, Inc. Full time

    About Monte CarloMonte Carlo is a pioneer in the data reliability space, providing a cutting-edge Data Observability platform that empowers businesses to make informed decisions with confidence. By partnering with Monte Carlo, you'll be at the forefront of a revolution that's changing the way organizations approach data.Your RoleWe're seeking a skilled Sales...

  • Data Solutions Expert

    1 week ago

    London, Greater London, United Kingdom Data Science Festival Full time

    Job Overview:Data Science Festival is seeking a highly skilled Data Solutions Expert to drive the design of solutions supporting business decisions. As a key member of our team, you will provide expert guidance on data architecture and collaborate with partners to shape future roadmaps for data tools.The Role:We are looking for someone with expertise in...

  • Cloud Data Solutions Expert

    3 days ago

    London, Greater London, United Kingdom Data Science Festival Full time

    Data Engineer Job DescriptionWe are seeking a highly skilled Data Engineer to join our team at Data Science Festival. This is a full-time, fully remote opportunity with an estimated salary range of £80,000 - £110,000 per annum.In this role, you will be responsible for designing, implementing, and maintaining large-scale data pipelines using AWS services....

  • Data Strategist

    1 week ago

    London, Greater London, United Kingdom Monte Carlo Data, Inc. Full time

    About Monte Carlo Data, Inc.A data reliability company that's mission-critical for businesses to power digital products and drive better decision-making. Our end-to-end Data Observability platform has been recognized as a Best Workplace for 2024, a DBTA Readers Choice for Best Data Observability Solution for 2024, a G2 Best Product for 2023, and the 'New...

  • Senior Data Engineer

    3 weeks ago

    London, Greater London, United Kingdom Data Idols Full time £75,000 - £95,000

    Data Engineering Role at Data IdolsJoin Data Idols, a renowned retail brand in the UK, as a Senior Data Engineer and contribute to the delivery of data transformation during an exciting period of growth. The ideal candidate will have extensive experience in building and maintaining data pipelines and collaborating with cross-functional data teams.About the...

  • Data Systems Engineer

    3 weeks ago

    London, Greater London, United Kingdom Data Privacy Full time

    About the Role:We are seeking a skilled Data Systems Engineer to join our team at Houseful.Key Responsibilities:Design and implement data warehousing solutions using AWS technologies.Collaborate with senior engineers to ensure data accuracy and implement validation checks.Develop and maintain ETL/ELT pipelines, ensuring alignment with business...

  • Data Engineer

    4 weeks ago

    London, Greater London, United Kingdom NTT DATA Full time

    Job Summary We are seeking an experienced Data Engineer to join our Anti-Financial Crime Technology team at NTT DATA. The ideal candidate will have a strong background in big data related technologies, including Hadoop and Elastic Search. Key Responsibilities: Analyzing large datasets and designing scalable data ingestion workflows Working closely with team...

  • Data Engineer

    1 week ago

    London, Greater London, United Kingdom Data Privacy Full time

    About UsHouseful is a leading property technology company known for its innovative approach to the property market. With brands like Zoopla, Alto, Hometrack, Calcasa, Mojo, and Prime location, we leverage software, data, and insights to drive progress in the industry.Company OverviewWe're committed to helping everyone make informed decisions about their...

  • Data Engineer for Digital Transformation

    1 week ago

    London, Greater London, United Kingdom Data Idols Full time

    Senior Data Platform EngineerWe are seeking a highly skilled Data Engineer to join our team at Data Idols. As a key member of our data platforms group, you will play a vital role in shaping the data landscape and contribute to data-driven decision-making.The OpportunityIn this exciting role, you will be responsible for designing, implementing, and...

  • Data Solutions Engineer

    1 month ago

    London, Greater London, United Kingdom GT Nexus Full time

    As a key contributor to the Go To Market team at GT Nexus, you will be the technical content solutions engineer responsible for deeply understanding your client's data content needs and creating solutions that exceed their expectations. Working with sales counterparts, you'll help acquire new customers, expand relationships, and drive market share and...

  • Senior Data Engineering Specialist

    3 weeks ago

    London, Greater London, United Kingdom Data Science Festival Full time

    Senior Data EngineerAt Data Science Festival, we are seeking an experienced Senior Data Engineer to join our team. As a key member of our data function, you will be responsible for building and maintaining high-quality data solutions to support our data-driven decision-making processes.Key responsibilities include:Designing and implementing data pipelines...