Data Specialist Engineer

1 month ago


London, United Kingdom N Consulting Ltd Full time

Role Title: Data Specialist Engineer

Possibility of remote work: NO | Hybrid 3 days in the office
Contract duration: 6 months
Location: London

Required Core Skills:
• Databricks
• Azure Data Factory
• Spark, Scala
• Azure DevOps/GIT Repo
• Azure Artifact and CI/CD using Azure Pipelines
• End to End Release and Branching strategies
Minimum years of experience: 6 years

Areas of responsibility:
• Stake holder management skills
• Nice to have energy trading experience
• Team Handling

Detailed Job Description:
• Write, and maintain build pipelines for enabling CI for seamless code builds, packaging, and unit tests.
• Develop, deploy and maintain data pipelines and custom libraries required for Common Data Model (CDM) conformance.
• Enhance the PR review process by implementing automatic build validation checks, automatic approval process, etc.
• Enhance the code and test coverage reports as part of build pipelines to ensure continuous improvement of code quality.
• Design, develop and deliver large scale data pre-ingestion, ingestion and data transformation use-cases on Azure Data Hub.
• Deploy and maintain reliable and scalable data infrastructure needed in data ingestion pipelines development stage.
• Implement data transformation pipelines in line with provided mapping document, using Azure Data Factory and Databricks to deliver data in enriched layer to a target CDM model.
• Build and deploy enriched and curated views for delivering analytical and business value out of various transactional and reference data sources.
• Assist with the configuration and setup of Power BI reports


  • Data Engineer

    4 weeks ago


    City of London, United Kingdom Data Idols Full time

    **Senior Data Engineer** Data Idols are proud to be working with an iconic UK brand to assist them in hiring a Senior Data Engineer as they undertake a digital and data-driven journey that will transform the business. Data is at the heart of the organisation and forms a key partof their future plans. **The Opportunity** As a Senior Data Engineer you will be...


  • London, United Kingdom Data Idols Full time

    Senior Data Engineer Location: London (Hybrid) Data Idols are working with one of the fast-growing companies in the logistics sector that are making the world a greener place. They are looking for a Senior Data Engineer to join their team within the Data Space. As a Senior Data Engineer, you will work alongside different data teams to design,...


  • London, United Kingdom Data Idols Full time

    Senior Data Engineer Location: London (Hybrid) Data Idols are working with one of the fast-growing companies in the logistics sector that are making the world a greener place. They are looking for a Senior Data Engineer to join their team within the Data Space. As a Senior Data Engineer, you will work alongside different data teams to design,...

  • Gcp Data Engineer

    4 weeks ago


    London, United Kingdom Data Idols Full time

    **GCP Data Engineer** Would you like to build enterprise scale data solutions for a global organisation that reaches 400 million users monthly? As a GCP Data Engineer, you will be involved in delivering solutions from initial concept to production. **The Opportunity** Working for a well known brand you will be responsible for all aspects of the data...


  • London, United Kingdom Abs Data Full time

    Lead Data Engineer Do you enjoy creating valuable insights with data? Do you want to play a key role in transforming our firm into an agile organization? Being agile will make us more responsive, more adaptable, and ultimately more innovative. We’re looking for a Data Engineer to: ~ transform data into valuable insights that inform business...

  • Lead Data Engineer

    4 weeks ago


    City of London, United Kingdom Data Idols Full time

    **Lead Data Engineer** Data Idols are proud to be working with an iconic UK brand to assist them in hiring a Lead Data Engineer as they undertake a digital and data-driven journey that will transform the business. Data is at the heart of the organisation and forms a key part oftheir future plans. **Skills and Experience**: - Awareness and understanding of...


  • London, United Kingdom DATA WORLD Full time

    **Key Responsibilities**: - Enter data accurately and efficiently into the company's database system. - Verify data for accuracy and completeness. - Maintain confidentiality of sensitive data and adhere to data entry and security policies. - Ensure data entry procedures are followed correctly. - Identify and resolve any data entry errors or discrepancies. -...


  • London, United Kingdom Abs Data Full time

    Regulatory Reporting, Big Data Software Engineer We’re looking for software engineers to: provide technology solutions that will solve business problems and strengthen our position as digital leaders in financial services work with our Regulatory Reporting team to translate business and external regulatory needs using Behavior Driven Development...

  • Data Engineer

    4 weeks ago


    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **DATA ENGINEERING £70,000 - £80,000 + BONUS FLEXIBLE - LONDON** Are you a Data Engineer with a strong background in Data Engineering supporting the Data Analytics and Data Science team? Want to become part of a growing insurance company going through some exciting new changes? Read on! **THE COMPANY**: Harnham is partnered with an exciting insurance...


  • London, United Kingdom Hays Specialist Recruitment Full time

    We are seeking an experienced and knowledgeable RTT Validation Specialist/Data Analyst to join our team. The successful candidate will be responsible for providing specialist RTT knowledge and support to ensure the accuracy and quality of patient pathways. You will be expected to validate complex pathways, identify key data quality metrics and trends, and...

  • Data Engineer

    4 weeks ago


    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    DATA ENGINEER **Salary: £50,000 - £70,000** **LONDON** This is an extremely technically driven company offering many benefits. They are data-driven and are situated globally, streaming, and using data to best help their customer. **THE COMPANY** This global data company is heavily driven by Data and Analytics and is looking for a Data Engineer to...


  • London, United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer. As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...

  • Data Engineer

    1 month ago


    London, United Kingdom Open Data Science Conferenc Full time

    You have prior experience as a data engineer, software engineer, or data architect. You are experienced in designing and production of solutions for complex problems. You thrive in a fast-paced, start-up environment. You seek to continuously improve processes and find the most optimal way to solve problems. You can work remotely and independently,...

  • Data Engineer

    1 month ago


    London, United Kingdom Abs Data Full time

    Data Engineer/Analyst Risk & Margin We’re looking for a software engineer to: provide technology solutions that will solve business problems in the Risk and Margin space work with risk managers to translate business needs using Behavior Driven Development (BDD) into functional requirements. Key to success will be the ability to understand the data...


  • London, United Kingdom TPXimpact Full time

    TPXimpact is expanding their Data Engineering Capability to continue to deliver real impact by ensuring our clients have access to the right information, at the right time, and in the right format to support them in making great decisions that in turn drive positive impact.  We aim to achieve this by balancing profit and purpose, delivering projects with...


  • City of London, United Kingdom Hays Specialist Recruitment Limited Full time

    Pharmacovigilance Data Acquisition Specialist - 12-month contract - Top Pharma My client a top pharmaceutical company is looking for a Pharmacovigilance Data Acquisition Specialist to join their Pharmacovigilance team on an initial 12-month contract. INSIDE IR35 PAYE - £40 - 45 P/H As the Pharmacovigilance Data Acquisition Specialist you will be responsible...

  • Data Specialist

    1 month ago


    Greater London, United Kingdom Selby Jennings Full time

    Our client is a prestigious global investment management firm, seeking a skilled software/data engineer to fill the role of Data Scraping Specialist.Role Overview:As a Data Scraping Specialist, you'll play a vital role in developing and maintaining web scraping tools to curate datasets crucial for research and trading purposes. Your responsibilities will...


  • London, United Kingdom Open Data Science Conferenc Full time

    You have prior experience as a data engineer, software engineer, or data architect. You can work remotely and independently, taking ownership of your work. You have proven English language communication skills that enable you to collaborate in a remote-first company with a diverse international workforce. Experience with Java11+ for ingesting,...

  • Java Data Engineer

    1 month ago


    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **DATA ENGINEER £70,000 - £80,000 + BONUS REMOTE** Are you a Data Engineer with a strong background in Data Engineering looking for an exciting challenge? Want to become part of an exciting start-up in the telecoms industry as a Data Engineer? Read on! **THE COMPANY**: Harnham has partnered with an exciting Start-Up who thanks to their success, are...

  • Lead Data Engineer

    4 weeks ago


    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **LEAD DATA ENGINEER** **£100,000 - £110,000 + EQUITY** **LONDON - HYBRID** This role is with a rapidly growing FinTech Scale up who are looking to build out their data engineering team. They are looking to hire a Lead Data Engineer to work closely with the Engineering Manager and Architects to take their data platform & capabilityto the next...