Data Specialist Engineer
1 month ago
Role Title: Data Specialist Engineer
Possibility of remote work: NO | Hybrid 3 days in the office
Contract duration: 6 months
Location: London
Required Core Skills:
• Databricks
• Azure Data Factory
• Spark, Scala
• Azure DevOps/GIT Repo
• Azure Artifact and CI/CD using Azure Pipelines
• End to End Release and Branching strategies
Minimum years of experience: 6 years
Areas of responsibility:
• Stake holder management skills
• Nice to have energy trading experience
• Team Handling
Detailed Job Description:
• Write, and maintain build pipelines for enabling CI for seamless code builds, packaging, and unit tests.
• Develop, deploy and maintain data pipelines and custom libraries required for Common Data Model (CDM) conformance.
• Enhance the PR review process by implementing automatic build validation checks, automatic approval process, etc.
• Enhance the code and test coverage reports as part of build pipelines to ensure continuous improvement of code quality.
• Design, develop and deliver large scale data pre-ingestion, ingestion and data transformation use-cases on Azure Data Hub.
• Deploy and maintain reliable and scalable data infrastructure needed in data ingestion pipelines development stage.
• Implement data transformation pipelines in line with provided mapping document, using Azure Data Factory and Databricks to deliver data in enriched layer to a target CDM model.
• Build and deploy enriched and curated views for delivering analytical and business value out of various transactional and reference data sources.
• Assist with the configuration and setup of Power BI reports
-
Data Engineer
4 weeks ago
City of London, United Kingdom Data Idols Full time**Senior Data Engineer** Data Idols are proud to be working with an iconic UK brand to assist them in hiring a Senior Data Engineer as they undertake a digital and data-driven journey that will transform the business. Data is at the heart of the organisation and forms a key partof their future plans. **The Opportunity** As a Senior Data Engineer you will be...
-
Senior Engineer, Data Engineering
2 weeks ago
London, United Kingdom Data Idols Full timeSenior Data Engineer Location: London (Hybrid) Data Idols are working with one of the fast-growing companies in the logistics sector that are making the world a greener place. They are looking for a Senior Data Engineer to join their team within the Data Space. As a Senior Data Engineer, you will work alongside different data teams to design,...
-
Senior Engineer, Data Engineering
2 weeks ago
London, United Kingdom Data Idols Full timeSenior Data Engineer Location: London (Hybrid) Data Idols are working with one of the fast-growing companies in the logistics sector that are making the world a greener place. They are looking for a Senior Data Engineer to join their team within the Data Space. As a Senior Data Engineer, you will work alongside different data teams to design,...
-
Gcp Data Engineer
4 weeks ago
London, United Kingdom Data Idols Full time**GCP Data Engineer** Would you like to build enterprise scale data solutions for a global organisation that reaches 400 million users monthly? As a GCP Data Engineer, you will be involved in delivering solutions from initial concept to production. **The Opportunity** Working for a well known brand you will be responsible for all aspects of the data...
-
Lead Engineer/Data Engineer
1 month ago
London, United Kingdom Abs Data Full timeLead Data Engineer Do you enjoy creating valuable insights with data? Do you want to play a key role in transforming our firm into an agile organization? Being agile will make us more responsive, more adaptable, and ultimately more innovative. We’re looking for a Data Engineer to: ~ transform data into valuable insights that inform business...
-
Lead Data Engineer
4 weeks ago
City of London, United Kingdom Data Idols Full time**Lead Data Engineer** Data Idols are proud to be working with an iconic UK brand to assist them in hiring a Lead Data Engineer as they undertake a digital and data-driven journey that will transform the business. Data is at the heart of the organisation and forms a key part oftheir future plans. **Skills and Experience**: - Awareness and understanding of...
-
Data Entry Clerk Specialist
1 week ago
London, United Kingdom DATA WORLD Full time**Key Responsibilities**: - Enter data accurately and efficiently into the company's database system. - Verify data for accuracy and completeness. - Maintain confidentiality of sensitive data and adhere to data entry and security policies. - Ensure data entry procedures are followed correctly. - Identify and resolve any data entry errors or discrepancies. -...
-
Data Software Engineer | Python
1 month ago
London, United Kingdom Abs Data Full timeRegulatory Reporting, Big Data Software Engineer We’re looking for software engineers to: provide technology solutions that will solve business problems and strengthen our position as digital leaders in financial services work with our Regulatory Reporting team to translate business and external regulatory needs using Behavior Driven Development...
-
Data Engineer
4 weeks ago
London, United Kingdom Harnham - Data & Analytics Recruitment Full time**DATA ENGINEERING £70,000 - £80,000 + BONUS FLEXIBLE - LONDON** Are you a Data Engineer with a strong background in Data Engineering supporting the Data Analytics and Data Science team? Want to become part of a growing insurance company going through some exciting new changes? Read on! **THE COMPANY**: Harnham is partnered with an exciting insurance...
-
Temporary Data Analyst/Excel specialist
14 minutes ago
London, United Kingdom Hays Specialist Recruitment Full timeWe are seeking an experienced and knowledgeable RTT Validation Specialist/Data Analyst to join our team. The successful candidate will be responsible for providing specialist RTT knowledge and support to ensure the accuracy and quality of patient pathways. You will be expected to validate complex pathways, identify key data quality metrics and trends, and...
-
Data Engineer
4 weeks ago
London, United Kingdom Harnham - Data & Analytics Recruitment Full timeDATA ENGINEER **Salary: £50,000 - £70,000** **LONDON** This is an extremely technically driven company offering many benefits. They are data-driven and are situated globally, streaming, and using data to best help their customer. **THE COMPANY** This global data company is heavily driven by Data and Analytics and is looking for a Data Engineer to...
-
Data Engineering Lead Engineer
1 week ago
London, United Kingdom ON Data Staffing Full timeWe are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer. As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...
-
Data Engineer
1 month ago
London, United Kingdom Open Data Science Conferenc Full timeYou have prior experience as a data engineer, software engineer, or data architect. You are experienced in designing and production of solutions for complex problems. You thrive in a fast-paced, start-up environment. You seek to continuously improve processes and find the most optimal way to solve problems. You can work remotely and independently,...
-
Data Engineer
1 month ago
London, United Kingdom Abs Data Full timeData Engineer/Analyst Risk & Margin We’re looking for a software engineer to: provide technology solutions that will solve business problems in the Risk and Margin space work with risk managers to translate business needs using Behavior Driven Development (BDD) into functional requirements. Key to success will be the ability to understand the data...
-
Data Engineering Specialist
4 weeks ago
London, United Kingdom TPXimpact Full timeTPXimpact is expanding their Data Engineering Capability to continue to deliver real impact by ensuring our clients have access to the right information, at the right time, and in the right format to support them in making great decisions that in turn drive positive impact. We aim to achieve this by balancing profit and purpose, delivering projects with...
-
City of London, United Kingdom Hays Specialist Recruitment Limited Full timePharmacovigilance Data Acquisition Specialist - 12-month contract - Top Pharma My client a top pharmaceutical company is looking for a Pharmacovigilance Data Acquisition Specialist to join their Pharmacovigilance team on an initial 12-month contract. INSIDE IR35 PAYE - £40 - 45 P/H As the Pharmacovigilance Data Acquisition Specialist you will be responsible...
-
Data Specialist
1 month ago
Greater London, United Kingdom Selby Jennings Full timeOur client is a prestigious global investment management firm, seeking a skilled software/data engineer to fill the role of Data Scraping Specialist.Role Overview:As a Data Scraping Specialist, you'll play a vital role in developing and maintaining web scraping tools to curate datasets crucial for research and trading purposes. Your responsibilities will...
-
Senior Engineer, Data Engineering
1 month ago
London, United Kingdom Open Data Science Conferenc Full timeYou have prior experience as a data engineer, software engineer, or data architect. You can work remotely and independently, taking ownership of your work. You have proven English language communication skills that enable you to collaborate in a remote-first company with a diverse international workforce. Experience with Java11+ for ingesting,...
-
Java Data Engineer
1 month ago
London, United Kingdom Harnham - Data & Analytics Recruitment Full time**DATA ENGINEER £70,000 - £80,000 + BONUS REMOTE** Are you a Data Engineer with a strong background in Data Engineering looking for an exciting challenge? Want to become part of an exciting start-up in the telecoms industry as a Data Engineer? Read on! **THE COMPANY**: Harnham has partnered with an exciting Start-Up who thanks to their success, are...
-
Lead Data Engineer
4 weeks ago
London, United Kingdom Harnham - Data & Analytics Recruitment Full time**LEAD DATA ENGINEER** **£100,000 - £110,000 + EQUITY** **LONDON - HYBRID** This role is with a rapidly growing FinTech Scale up who are looking to build out their data engineering team. They are looking to hire a Lead Data Engineer to work closely with the Engineering Manager and Architects to take their data platform & capabilityto the next...