Senior Databricks Engineer

2 weeks ago

Birmingham, Birmingham, United Kingdom Version 1 Full time

Version 1 has celebrated over 26 years in Technology Services and continues to be trusted by global brands to deliver solutions that drive customer success.

Version 1 has several strategic technology partners including Microsoft, AWS, Oracle, Red Hat, OutSystems and Snowflake. We're also an award-winning employer reflecting how employees are at the heart of Version 1.

We've been awarded:

Innovation Partner of the Year Winner 2023 Oracle EMEA Partner Awards, Global Microsoft Modernising Applications Partner of the Year Award 2023, AWS Collaboration Partner of the Year - EMEA 2023 and Best Workplaces for Women by Great Place To Work in UK and Ireland 2023.

As a consultancy and service provider, Version 1 is a digital-first environment and we do things differently.

We're focused on our core values; using these we've seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion.

This creates new opportunities for driven and skilled individuals to join one of the fastest-growing consultancies globally.

Job Description

This is an exciting opportunity for an experienced developer of large-scale data solutions. You will join a team delivering a transformative cloud hosted data platform for a key Version 1 customer.


The ideal candidate will have a proven track record as a senior/self-starting data engineer in implementing data ingestion and transformation pipelines for large scale organisations.

We are seeking someone with deep technical skills in a variety of technologies, specifically SPARK performancetuningoptimisation and Databricks, to play an important role in developing and delivering early proofs of concept and production implementation.


You will ideally have experience in building solutions using a variety of open source tools & Microsoft Azure services, and a proven track record in delivering high quality work to tight deadlines.


Your main responsibilities will be:

nDesigning and implementing highly performant data ingestion & transformation pipelines from multiple sources using Databricks and SparknStreaming and Batch processes in DatabricksnSPARK performancetuningoptimisationnProviding technical guidance for complex geospatial problems and spark dataframesnDeveloping scalable and re-usable frameworks for ingestion and transformation of large data setsnData quality system and process design and implementation.nIntegrating the end to end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all timesnWorking with other members of the project team to support delivery of additional project components (Reporting tools, API interfaces, Search)nEvaluating the performance and applicability of multiple tools against customer requirementsnWorking within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints.

Qualifications


Direct experience of building data piplines using Azure Data Factory and Databricks Spark.nBuilding data integration with PythonnHands on experience designing and delivering solutions using the Azure Data Analytics platform.nExperience building data warehouse solutions using ETL / ELT tools like Informatica, Talend.nComprehensive understanding of data management best practices including demonstrated experience with data profiling, sourcing, and cleansing routines utilizing typical data quality functions involving standardization, transformation, rationalization, linking and matching.

Additional Information

Location:

This role can be delivered in a hybrid nature from one of these offices Dublin, Belfast, Birmingham, Manchester, Edinburgh or London.


At Version 1, we believe in providing our employees with a comprehensive benefits package that prioritises their well-being, professional growth, and financial stability.


One of our standout advantages is the ability to work with a hybrid schedule along with business travel, allowing our employees to strike a balance between work and life.

We also offer a range of tech-related benefits, including an innovative Tech Scheme to help keep our team members up-to-date with the latest technology.


We prioritise the health and safety of our employees, providing private medical and life insurance coverage, as well as free eye tests and contributions towards glasses.

Our team members can also stay ahead of the curve with incentivized certifications and accreditations, including AWS, Microsoft, Oracle, and Red Hat.

Our employee-designed Profit Share scheme divides a portion of our company's profits each quarter amongst employees.

We are dedicated to helping our employees reach their full potential, offering Pathways Career Development Quarterly, a programme designed to support professional growth.

  • Data Engineering Manager

    2 weeks ago

    Birmingham, Birmingham, United Kingdom Harnham - Data & Analytics Recruitment Full time

    DATA ENGINEERING MANAGERREMOTE (1x MONTH IN OFFICE) - NORTH LONDONUP TO £95,000THE COMPANYThis company is one of the world's leading aviation companies. They may be facing the biggest challenge in history, but they are confident that throughout the pandemic they have taken the right action to build back stronger and better - and they want youto play a part...

  • Azure Data Engineer

    2 weeks ago

    Birmingham, Birmingham, United Kingdom Langham Recruitment Full time

    Data Engineer (6-Month Contract) - £450 per day inside IR35 – Birmingham/Hybrid We are recruiting on behalf of a leading company dedicated to innovative solutions in waste management. As part of our ongoing commitment to excellence, we are currently seeking a skilled Data Engineer to join our Commercial Waste programme on a 6-month contract basis. Role...

  • Azure Data Engineer

    4 weeks ago

    Birmingham, Birmingham, United Kingdom Langham Recruitment Full time

    Data Engineer (6-Month Contract) - £450 per day inside IR35 – Birmingham/Hybrid We are recruiting on behalf of a leading company dedicated to innovative solutions in waste management. As part of our ongoing commitment to excellence, we are currently seeking a skilled Data Engineer to join our Commercial Waste programme on a 6-month contract basis. Role...

  • Senior Data Engineer

    2 weeks ago

    Birmingham, Birmingham, United Kingdom National Physical Laboratory Full time

    The UK Telecoms Lab (UKTL), announced in October 2022, will give the UK the cutting-edge technology to keep our telecommunications networks safe, accelerate the roll-out of 5G, and grow our brilliant telecoms sector by bringing in new entrants to diversify the supply chain market. As a member of the UKTL Lab & Test Networks team, you'll be accountable for...

  • Senior Electrical Engineer

    2 weeks ago

    Birmingham, Birmingham, United Kingdom RGB Recruitment Ltd Full time

    Senior Electrical Engineer Job In Birmingham Filter Jobs Senior Electrical Design Engineer Permanent Senior Electrical Design EngineerAre you l... Senior Electrical Design Engineer Permanent Senior Electrical Engineer Permanent Senior Electrical Design Engineer Permanent Senior Electrical Design EngineerAre you l... Senior Electrical Design Engineer...

  • Senior Engineer

    2 weeks ago

    Birmingham, Birmingham, United Kingdom Fawkes & Reece London Full time

    If you're a Senior Engineer with a background in Highways/Heavy civils based near Birmingham , this is the perfect opportunity for youOne of the leading engineering and construction companies in the UK and provide specialist multi-disciplinary expertise to a range of markets are looking for a Senior Engineer to join their Highways team in Birmingham.You will...

  • Senior Engineer

    2 weeks ago

    Birmingham, Birmingham, United Kingdom Fawkes & Reece London Full time

    If you're a Senior Engineer with a background in Highways/Heavy civils based near Birmingham , this is the perfect opportunity for you One of the leading engineering and construction companies in the UK and provide specialist multi-disciplinary expertise to a range of markets are looking for a Senior Engineer to join their Highways team in Birmingham. You...

  • Senior Data Analyst

    2 weeks ago

    Birmingham, Birmingham, United Kingdom Page Group Full time

    Senior Data Analyst | Predictive Analysis | Power BI | SQL | Data Science | 3 month contract | West Midlands | £450 per day | Outside IR35 Client Details A leading financial resolutions provider DescriptionSupporting the insight and data team and the wider business in understanding the information they have and driving the right measures that will lead to...

  • Senior Geotechnical Engineer

    2 weeks ago

    Birmingham, Birmingham, United Kingdom Penguin Recruitment Ltd Full time

    SEnior Geotechnical EngineerBirminghamAre you a Senior Geotechnical Engineer looking to increase the value of your CV? Working for one of the great Engineering Consultants is a career highlight for most Engineers. Exposure to working on the world's iconic projects is a major draw card as wellas working on a wide range of equally important mainstream...

  • Senior Engineering Geologist

    4 days ago

    Birmingham, Birmingham, United Kingdom Penguin Recruitment Full time

    Senior Engineering GeologistBirmingham£30,000 to £40,000 per Annum Are you looking for a role at an established ground investigation company based out of Birmingham? Are you looking for a role that offers the chance for first-class mentorship and a clear progression path even at a senior level?My client is a well-established ground investigation...

  • Senior Mechanical Engineer

    2 weeks ago

    Birmingham, Birmingham, United Kingdom RGB Recruitment Ltd Full time

    Senior Mechanical Engineer Job In Birmingham Filter Jobs Keywords Location Within (Miles) Sort By Category Salary From Salary To Job Type related jobs Senior Mechanical Design Engineer 90144000050000 Annually Permanent Birmingham Are you looking to take the next step in your Building Servi... Senior Mechanical Engineer 90064000050000 Annually ...

  • Senior Engineer

    2 weeks ago

    Birmingham, Birmingham, United Kingdom Conrad Consulting Ltd Full time £55,000 - £65,000

    Senior Structural EngineerOur client is in search of a seasoned senior structural engineer to become part of their team and handle captivating projects from inception to fruition.They boast a variety of longstanding clients and are on the lookout for an individual who is highly knowledgeable in the competitive realm of structural engineering.You will play a...

  • Senior Electrical Engineer

    2 weeks ago

    Birmingham, Birmingham, United Kingdom RGB Recruitment Ltd Full time

    Senior Electrical Engineer Job In Birmingham Filter Jobs Keywords Location Within (Miles) Sort By Category Salary From Salary To Job Type related jobs Senior Electrical Design Engineer 90134000050000 Annually Permanent Birmingham Senior Electrical Design EngineerAre you l... Senior Electrical Design Engineer 1005844200058000 Annually Permanent ...

  • Senior Planning Engineer

    2 weeks ago

    Birmingham, Birmingham, United Kingdom Gold Group Ltd Full time

    An exciting opportunity has arisen for an experienced Senior Planning Engineer with a background in the UK construction industry to join the expanding team of a dynamic main contractor who have a strong pipeline of projects across the Midlands.Scroll down the page to see all associated job requirements, and any responsibilities successful candidates can...

  • Senior Project Engineer

    2 weeks ago

    Birmingham, Birmingham, United Kingdom Hitachi ABB Power Grids Full time

    Senior Project Engineer - Auxiliary Power Systems & Equipment (Glasgow/Birmingham) Senior Project Engineer - Auxiliary Power Systems & Equipment (Glasgow/Birmingham) The HVDC - High Voltage Direct Current technology has been on the market for the past 60 years and is used, among other things, to transmit power over long distances & integrate renewables into...

  • Senior Engineer

    2 weeks ago

    Birmingham, Birmingham, United Kingdom VolkerFitzpatrick Limited Full time

    Senior Engineer at VolkerFitzpatrick VolkerFitzpatrick specializes in civil engineering, infrastructure, and building services, playing a crucial role in both high-profile national projects and essential works for various sectors. From highways and airports to commercial and educational buildings, we are deeply involved in shaping the nation's...

  • Senior Structural Engineer

    2 weeks ago

    Birmingham, Birmingham, United Kingdom Hunter Mason Consulting Ltd Full time £55,000 - £65,000

    Job Title: Senior Structural Engineer Are you a highly skilled and experienced Structural Engineer seeking a new challenge with a leading Civil Engineering Consultancy? If you possess a MICE qualification or are working towards it, and have a proven track record in the field of structural engineering, we want to hear from you. My client are a multi-sector...

  • Senior Engineer

    2 weeks ago

    Birmingham, Birmingham, United Kingdom RTL Group Ltd Full time

    My client is a specialist in the strucutres and civils sector and they are currently recrtuiting a site engineer for a major project they currently have in Birmingham. They are looking to bring on a senior engineer who has experience in bridges, frc and structures. Site engineer responsibilities: Site set up and setting out. As-built surveys. QA. Health...

  • Senior Electronic Engineer

    2 weeks ago

    Birmingham, Birmingham, United Kingdom KO2 Recruitment Full time

    Join to apply for the Senior Electronic Engineer role at KO2 Embedded Recruitment Solutions Ltd 2 days ago Be among the first 25 applicants Join to apply for the Senior Electronic Engineer role at KO2 Embedded Recruitment Solutions Ltd Save this job with your existing LinkedIn profile, or create a new one. Save this job with your existing LinkedIn...

  • Senior Structural Engineer

    2 weeks ago

    Birmingham, Birmingham, United Kingdom GCB Recruitment Full time

    We are currently looking for an experienced Senior Structural Engineer for our client's Multidiscipline Property and Construction Consultants in Birmingham. They specialise in many sectors, including hotels, hospitality and public buildings, and projectvalues in the multi-millions. They are also one of the top 10 surveyors in the Country.Working hours:As a...