Data Engineer

1 month ago

Manchester, United Kingdom CV-Library Full time

Data Engineer

Manchester (Hybrid working available)

Perm

Up to £60,000pa

You will be working in the Data Engineering team whose main function is developing maintaining and improving the end-to-end data pipeline that includes real-time data processing; extract, transform load jobs artificial intelligence and data analytics on a complex and large dataset.

Your role will primarily be to perform DevOps backend and cloud development on the data infrastructure to develop innovative solutions to effectively scale and maintain the data platform. You will be working on complex data problems in a challenging and fun environment using some of the latest Big Data open-source technologies like Apache Spark as well as Amazon Web Service technologies including Elastic MapReduce Athena and Lambda to develop scalable data solutions.

Key responsibilities include but are not limited to:

*

Adhering to Company Policies and Procedures with respect to Security Quality and Health & Safety.

*

Writing application code and tests that conform to standards.

*

Developing infrastructure automation and scheduling scripts for reliable data processing.

*

Continually evaluating and contribute towards using cutting-edge tools and technologies to improve the design architecture and performance of the data platform.

*

Supporting the production systems running the deployed data software.

*

Regularly reviewing colleagues work and providing helpful feedback.

*

Working with stakeholders to fully understand requirements.

*

Be the subject matter expert for the data platform and supporting processes and be able to present to others to knowledge share.

Skills and experience required:

Essential:

*

The ability to problem solve

*

Knowledge of AWS or equivalent cloud technologies

*

Knowledge of Serverless technologies frameworks and best practices

*

Experience using AWS CloudFormation or Terraform for infrastructure automation

*

Knowledge of Scala or OO language such as Java or C#

*

SQL or Python development experience

*

High-quality coding and testing practices

*

Willingness to learn new technologies and methodologies

*

Knowledge of agile software development practices including continuous integration automated testing and working with software engineering requirements and specifications

*

Good interpersonal skills positive attitude willing to help other members of the team

*

Experience debugging and dealing with failures on business-critical systems.

Preferable:

*

Exposure to Apache Spark Apache Trino or another big data processing system.

*

Knowledge of streaming data principles and best practices

*

Understanding of database technologies and standards

*

Experience working on large and complex datasets

*

Exposure to Data Engineering practices used in Machine Learning training and inference

*

Experience using Git Jenkins and other CI/CD tools

  • Data Engineer

    1 month ago

    Manchester, United Kingdom Data Privacy Full time

    WEX Europe Services Ltd, a rapidly expanding business with offices across Europe and the US, is seeking a skilled Data Engineer to connect data with the rest of the organization. As a Data Engineer at WEX, you will work with stakeholders to meet business needs using SQL-first transformation workflows.This role involves creating optimized data pipelines,...

  • Data Insights Specialist

    1 week ago

    Manchester, United Kingdom Data Privacy Full time

    About UsWe are First Central Insurance & Technology Group, a market-leading insurance company driven by innovation and data expertise. Our technology and data teams work together to deliver cutting-edge solutions that drive business success.Job DescriptionWe are seeking a skilled Data Business Analyst to join our team. The successful candidate will be...

  • Data Warehouse Developer

    2 months ago

    Manchester, United Kingdom Data Idols Full time €75,000 - €80,000

    Data Warehouse Architect Data Idols are working with one of the largest entertainment organisations growing rapidly within their global operations. With innovation, creativity, and data at the company's heart, they are looking for a Data Warehouse Architect to join the team. As a Data Warehouse Architect you will be responsible for improvements and...

  • Data Warehouse Developer

    2 months ago

    Manchester, United Kingdom Data Idols Full time €75,000 - €80,000

    Data Warehouse Architect Data Idols are working with one of the largest entertainment organisations growing rapidly within their global operations. With innovation, creativity, and data at the company's heart, they are looking for a Data Warehouse Architect to join the team. As a Data Warehouse Architect you will be responsible for improvements and...

  • Data Warehouse Architect

    1 month ago

    Manchester, United Kingdom Data Science Festival Full time

    Data Warehouse ArchitectData Science Festival is seeking a Data Warehouse Architect to join their team. As a key member of the Data Engineering department, you will be responsible for designing and implementing data warehouses that meet the needs of the organization.Key responsibilities include:Designing and implementing data warehousesWorking closely with...

  • Data Business Analyst

    1 month ago

    Manchester, United Kingdom Data Privacy Full time

    Data Business Analyst - 12 Month Fixed Term ContractWe're seeking a talented Data Business Analyst to join our dynamic Data & Analytics team on a 12 month Fixed Term Contract. As a critical team member, you'll ensure we really understand our internal customer's needs and deliver huge value for the business via innovative data solutions.Key...

  • Data Engineer

    2 months ago

    Manchester, United Kingdom CV-Library Full time

    Data Engineer - Manchester - £35,000 - £40,000 - Hybrid Working My client is hiring a full time Data Engineer to contribute to their expanding data science and analytics initiatives. Your role involves designing, building, and maintaining data pipelines, ensuring seamless data flow into their central Microsoft Azure repository. Collaborate with...

  • Data Engineer

    4 weeks ago

    Manchester, United Kingdom Circle Recruitment Full time

    Data Engineer - Circle RecruitmentCircle Recruitment is seeking a skilled Data Engineer to join our team and contribute to the development of our data platform. As a key member of our data team, you will be responsible for designing, implementing, and maintaining our data pipeline, ensuring the accurate and efficient processing of large datasets.About the...

  • Data Engineer

    3 days ago

    Manchester, United Kingdom Brio Digital | Certified B Corp Full time

    Job Description Job Title: Data Engineer Location: Hybrid/Manchester Rate: £350/day Inside Ir35 Duration: 3m to begin with About Us: Brio Digital are currently supporting a public sector consultancy who are currently looking for a skilled Data Engineer with a lot of experience with R, Shiny & Databricks. Role Overview: As a Databricks Engineer,...

  • Data Engineer

    4 days ago

    Manchester, United Kingdom Brio Digital | Certified B Corp Full time

    Job Title: Data EngineerLocation: Hybrid/ManchesterRate: £350/day Inside Ir35Duration: 3m to begin withAbout Us:Brio Digital are currently supporting a public sector consultancy who are currently looking for a skilled Data Engineer with a lot of experience with R, Shiny & Databricks. Role Overview:As a Databricks Engineer, you will design, develop, and...

  • Data Engineer

    3 months ago

    Manchester, United Kingdom Axiom Software Solutions Limited Full time

    Develop exploit and maintain dataproducts. Data Engineering teams are responsible for the deliveryand operational stability of the data products built and provideongoing support for those products. Data Engineers work within andcontribute to the overall data development lifecycle process aspart of multifunctional Agile delivery teams focused on one or...

  • Data Engineer

    1 month ago

    Manchester, United Kingdom Maxwell Bond Full time €70,000

    I'm searching for a Data Engineer Manchester based: Hybrid Up to £70,000 salary Are you a Data Engineer with over 3 years' experience looking for a new challenge? I'm working with an innovative Legal services company who have represented hundreds of thousands of clients vs large organisations. What's in it for the successful Data Engineer: Joining a...

  • Data Engineer

    1 month ago

    Manchester, United Kingdom Maxwell Bond Full time

    I'm searching for a Data EngineerManchester based: Hybrid Up to £70,000 salaryAre you a Data Engineer with over 3 years' experience looking for a new challenge?I'm working with an innovative Legal services company who have represented hundreds of thousands of clients vs large organisations.What's in it for the successful Data Engineer:Joining a growing data...

  • Data Engineer

    1 month ago

    Manchester, United Kingdom Maxwell Bond Full time

    I'm searching for a Data EngineerManchester based: Hybrid Up to £70,000 salaryAre you a Data Engineer with over 3 years' experience looking for a new challenge?I'm working with an innovative Legal services company who have represented hundreds of thousands of clients vs large organisations.What's in it for the successful Data Engineer:Joining a growing data...

  • Data Engineer

    1 month ago

    Manchester, United Kingdom Maxwell Bond Full time

    I'm searching for a Data EngineerManchester based: Hybrid Up to £70,000 salaryAre you a Data Engineer with over 3 years' experience looking for a new challenge?I'm working with an innovative Legal services company who have represented hundreds of thousands of clients vs large organisations.What's in it for the successful Data Engineer:Joining a growing data...

  • Data Engineer

    1 month ago

    Manchester, United Kingdom Maxwell Bond Full time €70,000

    I'm searching for a Data Engineer Manchester based: Hybrid Up to £70,000 salary Are you a Data Engineer with over 3 years' experience looking for a new challenge? I'm working with an innovative Legal services company who have represented hundreds of thousands of clients vs large organisations. What's in it for the successful Data Engineer: Joining a...

  • Data Engineer

    1 month ago

    Manchester, United Kingdom Maxwell Bond Full time

    I'm searching for a Data Engineer Manchester based: Hybrid Up to £70,000 salary Are you a Data Engineer with over 3 years' experience looking for a new challenge? I'm working with an innovative Legal services company who have represented hundreds of thousands of clients vs large organisations. What's in it for the successful Data Engineer: Joining a...

  • Data Engineer

    1 month ago

    Manchester, United Kingdom PSD Technology Contracts Ltd. Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer to join our team at PSD Technology Contracts Ltd. in Manchester. As a Data Engineer, you will play a pivotal role in designing, implementing, and maintaining our data infrastructure. You will lead a small team and work closely with business stakeholders to ensure the availability, reliability, and...

  • Data Engineer

    2 weeks ago

    Manchester, United Kingdom Searchability® Full time

    Job Description Data Engineer Opportunity for a Data Engineer to join a market leading Software Development service Salary up to 55,000 + fantastic benefits including our Inclusive working culture, Private Medical Insurance and Tech Loan Scheme and more Apply online or contact Chelsea Hackett via WHO WE ARE: We provide businesses with tools to...

  • Data Engineer

    2 weeks ago

    Manchester, United Kingdom Searchability® Full time

    Data EngineerOpportunity for a Data Engineer to join a market leading Software Development serviceSalary up to 55,000 + fantastic benefits including our Inclusive working culture, Private Medical Insurance and Tech Loan Scheme and moreApply online or contact Chelsea Hackett via Chelsea.hackett@searchability.comWHO WE ARE:We provide businesses with tools to...