Data Scraping Engineer

2 days ago


UK, UK, United Kingdom Digital Waffle Full time

Our client, a Software Engineering house, is now looking for their next Web Scraping Software Engineer to join their team. This employer has now been operational for over 20 years and have a strong team that covers both SaaS & Web Scraping projects.


The position is fully remote and is suitable for those that have experience or an interest in Web Scraping technologies.


Role: Web / Data Scraping Engineer (Software Engineer)

Location: Fully Remote

Salary: From £40,000 and up to £50,000 per annum


Required Experience:


  • Develop and Maintain Web Scrapers: Write, test, and maintain high-quality code for new web scrapers to extract data from target websites. Ensure these scrapers meet functional and technical requirements.
  • Support Data Acquisition Operations: Collaborate with the team to maintain data acquisition operations, adhering to SLAs. This includes fixing broken scrapers (e.g., due to website changes) and resolving data quality issues.
  • Test and Debug: Write and execute tests for code, troubleshoot, debug, and resolve software defects and issues.
  • Code Review and Documentation: Participate in code reviews and create and maintain comprehensive documentation for code.
  • Optimize and Analyze: Continuously improve scrapers for better performance, reliability, and accuracy. Analyze scraped data to ensure completeness and accuracy.


Required Skills:


  • PHP
  • Web scraping
  • Webdriver/Chromedriver
  • Guzzle


For further information on the role please apply, should you be suitable, one of our team will be in touch.


  • Full Stack Engineer

    1 month ago


    UK, UK, United Kingdom Hartford Advisers Full time

    Company DescriptionHartford is a corporate research and advisory firm specializing in enhanced due diligence and background screening. We provide critical information to clients during the commercial decision-making process by analyzing companies and their leadership teams ahead of - or during - transactions, partnerships, and appointments.Role...

  • Data Scientist

    2 months ago


    UK, UK, United Kingdom Bioscript Group Full time

    The RoleThe Senior Data Scientist supports the management, development and execution of the Data Insights Team by playing a pivotal role in helping shape our data strategy, designing, and implementing advanced data analytics solutions for the whole Bioscript Group.Key Responsibilities/Accountabilities Leadership and Strategy:Manage data scientists, providing...

  • Data Engineer

    3 months ago


    UK, UK, United Kingdom Eames Consulting Full time

    We are delighted to be working with a global speciality Insurance firm that are looking to expand there Pricing Data engineering team with an experienced Data engineer.Responsibilities:Build and maintain data pipelines in a Spark-based platform to support the Pricing function.Develop solutions that enhance Global Pricing’s data-driven approach, leveraging...


  • UK, UK, United Kingdom Vantage Data Centers Full time

    About Vantage Data CentersVantage is committed to being a workplace of inclusion, equity, respect and acceptance. We celebrate diversity and intentionally seek out opportunities to learn from one another’s experience.Vantage Data Centers powers, cools, protects and connects the technology of the world’s well-known hyperscalers, cloud providers and large...

  • Data Engineer

    4 weeks ago


    UK, UK, United Kingdom Next Phase Recruitment Full time

    Description‍The client is seeking software engineers with a strong background with Python programming and ideally a chemistry or material science background to develop domain-specific applications. Their goal is to revolutionize industrial research and development. They’re looking for motivated engineers who can help to build out tools that will...

  • Graduate Data Engineer

    3 months ago


    UK, UK, United Kingdom Oho Group Ltd Full time

    Graduate Data Engineer - Fast Growing FinTech - ex Facebook / Google A very fast scaling FinTech in London founded by ex Facebook and Google Engineer are looking for a talented Data Engineer to join their team. In this role as a Data Engineer you’ll work with extremely high calibre engineers and hit the ground running from day one, starting off with where...

  • Lead Data Engineer

    3 months ago


    UK, UK, United Kingdom Noir Full time

    Lead Data Engineer (Python, PySpark) - Remote(Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer, Python, PySpark, SQL, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI / CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Lead Data Engineer, Team Lead,...

  • Senior Data Engineer

    1 month ago


    UK, UK, United Kingdom Understanding Recruitment Full time

    Senior Data Engineer | 1x per month in the London office (flex)I am looking for a Senior Data Engineer to join a cutting edge start-up that’s leading the charge in IoT, and data-driven tech across Europe!They are revolutionising the automotive space with cutting-edge in-car technology, web apps, and APIs. To accelerate the building of their greenfield...

  • Senior Data Engineer

    2 weeks ago


    UK, UK, United Kingdom Understanding Recruitment Full time

    Senior Data Engineer | 1x per month/quarter in the London office (flex)I am looking for a Senior Data Engineer to join a cutting edge start-up that’s leading the charge in IoT, and data-driven tech across Europe!They are revolutionising the automotive space with cutting-edge in-car technology, web apps, and APIs. To accelerate the building of their...


  • UK, UK, United Kingdom The MWek Company Full time

    My client, a growing Fintech, is looking for a Financial Data Engineer to apply critical thinking and data engineering expertise to enhance our financial data systems and pipelines.Qualifications* Master’s degree in Computer Science, Data Engineering, Quantitative Finance, or a related technical field* A minimum of 1 year of experience is required, with...

  • Lead Data Engineer

    2 months ago


    UK, UK, United Kingdom Head Resourcing Full time

    Lead Data Engineer - £75k plus bonus & benefits - hybrid 2 days in ManchesterAn exciting opportunity has arisen to join this leading household name, based in Manchester city centre (hybrid).The role will be critical in delivering and ensuring data quality, consistency, and reliability working closely with other data engineers in the team as well as the...

  • Senior Data Engineer

    3 months ago


    UK, UK, United Kingdom TLP Consultancy Ltd Full time

    £65,000 to £75,000 Permanent Near Epsom, Surrey (location is most easily reached by own transport) Hybrid working (3 days a week in the office) Generous benefits package (Performance related bonus, Pension, access to their car scheme, Birthday voucher, Workplace Nursery Benefit & Cycle Scheme, holiday purchase scheme, discounted onsite gym membership,...


  • UK, UK, United Kingdom Technical Global Solutions Full time

    Job Title: Data Centre EngineerLocation: Welwyn Garden City, Hertfordshire, United KingdomSalary: £30,000.00 to £38,000.00We are seeking a skilled and dedicated Data Centre Engineer to join a leading organisation in Hertfordshire. You will play a vital role as part of a small team providing critical Data Centre services to a prestigious international...

  • Data Engineering Lead

    2 weeks ago


    UK, UK, United Kingdom LexisNexis Intellectual Property Solutions Full time

    About our Team The Content Engineering teams at LexisNexis Intellectual Property (IP) are at the forefront of innovation, transforming the way patent data is processed, managed, and utilized. We are in the initial stages of building our DataOps team who will govern the Data Quality across the entire technology department.Our teams are working closely with...

  • Lead Data Engineer

    3 weeks ago


    UK, UK, United Kingdom Recann Full time

    Lead Data EngineerWe are on the lookout for an experienced Lead Data Engineer to join our customer's innovative team on a contract basis. Key Responsibilities:Provide strategic leadership to the Data Engineering team, fostering best practices in software development to create robust AWS Glue data pipelines.Oversee the secure management of the data...

  • Senior Data Engineer

    2 months ago


    UK, UK, United Kingdom SPG Resourcing Full time

    Job Title: Microsoft Fabric SME / Senior Data Engineer (3-Month initial Contract)Location: Remote Day Rate: £500-£600 (Outside IR35) About the Role:We are seeking a Microsoft Fabric SME/ Senior Data Engineer to join one of our clients for a critical 3-month project within the manufacturing sector. You will play a key role in the design, setup, and scaling...

  • Senior Data Engineer

    1 month ago


    UK, UK, United Kingdom Harnham Full time

    Senior Data EngineerLocation: Remote working (Once a month in Oxford)Salary: £80k + competitive benefits packageRole Overview:Our client is seeking a Senior Data Engineer to elevate their data infrastructure's reliability and scalability. Reporting to the Data & Analytics Director, you will drive the development of a larger data mesh setup while...

  • Data Engineer

    3 weeks ago


    UK, UK, United Kingdom FBSPL Full time

    We're going to start by talking about our exciting new Data Engineer position, but if you'd like to know more about the company then just reach out and we’ll fill you in!You will be working in our Data Engineering department to support every part of the business in their journeys to streamline and automate the data they have. You will lead the way...


  • UK, UK, United Kingdom Focus on WD Full time

    Job Title: Azure & AWS Data Engineer Contract Length: 4 Months (Outside IR35) Location: Remote, with occasional on-site presence in London (approx. once a month) Client: Consultancy Firm based in London Job Description: We are seeking an experienced Azure & AWS Data Engineer to join our client, a dynamic consultancy based in London, on a 4-month contract....


  • UK, UK, United Kingdom Kainos Full time

    When you join Kainos, you get to think beyond limitations to make an immediate and positive impact – like transforming digital services for millions of citizens or helping Fortune 500 companies get live and thrive on Workday.You’ll be part of a people-first culture that is growing around the world. We’re a creative, committed, and diverse group of...