Feedoptimise
Feedoptimise
menu
Start your 7 days free trial
  1. home
  2. Integrations
  3. Web Crawling

Website Data Scraping & Feed Creation

Product Feed Creation, Automated Website Data Extraction, and Scraping

{
    "id":1,
    "category":"Home > Category",
    "title":"Lorem ipsum",
    "price":{
        "now":99.99,
        "was":199.99,
        "currency":"GBP",
    }
    "available":"yes",
    "description":{
        "short":"Lorem ipsum dolor sit amet, consectetur adipiscing elit. Duis vel aliquet.",
        "full":"Lorem ipsum dolor sit amet, consectetur adipiscing elit. Cras vel velit ac massa fringilla auctor. Curabitur orci ligula, venenatis sit amet nisl et, lobortis volutpat odio. Praesent pulvinar orci nec ante commodo, vel."
    },
    "image":{
        "main":"https://example.com/images/product/1/image1.png",
        "gallery":[
            "https://example.com/images/product/1/image1.png",
            "https://example.com/images/product/1/image2.png",
            "https://example.com/images/product/1/image3.png",
            "https://example.com/images/product/1/image4.png",
            "https://example.com/images/product/1/image5.png"
        ]
    }
}
lock
Home > Category > Product
£99.99 £199.99
add to basket
Start your 7 days free trial

Automated Data Discovery

Our robots will scan through your links map to find the routes to all the relevant and available attributes

  • Find its way through

    Our crawling technology will follow the links on your website to discover all relevant data.

  • Control access pattern

    You can control how often and how quickly our robots can be at scanning your website.

  • Very low footprint

    Our robots have a much smaller impact on your server resources than a regular user.

Extract all the relevant information

Our robots can extract all relevant data attributes available across your pages

  • Semantical

    Our robots are trained to know where each of the data attributes is being positioned thus providing consistent data mapping.

  • Contextual

    Our robots can also associate attributes discovered on the way to your item and associate them with it.

  • Inferred

    Using our modifiers platform you can enrich your data by inferring attributes from other attributes.

Lorem
brand
 ipsum dolor
title
 sit amet, consectetur
category
 adipiscing elit.

Keeping your feeds fresh

Our robots will actively monitor your website for any content and design changes

  • Content sync

    Whether you change your prices, or availability or add more items, our robots are equipped to deal with it.

  • Issues detection

    Our robots can detect any HTTP Statuses e.g. 404 links, 301 redirects, server instabilities, and more.

  • Notifications

    Using our analysers platform, you can get notified about any data attribute changes.

Analyse your crawled data

Visualise your crawl-feed attributes distribution and data quality and report changes over time

  • Quality assurance built-in

    Set up reports against any of your data feed attributes enabling you to monitor for any issues and to be notified should they occur.

  • Predefined reports

    Select from predefined reports such as title's length enabling you to start monitoring for data QA with just 1 click.

  • Custom reports

    You can build your own reports enabling you to monitor and visualise anything about your data feed and track it over time.

In stock items
5.3k
Good titles
99%
Good descriptions
98%
Items on sale
33%
Start your 7 days free trial