6.5.7. What type of robots to choose ?

Regarding social networks and radar sources, answering this question is rather simple (what types of robots to choose).

Inserting a classic web source (not social) is possible via several tools:

1. RSS feed
2. Website crawler
3. Scrap bot

Which one to choose?

Always prefer the RSS feed if it exists and if it is complete. This is the fastest and most reliable method.

No RSS feed?

If there is no RSS feed, ask yourself these two questions:

• “Is this page important?”
• “How much time*+ do I have to integrate my sourcing?”

On an important page, like your main competitor’s press releases, you have no room for error. Collection must be reliable and perfect. In this case, the scrapping bot is ideal.

If you don’t have enough time or if a few collection errors are acceptable, the website crawler is the best suited. Indeed, the crawler is very easy to insert in large amount and collects the entirety of a website, while the scrapping bot takes care of a single web page and requires time to insert the selectors yourself. .