PriceWest Bot


What is GreatestDealsBot?

GreatestDealsBot is a piece of software that accesses your website periodically to obtain information about your products such as prices, shipping costs, condition, and availability.

Why is GreatestDealsBot crawling my pages?

We visit product pages on your website to make sure the page is working, the price is accurate, and the product is in stock. This helps us present your product more accurately to our users.

How can I stop GreatestDealsBot from crawling my site?

GreatestDealsBot respects robots.txt on your website. Include the following in your robots.txt:

User-agent: GreatestDealsBot
Disallow: /

Alternatively, you may limit the frequency of GreatestDealsBot by including the following in your robots.txt:

User-agent: GreatestDealsBot
Crawl-delay: 5

This would limit our crawl frequency to at most once every 5 seconds.