For shop owners
MugBot
MugBot is how Mug keeps its catalogue's facts current: names, capacities, styles, prices and product photos of collectible mugs, read from the makers' own shops. Every mug in the catalogue links back to the shop page it came from.
How it identifies itself
Every request carries the User-Agent MugBot/1.0 (+https://mug.neorgon.com/bot/). It never presents itself as a browser, and it never tries to get past a bot challenge: a page that challenges it is left for a person to enter by hand.
robots.txt
MugBot reads a shop's robots.txt before its first request and obeys the MugBot group, or * when there is none. To keep it out of your shop entirely:
User-agent: MugBot Disallow: /
A robots.txt that cannot be read because of a server error is treated as "stay out" until it can be read again.
How much it reads
- One request at a time per shop, at least 1.5 seconds apart.
- Public product feeds (such as a Shopify store's product JSON) and the structured data on product pages. No accounts, no carts, no checkout.
- A scan stops after 40 listing pages, and a page read in the last week is not read again.
- Product photos are copied once, kept with the address they came from, and shown with a link to your shop.
Asking to be left out, or for a correction
Use the Report link at the bottom left of any page on this site, name your shop or the mug, and say what you would like: a correction, a photo removed, or your shop left out. Removal is done by hand, and the shop is marked so it is not read again.