ShopAssist bot
Who ShopAssist's crawler and connector are, their User-Agents, how they respect robots.txt and where they connect from.
If you see ShopAssist in your server logs, a store owner has connected their store to ShopAssist, an AI shopping assistant by COEC, or added your pages to their assistant's knowledge base.
User-Agents
| User-Agent | Purpose |
|---|---|
ShopAssist/1.0 (+https://shopassist.coec.dk/bot) | knowledge crawler (pages and sitemaps a merchant added) and product feeds |
ShopAssist-Connector/1.0 (+https://shopassist.coec.dk/bot) | calls to a store's ShopAssist plugin or order endpoint |
ShopAssist-Webhooks/1.0 (+https://shopassist.coec.dk/docs/webhooks) | webhooks to an endpoint a merchant configured |
What the crawler does
- It fetches only pages, sitemaps and feeds a merchant explicitly added, plus pages linked from them on the same site.
- It honours
robots.txt. Only a merchant crawling their own verified storefront can choose to ignore it. - It follows at most 5 redirects, runs no JavaScript, sends no cookies and does not log in.
- It reads HTML, plain text and PDF; it never downloads images.
- It crawls on the merchant's schedule, at a low rate.
Blocking the crawler
To keep ShopAssist from crawling your site, add to your robots.txt:
User-agent: ShopAssist
Disallow: /If you believe the crawler misbehaves, write to abuse@coec.dk with the URL, the time and the User-Agent.
IP addresses
The crawler and connector connect from the addresses on egress IPs.
Last updated on