Fundig · Crawlers
FundigBot and FundigResearch
Fundig is a business-research platform run by Stehrway in Canada. It reads public websites to describe businesses and organizations.
FundigBot
Builds Fundig's index.
- User agent
FundigBot/1.0 (+https://console.fundig.app/bot)- Opt out
Disallow it in your site's robots.txt, and FundigBot stops crawling your site:
User-agent: FundigBot Disallow: /
FundigResearch
Reads public pages when a Fundig customer researches companies.
- User agent
FundigResearch/1.0 (+https://console.fundig.app/bot)Some pages are read for it by a rendering service, under that service's own user agent.
- Opt out
FundigResearch reads on a customer's behalf and doesn't follow robots.txt. Ask on the opt-out form instead: we confirm each request by email, and a person reviews it within 2 business days.
Neither crawler signs in, fills in forms, or gets past paywalls or logins. Each of our servers reads one page at a time from a site, with a pause between pages. A rendering service reading for FundigResearch may make several requests to a site at once.
- Personal information
How Fundig handles personal information is described in its privacy policy.
- Contact