Spider Stats & Visit Analytics
GOCO ships two complementary analytics modules: Spider Stats answers “are search engines and AI crawlers fetching my sites, and what are they fetching?”, while Visit Analytics answers “how many real visitors do I have and where do they come from?”. Both collect automatically — no code to embed on your sites.
Spider Stats: who is crawling your sites
Section titled “Spider Stats: who is crawling your sites”Spider Stats reads your servers’ access logs, identifies search-engine and AI crawlers such as Googlebot, Bingbot and GPTBot, and verifies they are genuine. Data is collected hourly.
What you can see
Section titled “What you can see”- Overview tiles: Total crawls, Active bots, Crawled sites, Unique paths and Suspicious, switchable across “Today / Yesterday / 7 days / 30 days / All time” windows.
- Crawl trend: an hourly (Beijing time) or daily trend chart plus a “Bot share” pie, so you can see which crawler visits most.
- Bot categories: every bot is classified — CN search, Intl search, CN AI, Intl AI, Social, SEO, Security, Scraper, Unknown — and you can filter by category, server or domain.
- Verification: each crawl is marked “Verified / Suspicious / Unverified”. “Verified” means the source IP is confirmed to belong to the engine; “Suspicious” means someone faked a crawler’s user agent and it is not the real engine.
How to read crawl frequency — and what it means for indexing
Section titled “How to read crawl frequency — and what it means for indexing”- Verified search crawlers visiting (Googlebot, Bingbot, Baidu spider, …) means search engines have discovered your site — the prerequisite for getting indexed.
- Rising crawl frequency usually follows regular content updates: the more consistently you publish, the more often crawlers return, and the faster new pages get indexed.
- Zero crawls for a long time is worth investigating: is the domain live, does robots allow crawling, is the site reachable (check the Monitoring page)?
- Lots of suspicious crawls does not affect indexing — it counts fake-UA traffic and simply shows how much your site gets scraped.
Crawl detail & bot ranking
Section titled “Crawl detail & bot ranking”Two tabs sit below the charts:
- Crawl detail: row-by-row records with Site / Path, Bot, Category, Method, Status, IP, Country and Verified, with path search, column picker and CSV export.
- Bot ranking: per-bot aggregates — crawls, sites covered, suspicious count and last seen; click a bot to drill into its per-site breakdown, top paths and crawl log.
Collection settings
Section titled “Collection settings”Click “Configure” (top-right) to enable or disable spider analysis per server: it is on by default for every server you add, and the system collects hourly; you can adjust the scan interval, and non-standard panels can override the log path under “Advanced”. Cloud-hosting sites collect spider stats automatically via the gateway — nothing to configure.
Right after enabling you will see “First collection in progress…”; crawler data usually appears after the next hourly collection.
Visit Analytics: how many real visitors
Section titled “Visit Analytics: how many real visitors”Visit Analytics aggregates visits across all sites you own, collected every 15 minutes.
Core metrics
Section titled “Core metrics”- Page views (PV): total number of page loads.
- Visitors (UV): deduplicated visitor count.
- IPs: deduplicated visiting IP count.
- Active sites: number of sites that received visits in the window.
The Overview tab also shows “Visit trend” and “Visit share” charts, plus a per-site table (PV / UV / IPs / Bounce / Avg time / Last visit / Status) with server and group filters and CSV export. Each row offers “Details” to drill into a single site, or “Collect now” to trigger an immediate scan.
Sources and more dimensions
Section titled “Sources and more dimensions”- Sources: source types are Direct, Search engine, Social, External link, Internal and Other; you can also see the actual referrer sites.
- Pages: entry-page and landing-page rankings show which pages visitors actually view.
- Visitors: device (Desktop / Mobile / Tablet), browser and OS breakdowns.
- Geo: where your visitors come from.
Click any dimension value to open a drill-down with per-site share and a sample of visit rows.
Data-source badges
Section titled “Data-source badges”Each site row carries a data-source badge:
| Badge | Meaning |
|---|---|
| Log | From the server’s access logs (the default) |
| CF | From the Cloudflare edge — applies only to sites with the CF proxy (orange cloud) enabled; reflects real proxied-site traffic |
| JS | From the JS tracker |
| CF pending | The proxied site’s Cloudflare data is still being collected — server logs are used for now (may undercount) |
External sites (JS embed)
Section titled “External sites (JS embed)”The “External” tab lets you track websites not built with GOCO: add a domain, paste the generated snippet into the head of every page, and data is aggregated every minute and shown in Overview.
Data latency & retention
Section titled “Data latency & retention”| Data | Update frequency |
|---|---|
| Spider Stats | collected hourly |
| Visit Analytics (server logs) | collected every 15 minutes |
| External sites (JS embed) | aggregated every minute |
- A newly added server needs its first collection to finish before data appears; you can also click “Collect now” on a site row.
- Raw per-request detail is kept for the last 7 days only; aggregate stats cover the selected window.
- The platform keeps roughly the last 2 months of analytics; older data is purged automatically — export CSV if you need an archive.
How this differs from Monitoring
Section titled “How this differs from Monitoring”- Analytics (this page) answers “who came”: crawler and visitor analysis, aggregated in hourly / 15-minute batches.
- Monitoring answers “is the site up right now”: reachability, server uptime and alerts, with much tighter real-time behavior.
If traffic suddenly drops to zero, check the Monitoring page first to confirm the site is reachable, then come back here for the trend.