As an SEO lead managing several large publisher sites, OnCrawl is indispensable. The crawl-over-crawl comparisons catch regressions after every deployment, and the internal linking insights helped us reshape page depth so money pages sit closer to the homepage. Support actually understands log analysis too.
Crawl comparisons and internal link analysis are excellent
We run a 2M-URL ecommerce site and OnCrawl is the first crawler that didn't choke on it. Pairing the crawl data with our server logs showed us exactly which product pages Googlebot was actually hitting versus ignoring. The data-science segmentation let us prove orphan pages were eating crawl budget, and we recovered indexation in weeks.
Log analyzer plus crawl cross-analysis is genuinely powerful at scale
Connecting OnCrawl to our log files exposed thousands of crawl hits wasted on faceted navigation. We fixed the robots rules based on its data and saw key categories reindexed fast. The visualizations make it easy to present findings to non-technical stakeholders. Genuinely changed how we prioritize fixes.
Actionable crawl-budget insights, clear visualizations
Our scheduled crawl hung at around 60% twice and never produced a complete report, so we lost a full reporting cycle. When I asked to pause the plan while it was being sorted, I was told the annual commitment couldn't be adjusted. Powerful tool when it works, but I expected better reliability and flexibility for the price.
Incomplete crawls and a rigid annual contract
OnCrawl handles our large site without timing out and the custom dashboards are great once you build them. My only gripe is the onboarding: the segmentation editor and OQL query language took our team a couple of weeks to get comfortable with. Worth it, but budget time for ramp-up.
Scales to huge sites, flexible reporting
Steeper learning curve than expected