Enterprise Site Intelligence Adds Crawler Profiles for AI Agents and Search Bots
New bot simulation capabilities let teams see their website exactly as AI models and search engines do. Without manual configuration.
March 31, 2026
As data marketplaces explode in popularity, companies are racing to bring external datasets into their AI and market intelligence workflows.
In fact, traffic to leading data marketplaces has jumped ~500% in two years, while Snowflake.com alone saw a 136% increase over the same period.
(Global, Jun 2022–Jun 2025; Source: Semrush Traffic & Market).
Now, Semrush is joining that movement.
The Semrush Trends API datasets are available directly in Snowflake Marketplace and free to test. This integration gives users instant access to web traffic and competitive intelligence right inside Snowflake, with zero extracts, no separate feeds, and no waiting.
Why This Integration Matters
Speed is the new edge.
With zero-ETL (extract, transform, load), marketers can move from curiosity to insights in minutes. No more external contracts or feed uploads – just open Snowflake, query, and scale as needed.
With zero-ETL (extract, transform, load), marketers can move from curiosity to insights in minutes. No more external contracts or feed uploads – just open Snowflake, query, and scale as needed.
And that speed matters more than ever.
In just a year, AI-assistant referral traffic to major retailers has surged: amazon.it (+1,444%) and homedepot.com (+767%) are leading examples. When discovery channels evolve this fast, access to live traffic and benchmarking data helps brands spot shifts before competitors even notice them.
In just a year, AI-assistant referral traffic to major retailers has surged: amazon.it (+1,444%) and homedepot.com (+767%) are leading examples. When discovery channels evolve this fast, access to live traffic and benchmarking data helps brands spot shifts before competitors even notice them.
With access to this data, teams can benchmark performance and spot discovery shifts and channel reallocation opportunities before competitors adapt.
What’s inside
Semrush structures all datasets for immediate analysis and use, and refreshes them regularly. Here are two of the pre-built cohorts that users can look forward to accessing:
- S&P 500, NASDAQ-listed, and AI companies: Traffic summaries by domain for easy competitive benchmarking and market momentum analysis.
- Retail Top 100: Comprehensive datasets including traffic summaries, top pages, traffic sources, and geographic distribution for expansion planning and localization strategies.
How to instantly grab a competitive edge
Benchmark your cohort.
Impress your ELT with a concise visual of leaders and laggards in your space. Filter by industry cohorts (S&P 500 / NASDAQ / AI) to rank momentum and spot outliers worth deeper analysis.
Impress your ELT with a concise visual of leaders and laggards in your space. Filter by industry cohorts (S&P 500 / NASDAQ / AI) to rank momentum and spot outliers worth deeper analysis.
Prioritize countries for expansion.
Get a data-backed country short-list in minutes. Use Retail Top 100 geographic distribution data to see where competitors over-index and to prioritize market entry decisions.
Get a data-backed country short-list in minutes. Use Retail Top 100 geographic distribution data to see where competitors over-index and to prioritize market entry decisions.
Track AI-assistant referrals.
Secure swift budget reallocation approval by presenting executives with emerging AI-assistant referral insights that wouldn’t normally surface until quarterly report time.
Secure swift budget reallocation approval by presenting executives with emerging AI-assistant referral insights that wouldn’t normally surface until quarterly report time.
Not a Snowflake customer? Not a problem.
Test Semrush Trends API on Snowflake Marketplace for free. No external contracts or separate feeds required to start.
Test Semrush Trends API on Snowflake Marketplace for free. No external contracts or separate feeds required to start.
