← The Atlas of Alternative DataChapter II · WEB
Web & Pricing Data
Web and pricing data is information collected from public websites at scale: product prices, assortment, stock status, and site traffic, captured daily and structured for analysis.
The primer
Web data is collected by crawling public websites at scale: product pages, price points, stock status, and the structure of an online catalogue. Specialist firms run the infrastructure that fetches, parses, and normalises these pages into clean panels of prices and assortment. Investors use it to track pricing power, promotional intensity, and out-of-stock rates across competitors. The main considerations are coverage breadth, the legality and robustness of collection, and how cleanly the data maps to companies and brands.
The register
Every web & pricing data provider on file. Verified means the site is live, on its own brand, and editorially checked — never paid placement. Listings are informational, not investment advice.
ProviderGeographySinceDeliveryPrice band
AberdeenVerifiedWeb traffic data mapped to company IP addresses to understand what topics employees are researching.US———
Amass InsightsVerifiedAlternative data aggregator and analytics company that specializes in Web Data. Founded in 2015; 5 employees.US———
ApifyVerifiedSampleWeb scraping and automation platform producing structured datasets from public websites.Global2015API< $50k
ARCVerifiedLarge database of air travel ticketing data that provides insights into aviation, travel marketing, and hotel industries. Industry benchmark for airline pricingUS———
BayStreet ResearchVerifiedResearch on U.S. and European smartphone, tablet, and wearable markets. Has a database of mobile device sell-through data with rolling 6-month forecasts, and reUS———
Bright DataVerifiedSampleWeb data collection infrastructure and ready-made datasets scraped from public web pages at scale.Global2014API, S3$50–150k
BuiltWithVerifiedTechnographic data tracking adoption of web technologies across the internet, used to monitor usage trends for public technology vendors.Australia2007——
Common CrawlVerifiedSampleFree petabyte-scale archive of crawled web pages, refreshed monthly.Global2011BulkFree
Cruise AnalyticsVerifiedWeekly data on cruise prices and occupancy rates Founded in 2018; 2 employees.US———
Dataprovider.comVerifiedWeb data by sector and geography (e.g. data on websites for hardware stores in NYC area), frequency of website changes, and website build quality. Founded in 20Netherlands———
DataPulseVerifiedWeb traffic data focused on identifying total traffic related to a single company across multiple domain names. Founded in 2016; 37 employees.US———
DataWeaveVerifiedCompetitive pricing, assortment, and digital-shelf analytics collected across retail websites.Global2011API, Dashboard$50–150k
DiffbotVerifiedKnowledge-graph and web-extraction APIs built from crawling the public web.US2008API$50–150k
Hatched AnalyticsVerifiedHatched Analytics is a specialist operator in the alternative data space, focused on delivering insight on sought-after companies not available in traditional dIreland———
Import.ioVerifiedWeb data extraction platform turning public web pages into structured datasets.US2012API$50–150k
Intelligence NodeVerifiedRetail pricing, assortment, and digital-shelf analytics from web data.Global2012API, Dashboard$50–150k
Internet ArchiveVerifiedSampleOpen archive of web pages, media, and historical site snapshots (Wayback Machine).Global1996API, BulkFree
iSpot.tvVerifiedTV and streaming advertising measurement, including impressions and estimated advertiser spend captured from tens of millions of smart TVs.US2012——
ListEdTechVerifiedTechnology-adoption data for higher-education institutions, covering systems such as student information and ERP platforms with history since 2014.Canada2014——
MarketcheckVerifiedAutomotive inventory and listings data covering tens of thousands of US dealers, delivered through APIs and feeds with daily updates.US2006API—
MIDiA ResearchVerifiedEntertainment-sector data and research covering music streaming, video, gaming, and media technology, built from proprietary consumer surveys and tracking.UK2014——
MozendaVerifiedWeb scraping software that integrates with databases and BI toolkits. Founded in 2007; 36 employees.US———
OxylabsVerifiedWeb data collection infrastructure and ready-made scraper APIs.Lithuania2015API$50–150k
Real Estate DataVerifiedPublic real estate data including listings, price changes, contracts, and sales.US———
Rook ResearchVerifiedWeb data focused on the tech stack beneath the front-facing content, e.g. third party APIs, network-level analysis, and more.US———
RVIAVerifiedRecreational vehicle data and trends, including industry forecasts, ownership trends, and pricing. Founded in 1978; 68 employees.US———
ScrapeHeroVerifiedCustom web-scraping and ready datasets across retail, travel, and more.US2015API, S3< $50k
SimilarwebVerifiedSampleWeb and app traffic, engagement, and digital market-share estimates across millions of sites.Global2007API, Dashboard$50–150k
Standard Media IndexVerifiedAd spend data sourced directly from booking and invoice systems of media holding partners. Data is aggregated monthly. Founded in 2009; 35 employees.US———
T.H. CapitalVerifiedChina focused web data firm. Founded in 2011 by a former Bernstein analyst; 12 employees.China———
Webz.ioVerifiedWeb data feeds covering news, blogs, forums, and the dark web.Israel2016API, Feed$50–150k
YipitDataVerifiedAnalyst-ready research products built from web, transaction, and app data across consumer and internet sectors.US2011Report, Feed, API$150k+
ZyteVerifiedSampleWeb scraping infrastructure and managed data extraction, formerly Scrapinghub.Ireland2010API< $50k
Elsewhere in the atlas
Previous chapter: Card & Transactions. Next chapter: News & Sentiment. All 20 categories are defined in the glossary; the full register is on the front page, and the market counts are in the Atlas Briefing.