Allen Institute

Used by the Allen Institute for AI for web crawling and data collection.

Amazon

Utilized by Amazon to gather data for Alexa's web services.

Claude

Employed by Anthropic for AI research and development purposes.

Apple

Gathers data for Apple's Siri to improve search and AI capabilities.

Microsoft

Used by Bing for web indexing and search engine data collection.

ByteDance

Utilized by Bytedance to collect data for TikTok's content recommendations.

Common Crawl

Collects web data for the Common Crawl open repository.

ChatGPT

User prompt agent for interacting with OpenAI's ChatGPT.

Cohere

Utilized by Cohere for AI model training and data gathering.

Diffbot

Used by the Diffbot service which scrapes websites to build AI datasets.

DuckDuckGo

Used by DuckDuckGo to enhance AI-driven search results.

Meta

Gathers data for Facebook's various services and features.

Gemini

Employed by Google for non-search related data collection.

LinkedIn

Used by LinkedIn to gather data for its professional networking platform.

Omgili

Utilized for web scraping and data aggregation by Omgili.

Perplexity

Used by Perplexity.ai for AI-driven search and data analysis.

Timpi

Used to build a dataset of website text that's then used in AI applications.

You.com

Employed by You.com to gather data for its search engine.