The Websets API helps you create your own unique slice of the web by organizing content in containers (Webset). These containers store structured results (WebsetItem) which are discovered by search agents (WebsetSearch) that find web pages matching your specific criteria. Once these items are added to your Webset, they can be further processed with enrichment agents to extract additional data. Whether you’re looking for companies, people, or research papers, each result becomes a structured Item with source content, verification status, and type-specific fields. These Items can be further enriched with enrichments.

​
Key Features

At its core, the API is:
  • Asynchronous: It’s an async-first API. Searches (Webset Search) can take from seconds to minutes, depending on the complexity.
  • Structured: Every result (Webset Item) includes structured properties, webpage content, and verification against your criteria, with reasoning and references explaining why it matches.
  • Event-Driven: Events are published and delivered through webhooks to notify when items are found and when enrichments complete, allowing you to process data as it arrives.

​
Core Objects

Core concepts diagram showing relationships between Webset, Search, Item and Enrichment objects
  • Webset: Container that organizes your unique collection of web content and its related searches
  • Search: An agent that searches and crawls the web to find precise entities matching your criteria, adding them to your Webset as structured WebsetItems
  • Item: A structured result with source content, verification status, and type-specific fields (company, person, research paper, etc.)
  • Enrichment: An agent that searches the web to enhance existing WebsetItems with additional structured data

​
Next Steps