A live demo that monitors the web semantically using the Websets API.
Set Up a Webhook
webset.created
and webset.item.enriched
.webhook.secret
, we’ll use it later to validate incoming webhook requests.Create a Webset
query
to direct the search and criteria
to narrow down the results.In this example we’re looking for articles about recent startup fundraises.Monitor the Webset
webset.id
. We set the cadence
parameter to run daily and the search
behavior so it looks for new results.By default, monitors use the last search the Webset ran. When we created the Webset we used “in the last 24 hours” so it’s always relative to when the monitor runs.Handle the Webhook
Embed the Article Title
text-embedding-3-small
model that produces vectors optimized for similarity comparisons.Search for Similar Articles
pgvector
extension to find the 10 most similar articles from the last week.Classify Duplicates with an LLM