targets holds 1 to 50 entries. Each has a type of scrape (fixed URLs), crawl (pages found under a start page on every check) or search (new results for queries). One monitor can mix types, and every check reads every target. Pages in a check name their target by id, which you can set (1 to 64 characters) or let Stophy make.
goal here.
Scrape targets
A monitor always reads live, so
maxAge and minAge are ignored. zeroDataRetention is refused, because a monitor keeps a snapshot to compare.
formats says what to compare. The first of markdown, html, rawHtml and links is compared, with markdown as the default. A page is changed when that text differs from the last read. To compare fields instead, add a json format with a schema or prompt, or a changeTracking format as in Change tracking. changeTracking modes are git-diff (the text diff) and json (each field before and after). With only json, a page whose text changed but whose fields did not is same.
Crawl targets
url is the start page (required). Every check finds the pages under it again and reads each one, so a page that appears later is a new change. A check that finds no pages fails, with the reason in error. A crawl target takes scrapeOptions too.
Search targets
A search target has no baseline: a meaningful result is reported the first time it is found.
A search target needs a
goal, or judgeEnabled: false. A result the judge finds meaningful is new. One it finds not meaningful is marked ignored and not looked at again. A result you were already told about is already_seen. See search results.
Goal and judge
goal is up to 2,000 characters of plain words. With a goal, a model judges every changed page against it. judgeEnabled: false keeps the goal and turns the judge off.
Read judgment on the page result or webhook: meaningful, confidence (high, medium, low), reason, and meaningfulChanges with type, before, after and reason. A change judged not meaningful is still recorded and sent with meaningful: false. If the judge cannot decide, judgment is null and that judging is free. Pricing is on Pricing.
Update targets
PATCH /v1/monitor/{id} replaces targets as a whole, so send every target you keep. goal and judgeEnabled can change in the same call.
- A kept page stays compared with its last snapshot.
- A page you add is
newon the next check and sends no event. - A removed page is no longer read or billed.
Limits and errors
Account limits are on Monitors. Codes are on Errors. All are400 invalidRequest.
targets.0.urls.0: Expected a public website URL: the address is not public.targets.0.scrapeOptions.zeroDataRetention: zeroDataRetention is not available for monitors, which keep a snapshot to compare.goal: a search target needs a goal to judge results against, or judgeEnabled set to false.- The older
url,urls,interval,formatsandchangeTrackingfields work only withouttargetsandschedule. Mixing them returns this error.