Koble til Knoon AI med Crawler (Web Intelligence) for å automatisere AI-arbeidsflyter.

Fetch a web page and return extracted content with high chances of succeeding and not being blocked.

webIntelligenceCrawlerScrapeUrl

BETA

Tillatelser

Det finnes ingen elementer å vise.

Valgfrie tillatelser

Det finnes ingen elementer å vise.

Parametere

Navn	Type	Beskrivelse	Påkrevd
url	mustache	Public URL to scrape (e.g. "https://example.com/article").	Ja
formats	array (mustache)	Optional list of formats to return (e.g. ["markdown","html"]). Defaults to ["markdown"].	Nei
onlyMainContent	boolean	If true, attempts to return only the primary page content.	Nei
waitFor	mustache	Optional wait time in milliseconds before scraping (e.g. "2000").	Nei
timeout	mustache	Optional timeout in milliseconds for the scrape request.	Nei

Returer

Navn	Type	Beskrivelse
status	string	OK or ERROR.
url	string	The scraped URL.
content.markdown	string	Markdown content when available.
content.html	string	HTML content when available.
content.text	string	Plain text content when available.
metadata	object	Metadata when available.
links	array	Extracted links when available (shape may vary by source; commonly URL strings).