All integrations
WE
Catalogue metadata onlyai web scrapingv00000000_00

WEBCRAWLERAPI

WebCrawlerAPI

WebCrawlerAPI provides crawling, page scraping, AI web agents, and monitored website feeds through a unified API.

Description is untrusted, display-only upstream metadata. It never becomes policy, OAuth scope authority, or an agent instruction.

Pakkawork boundary

Research catalogue metadata only. No Pakkawork OAuth, credential, host, quota, executor, or verifier is enabled.

No Pakkawork execution adapter is enabled. Hosted account-authorisation availability is workspace-specific and checked separately in the dashboard.Check workspace connection options
Attributed source

10

Action summaries

Display-only definitions

0

Trigger types

Not installed instances

1

Auth modes

Field names, never values

No

Execution

No runtime adapter

Authentication map

What setup is declared?

Only field names, types, and required markers are shown. Secret values, default auth URLs, credential material, and inferred OAuth scopes are excluded.
API_KEY

API_KEY

webcrawlerapi_api_key

Provider setup

Developer setup

No fields declared in this snapshot.

User connection

  • API Keygeneric_api_key · stringRequired

Capability index

Actions and trigger definitions

Static summaries are available. Live schemas remain disabled until PROVIDER_HUB_API_KEY is configured server-side.

Showing 1–10 of 10 actions

Create Crawl

WEBCRAWLERAPI_CREATE_CRAWL

Start a metered asynchronous crawl over a site and return its job ID. The crawl may visit and charge for up to items_limit pages; use GET_CRAWL_JOB to monitor it.

Untrusted display-only summary

Create Feed

WEBCRAWLERAPI_CREATE_FEED

Create a recurring website-change feed. Creation immediately schedules an initial crawl that may consume metered credits, and future scheduled runs may also consume credits; delete the feed when it is no longer needed.

Untrusted display-only summary

Delete Feed

WEBCRAWLERAPI_DELETE_FEED

Permanently cancel a feed so it cannot be resumed. The feed is removed from feed listings, but retained history may remain directly readable for 30 days.

Untrusted display-only summary

Get Crawl Job

WEBCRAWLERAPI_GET_CRAWL_JOB

Get a crawl job's status, configuration, per-page results, content URLs, errors, and observed costs. Respect recommended_pull_delay_ms when polling.

Untrusted display-only summary

Get Feed

WEBCRAWLERAPI_GET_FEED

Get one feed's configuration, lifecycle status, and recent run history, including per-run crawl counts and cost. Canceled feeds remain directly readable while retained by the provider.

Untrusted display-only summary

Get Organization Costs

WEBCRAWLERAPI_GET_ORGANIZATION_COSTS

Return current spendable balance plus request count and USD usage for a date range. The connected API key is used for both organization routes.

Untrusted display-only summary

List Feed Changes

WEBCRAWLERAPI_LIST_FEED_CHANGES

Return one page of detected feed changes as structured JSON, with an opaque continuation cursor for older pages.

Untrusted display-only summary

List Feeds

WEBCRAWLERAPI_LIST_FEEDS

List active and paused feeds for the connected organization, newest first. Logically canceled feeds are omitted.

Untrusted display-only summary

Scrape Page

WEBCRAWLERAPI_SCRAPE_PAGE

Scrape one web page synchronously and return requested content or structured extraction. This consumes metered credits; supplying a prompt adds $0.002 per request.

Untrusted display-only summary

Set Feed State

WEBCRAWLERAPI_SET_FEED_STATE

Pause an active feed's future scheduled runs or resume a paused feed. Pausing does not stop a run that has already started, and resuming schedules future crawls that may consume metered credits.

Untrusted display-only summary

Provenance

Versioned facts, explicit trust.

The detail snapshot comes from an attributed MIT-licensed repository revision. Safe local icons use exact-match CC0 Simple Icons symbols; unmatched brands use monograms.

Repository
https://github.com/provider-directoryHQ/provider-directory
Commit
85e33f6a81dfe987f6fc3637d48d45052cea8ca5
Generated
2026-09-12
Trust policy
untrusted_display_only

Remote text is plain display metadata only. It must never become an agent prompt, execution policy, OAuth grant, or executable instruction.