action_sitemap_crawler · action · Utility · Available · v1.0.0
Specialised crawler for sitemap.xml (the sitemaps.org standard every serious site exposes): downloads the sitemap, follows sitemap-index nesting, and returns the full URL universe with freshness/priority metadata — the fastest way to enumerate a site.
Fields shown in the editor when configuring the node. Generated directly from the NodeDefconfigFields.
| Field | Type | Required | Default | Description |
|---|---|---|---|---|
urlURL sitemap.xml | string | yes | — https://miosito.com/sitemap.xml | URL del sitemap. Funziona sia con urlset diretto sia con sitemap-index (recursion auto). |
includeRegexInclude regex (filtro URL) | string | no | — /blog/|/news/ | Solo URL che matchano questa regex (case-insensitive). Lascia vuoto = tutte. |
excludeRegexExclude regex (filtro URL) | string | no | — /admin/|\.pdf$ | Escludi URL che matchano questa regex. |
lastmodSinceIsoSolo lastmod >= (ISO) | string | no | — 2026-05-01 | Filtra URL con lastmod >= questa data. URL senza lastmod vengono SCARTATI quando filtro attivo. |
maxRecurseDepthMax recursion depth | number | no | 3 | Quanti livelli di sitemap-index seguire. Default 3 (sufficiente per 99% siti). |
limitMax URL ritornati | number | no | 1000 | Limite output. Default 1000, max 50000. |
userAgentUser-Agent | string | no | FlowForge/1.0 (+https://flowforge.automazionezeli.com) | — |
Fields available to downstream nodes via $node.<alias>.json.<field>:
totalUrlsInSitemapfilteredCounturlsincludeRegexexcludeRegexlastmodSinceIsoJSON snippet of the node as it appears in the workflow. Values are derived fromdefaultValue and from required parameters.
{
"id": "node-action_sitemap_crawler-1",
"defId": "action_sitemap_crawler",
"label": "Sitemap Crawler",
"config": {
"url": "https://miosito.com/sitemap.xml",
"maxRecurseDepth": 3,
"limit": 1000,
"userAgent": "FlowForge/1.0 (+https://flowforge.automazionezeli.com)"
}
}Available now on all FlowForge plans. Try it free without a credit card.
Start freeBrowse all nodes