Description
n8n-nodes-datagleaner
This is an n8n community node. It lets you use Data Gleaner scrapers in your n8n workflows: find contact details on company websites, get Google Hotels prices, collect Weibo posts and Bilibili videos, and list every URL in a site’s sitemaps.
Each operation runs a Data Gleaner Actor on Apify with your own Apify account and returns the scraped records as n8n items, one item per record. The node also works as a tool for the n8n AI Agent.
n8n is a fair-code licensed workflow automation platform.
Installation | Operations | Credentials | Compatibility | Usage | Resources
Installation
Follow the installation guide in the n8n community nodes documentation. In a self-hosted n8n, open Settings > Community Nodes > Install and enter n8n-nodes-datagleaner.
Operations
| Operation | Apify Actor | What you get |
|—|—|—|
| Get Contact Details | datagleaner/website-contact-details-scraper | Emails, phone numbers, social profiles and company name for each website |
| Search Hotels | datagleaner/google-hotels-scraper | Google Hotels listings with rating, reviews, amenities and prices for your dates, optionally per-provider offers |
| Get Weibo Posts | datagleaner/weibo-scraper | Weibo posts by keyword or by user, with text, engagement counts, topics and author |
| Get Bilibili Videos | datagleaner/bilibili-scraper | Bilibili videos by keyword, URL or trending list, with stats, tags, and optional comments and danmaku |
| Get Sitemap URLs | datagleaner/sitemap-extractor | Every page URL in a site’s sitemaps, with lastmod, images and optional HTTP status |
Fields that take several values (websites, keywords, users, URLs) accept a comma or newline separated list. Any other input field an Actor supports, such as proxyConfiguration, can be passed under Run Settings > Extra Input (JSON).
Credentials
You need an Apify account (the free plan works) and its API token.
1. Sign up at apify.com.
2. Open Apify Console > Settings > API & Integrations and copy your personal API token.
3. In n8n, create a Data Gleaner (Apify) API credential and paste the token.
Runs are billed to your Apify account at each Actor’s Store price. The “Max … per …” field on each operation caps how many records, and so how much cost, a run can produce.
Compatibility
Built with @n8n/node-cli and tested against n8n-workflow 2.x (n8n 1.x and 2.x). It has no runtime dependencies.
Usage
Each operation calls Apify’s synchronous endpoint POST /v2/acts/datagleaner~, which waits for the run to finish and returns its records. Apify allows a synchronous run at most 300 seconds, so keep inputs small per node execution (a few websites, keywords or users) and loop over larger lists with n8n’s Loop Over Items node. In testing, each operation returned 3 records in under 10 seconds, but a Bilibili search once took about 90 seconds.
If an input item fails, the node stops the workflow with Apify’s error message, or returns { "error": "..." } for that item when Settings > On Error is set to continue.
Templates
Two importable workflows are in templates/. In n8n, choose Workflows > Import from File (or paste the JSON onto the canvas), then pick your credentials and fill in the highlighted nodes.
enrich-company-websites.json: Manual Trigger, read a Google Sheet with awebsitecolumn, Get Contact Details, then write emails, phones and social profiles back to a sheet (matched onwebsite, so reruns update rows).weibo-keyword-monitor.json: daily Schedule Trigger, Get Weibo Posts for a keyword, drop posts already seen in earlier runs, post the new ones to Slack. The seen-post memory only persists once the workflow is activated.- n8n community nodes documentation
- Data Gleaner on the Apify Store
- Apify API: run Actor synchronously and get dataset items
Resources
Version history
0.1.0
First release: five operations, one per Data Gleaner Actor.
