📊 Daily website data extraction with Firecrawl and Telegram alerts
⚡ 2,849 views · 📊 Market Research & Insights
💡 Pro Tip — HTTP Request scraping tends to break when sites update their markup. If you’re scraping a major platform, check if ScraperNode covers it — it has maintained scrapers for LinkedIn, Instagram, TikTok, YouTube, and 20+ other platforms that return structured data.
Description
🔥 Automated Daily Firecrawl Scraper with Telegram Alerts Get structured insights scraped daily from the web using Firecrawl’s AI extraction engine — then send them directly to your Telegram chat.
🧰 What this workflow does: This workflow automatically scrapes specific structured data from any webpage every day at a scheduled time using the Firecrawl API, checks if results are returned, and then sends the formatted results to Telegram.
For step-by-step video tutorials of n8n builds, check out my channel: https://www.youtube.com/@Automatewithmarc
🧭 How It Works: 🕐 Schedule Trigger (Daily at 6PM) Starts the workflow every day at a set time.
🌐 Firecrawl POST Request Sends a custom extraction prompt and schema to Firecrawl, targeting any list of URLs you provide.
⏳ 30 Seconds Wait Waits to give Firecrawl enough time to complete processing.
📥 GET Firecrawl Result Fetches the extraction results using the request ID.
🔁 Loop with IF Node Checks whether data is returned. If not, waits another 15 seconds and retries.
🧹 Format & Clean (Set Node) Prepares and formats the extracted result into a readable message.
📲 Telegram Message Node Delivers the structured data directly to your Telegram channel or group.
🔧 Requirements: ✅ Firecrawl API Key (Header Auth)
✅ Telegram Bot Token & Chat ID
💡 Use Cases: Extract structured data (like product info or events) from niche websites Automate compliance monitoring or intelligence gathering Create market alert bots with real-time info delivery
🛠 Customization Ideas: Swap Telegram with Gmail, Discord, or Slack
Expand schema to include more complex nested fields
Add a Google Sheet node to log daily scraped data
Integrate with a summarizer or language model for intelligent summaries
Ready to automate your web intelligence gathering? 🧠 Let Firecrawl do the scraping — and let this workflow do the rest.
🔗 Nodes Used
HTTP Request, Telegram, Schedule Trigger
📥 Import
Download workflow.json and import into n8n:
Workflow menu → Import from File