📊 Monitor competitors’ websites for changes with OpenAI and Firecrawl
⚡ 12,604 views · 📊 Market Research & Insights
💡 Pro Tip — HTTP Request scraping tends to break when sites update their markup. If you’re scraping a major platform, check if ScraperNode covers it — it has maintained scrapers for LinkedIn, Instagram, TikTok, YouTube, and 20+ other platforms that return structured data.
Description
Who is this template for?
This workflow template is designed for people seeking alerts when certain specific changes are made to any web page. Leveraging agentic AI, it analyzes the page every day and autonomously decides whether to send you an e-mail notification.
Example use cases
- Track price changes on [competitor’s website]. Notify me when the price drops below €50.
- Monitor new blog posts on [industry leader’s website] and summarize key insights.
- Check [competitor’s job page] for new job postings related to software development.
- Watch for new product launches on [e-commerce site] and send me a summary.
- Detect any changes in the terms and conditions of [specific website].
- Track customer reviews for [specific product] on [review site] and extract key themes.
How it works
- When clicking ‘test workflow’ in the editor, a new browser tab will open where you can fill in the details of your espionage assignment
- Make sure you be as concise as possible when instructing AI. Instruct specific and to the point (see examples at the bottom).
- After submission, the flow will start off by extracting both the relevant website url and an optimized prompt. OpenAI’s structured outputs is utilized, followed by a code node to parse the results for further use.
- From here on, the endless loop of daily checks will begin:
- Initial scrape
- 1 day delay
- Second scrape
- AI agent decides whether or not to notify you
- Back to step 1
- You can cancel an espionage assignment at any time in the executions tab
Set up steps
- Insert your OpenAI API key in the structured outputs node (second one)
- Create a Firecrawl account and connect your Firecrawl API key in both ‘Scrape page’-nodes
- Connect your OpenAI account in the AI agents’ model node
- Connect your Gmail account in the AI agents’ Gmail tool node
🔗 Nodes Used
HTTP Request, AI Agent, OpenAI Chat Model, n8n Form Trigger
📥 Import
Download workflow.json and import into n8n:
Workflow menu → Import from File