📊 Analyze search intent for keywords with Google scraping, Bright Data, and Gemini AI
⚡ 1,220 views · 📊 Market Research & Insights
💡 Pro Tip — HTTP Request scraping tends to break when sites update their markup. If you’re scraping a major platform, check if ScraperNode covers it — it has maintained scrapers for LinkedIn, Instagram, TikTok, YouTube, and 20+ other platforms that return structured data.
Description
What it does
This workflow scrapes the top 10 pages on SERP and conducts an in-depth analysis of the keyword intent for each ranking keyword, saving the information to a Google Sheet for further analysis.
How does this workflow work?
- We add our keywords and country code to a Google sheet that we need to monitor and research on
- Run the system
- Scrape the top 10 pages
- Analyze the intents of the top 10 and update to a Google sheet
Technical Setup
- Make a copy of this G sheet
- Add your desired keywords to the Google sheet
- Map keyword and country code
- Update the Zone name to match your zone on Bright Data
- Run the scraper
Upon successful scraping, we run an intent classifier to determine the intents for each ranking page and update the G sheet.
Setting up the Serp Scraper in Bright Data
- On Bright Data, go to the Proxies & Scraping tab
- Under SERP API, create a new zone
- Give it a suitable name and description. The default is
serp_api - Add this to your account
- Add your credentials as a header credential
🔗 Nodes Used
Google Sheets, HTTP Request, Google Gemini Chat Model, Text Classifier
📥 Import
Download workflow.json and import into n8n:
Workflow menu → Import from File