๐ Automate web research & analysis with Oxylabs & GPT for comprehensive reports
โก 1,220 views ยท ๐ Market Research & Insights
๐ก Pro Tip โ HTTP Request scraping tends to break when sites update their markup. If youโre scraping a major platform, check if ScraperNode covers it โ it has maintained scrapers for LinkedIn, Instagram, TikTok, YouTube, and 20+ other platforms that return structured data.
Description
Fully automate deep research from start to finish: scrape Google Search results, select relevant sources, scrape & analyze each source in parallel, and generate a comprehensive research report.
Who is this for?
This workflow is for anyone who needs to research topics quickly and thoroughly: content creators, marketers, product managers, researchers, journalists, students, or anyone seeking deep insights without spending hours browsing websites. If you find yourself opening dozens of browser tabs to piece together information, this template will automate that entire process and deliver comprehensive reports in minutes.
How it works
- Submit your research questions through n8nโs chat interface (include as much context as you need)
- AI generates strategic search queries to explore different angles of your topic (customize the number of queries as needed)
- Oxylabs scrapes Google Search results for each query (up to 50 results per query)
- AI evaluates and selects sources that are the most relevant and authoritative
- Content extraction runs in parallel as Oxylabs scrapes each source and AI extracts key insights
- Summaries are collected in n8nโs data table for final processing
- AI synthesizes everything into a comprehensive research report with actionable insights
See the complete step-by-step tutorial on the n8n blog.
Requirements
- Oxylabs AI Studio API key โ Get a free API key with 1000 credits
- OpenAI API key (or use alternatives like Claude, Gemini, and local Ollama LLMs)
Setup
- Install Oxylabs AI Studio as shown on this page
- Set your API keys:
- Oxylabs AI Studio
- OpenAI
- Create a data table
- Select the table name in each data table node
- Create a sub-workflow:
- Select the 3 nodes (Scrape content, Summarize content, Insert row)
- Right-click
- Select โConvert 3 nodes to sub-workflowโ
- Edit the sub-workflow settings for for parallel execution:
- Mode: Run once for each item
- Options โ Add Option โ disable โWait For Sub-Workflow Completionโ
Once you finish all these setup steps, you can run the workflow through n8nโs chat interface. For example, send the following message:
I'm planning to build a wooden summer house and would appreciate guidance on the process. What are the key considerations I should keep in mind from planning through completion? I'm particularly interested in the recommended construction steps and which materials will ensure long-term durability and quality.
Customize this workflow for your needs
Feel free to modify the workflow to fit the scale and final output your project requires:
- To reuse this workflow, clear the data table after the final analysis by adding a Data table node with the Delete row(s) action
- Scale up by processing more search queries, increasing results per query beyond 10, and selecting additional relevant URLs
- Enable JavaScript rendering in Oxylabs AI Studio (Scraper) node to ensure all content is gathered
- Adjust the system prompts in LLM nodes to fit your specific research goals
- Explore other AI Studio apps like Browser Agent for interactive browser control or Crawler for mapping entire websites
- Connect other nodes like Google Sheets, Notion, Airtable, or webhooks to route results where you need them
๐ Nodes Used
Chat Trigger, OpenAI, Data table
๐ฅ Import
Download workflow.json and import into n8n:
Workflow menu โ Import from File