🎣 Job post to sales lead pipeline with Scrape.do, Apollo.io & OpenAI

⚡ 113 views · 🎣 Lead Generation & Enrichment

💡 Pro Tip — If you’re pulling LinkedIn data through HTTP requests or dealing with API restrictions, there’s a community node called ScraperNode that handles this natively. It has dedicated scrapers for profiles, companies, jobs, and people search — you just pass a URL and get structured data back.

Description

Lead Sourcing by Job Posts For Outreach With Scrape.do API & Open AI & Google Sheets

Overview

This n8n workflow automates the complete lead generation process by scraping job postings from Indeed, enriching company data via Apollo.io, identifying decision-makers, and generating personalized LinkedIn outreach messages using OpenAI. It integrates with Scrape.do for reliable web scraping, Apollo.io for B2B data enrichment, OpenAI for AI-powered personalization, and Google Sheets for centralized data storage.

Perfect for: Sales teams, recruiters, business development professionals, and marketing agencies looking to automate their outbound prospecting pipeline.

Workflow Components

1. ⏰ Schedule Trigger

Function: Ensures consistent, hands-off lead generation by running the pipeline automatically without manual intervention.

2. 🔍 Scrape.do Indeed API

Request Parameters:

Function: Fetches Indeed job listings with anti-bot bypass, returning clean markdown for easy parsing.

3. 📋 Parse Indeed Jobs

Extracted Fields:

Function: Parses markdown using regex patterns, filters invalid entries, and deduplicates by company name.

4. 📊 Add New Company (Google Sheets)

Function: Creates a historical record of all discovered job postings and companies for pipeline tracking.

5. 🏢 Apollo Organization Search

Request Body:

{
  "q_organization_name": "Company Name",
  "page": 1,
  "per_page": 1
}

Response Fields:

Function: Retrieves comprehensive company intelligence including LinkedIn profiles, industry classification, and employee count.

6. 📤 Extract Apollo Org Data

Function: Extracts relevant fields from Apollo API response and combines with job posting data for downstream processing.

7. 👥 Apollo People Search

Request Body:

{
  "organization_ids": ["apollo_org_id"],
  "person_titles": [
    "CTO",
    "Chief Technology Officer",
    "VP Engineering",
    "Head of Engineering",
    "Engineering Manager",
    "Technical Director",
    "CEO",
    "Founder"
  ],
  "page": 1,
  "per_page": 3
}

Response Fields:

Function: Identifies key stakeholders and decision-makers based on configurable title filters.

8. 📝 Format Leads

Function: Combines person data with company context, creating comprehensive lead profiles ready for personalization.

9. 🤖 Generate Personalized Message (OpenAI)

System Prompt:

You are a professional outreach specialist. Write personalized LinkedIn connection request messages. Keep messages under 300 characters. Be friendly, professional, and mention a specific reason for connecting based on their role and company.

User Prompt Variables:

Function: Generates unique, contextual outreach messages that reference specific hiring activity and company details.

10. 🔗 Merge Lead + Message

Function: Merges OpenAI response with lead profile, creating the final enriched record.

11. 💾 Save Leads to Sheet

Data Mapping:

Function: Creates actionable lead database ready for outreach campaigns.

Workflow Flow

⏰ Schedule Trigger
       │
       ▼
🔍 Scrape.do Indeed API ──► Fetches job listings with JS rendering
       │
       ▼
📋 Parse Indeed Jobs ──► Extracts company names, job details
       │
       ▼
📊 Add New Company ──► Saves to Google Sheets (Companies)
       │
       ▼
🏢 Apollo Org Search ──► Enriches company data
       │
       ▼
📤 Extract Apollo Org Data ──► Parses API response
       │
       ▼
👥 Apollo People Search ──► Finds decision-makers
       │
       ▼
📝 Format Leads ──► Structures lead profiles
       │
       ▼
🤖 Generate Personalized Message ──► AI creates custom outreach
       │
       ▼
🔗 Merge Lead + Message ──► Combines all data
       │
       ▼
💾 Save Leads to Sheet ──► Final storage (Leads)

Configuration Requirements

API Keys & Credentials

n8n Credential Setup

Key Features

🔍 Intelligent Job Scraping

• Anti-Bot Bypass: Residential proxy rotation via Scrape.do
• JavaScript Rendering: Full headless browser for dynamic content
• Mobile Optimization: Cleaner HTML with mobile viewport
• Markdown Output: Lightweight, easy-to-parse format

🏢 B2B Data Enrichment

• Company Intelligence: Industry, size, location, LinkedIn
• Decision-Maker Discovery: Title-based filtering
• Contact Information: Email, phone, LinkedIn profiles
• Real-Time Data: Fresh information from Apollo.io

🤖 AI-Powered Personalization

• Contextual Messages: References specific hiring activity
• Character Limit: Optimized for LinkedIn (300 chars)
• Variable Temperature: Balanced creativity and consistency
• Role-Specific: Tailored to recipient’s title and company

📊 Automated Data Management

• Dual Sheet Storage: Companies + Leads separation
• Timestamp Tracking: Historical records
• Deduplication: Prevents duplicate entries
• Ready for Export: CSV-compatible format

Use Cases

🎯 Sales Prospecting

• Identify companies actively hiring in your target market
• Find decision-makers at companies investing in growth
• Generate personalized cold outreach at scale
• Track pipeline from discovery to contact

👥 Recruiting & Talent Acquisition

• Monitor competitor hiring patterns
• Identify companies building specific teams
• Connect with hiring managers directly
• Build talent pipeline relationships

📈 Market Intelligence

• Track industry hiring trends
• Monitor competitor expansion signals
• Identify emerging market opportunities
• Benchmark salary ranges by role

🤝 Partnership Development

• Find companies investing in complementary areas
• Identify potential integration partners
• Connect with technical leadership
• Build strategic relationship pipeline

Technical Notes

Rate Limits to Consider

Setup Instructions

Step 1: Import Workflow

1. Copy the JSON workflow configuration
2. In n8n: Workflows → Import from JSON
3. Paste configuration and save

Step 2: Configure Scrape.do

1. Sign up at scrape.do
2. Navigate to Dashboard → API Token
3. Copy your token
4. Token is embedded in URL query parameter (already configured)

To customize search:

Change the `url` parameter in "Scrape.do Indeed API" node:
- q=data+engineer (search term)
- l=Remote (location)
- fromage=7 (last 7 days)

Step 3: Configure Apollo.io

1. Sign up at apollo.io
2. Go to Settings → Integrations → API Keys
3. Create new API key
4. In n8n: Credentials → Add Credential → Header Auth
   • Name: x-api-key
   • Value: Your Apollo API key
5. Select this credential in both Apollo HTTP nodes

Step 4: Configure OpenAI

1. Go to platform.openai.com
2. Create new API key
3. In n8n: Credentials → Add Credential → OpenAI
4. Paste API key
5. Select credential in “Generate Personalized Message” node

Step 5: Configure Google Sheets

1. Create new Google Spreadsheet
2. Create two sheets:
   • Sheet 1: “Add New Company”
     • Columns: companyName | jobTitle | jobUrl | location | salary | source | postedDate
   • Sheet 2: “Leads”
     • Columns: First Name | Last Name | Title | Company | LinkedIn URL | Country | Industry | Date Added | Source | Personalized Message
3. Copy Sheet ID from URL
4. In n8n: Credentials → Add Credential → Google Sheets OAuth2
5. Update both Google Sheets nodes with your Sheet ID

Step 6: Test and Activate

1. Manual Test: Click “Execute Workflow” button
2. Verify Each Node: Check outputs step by step
3. Review Data: Confirm data appears in Google Sheets
4. Activate: Toggle workflow to “Active”

Error Handling

Common Issues

Troubleshooting Steps

1. Verify Credentials: Test each credential individually
2. Check Node Outputs: Use “Execute Node” for debugging
3. Monitor API Usage: Check Apollo and OpenAI dashboards
4. Review Logs: Check n8n execution history for details
5. Test with Sample: Use known company name to verify Apollo

Recommended Error Handling Additions

For production use, consider adding:

- IF node after Apollo Org Search to handle empty results
- Error Workflow trigger for notifications
- Wait nodes between API calls for rate limiting
- Retry logic for transient failures

Performance Specifications

API Reference

Scrape.do API

Documentation: scrape.do/documentation

Apollo.io API

Documentation: apolloio.github.io/apollo-api-docs

OpenAI API

Documentation: [platform.openai.com

🔗 Nodes Used

Google Sheets, HTTP Request, OpenAI, n8n Form Trigger

📥 Import

Download workflow.json and import into n8n: Workflow menu → Import from File

📖 Importing guide · 🔑 Credential setup