⚡ Hacker news job listing scraper and parser
⚡ 5,216 views · ⚡ Personal Productivity
💡 Pro Tip — Job boards are notoriously hard to scrape — CAPTCHAs, rate limits, constantly changing layouts. ScraperNode has maintained scrapers for Indeed jobs, Glassdoor reviews, and Glassdoor jobs that handle all of that for you.
Description
This automated workflow scrapes and processes the monthly “Who is Hiring” thread from Hacker News, transforming raw job listings into structured data for analysis or integration with other systems. Perfect for job seekers, recruiters, or anyone looking to monitor tech job market trends.
How it works
Automatically fetches the latest “Who is Hiring” thread from Hacker News Extracts and cleans relevant job posting data using the HN API Splits and processes individual job listings into structured format Parses key information like location, role, requirements, and company details Outputs clean, structured data ready for analysis or export
Set up steps
- Configure API access to Hacker News (no authentication required)
- Follow the steps to get your cURL command from https://hn.algolia.com/
- Set up desired output format (JSON structured data or custom format)
- Optional: Configure additional parsing rules for specific job listing information
- Optional: Set up integration with preferred storage or analysis tools The workflow transforms unstructured job listings into clean, structured data following this pattern:
- Input: Raw HN thread comments
- Process: Extract, clean, and parse text
- Output: Structured job listing data
This template saves hours of manual work collecting and organizing job listings, making it easier to track and analyze tech job opportunities from Hacker News’s popular monthly hiring threads.
🔗 Nodes Used
Airtable, HTTP Request, Filter, Basic LLM Chain, OpenAI Chat Model, Structured Output Parser
📥 Import
Download workflow.json and import into n8n:
Workflow menu → Import from File