🔬 Process receipt images with GPT-4o-mini, WhatsApp & Google Sheets automation

⚡ 2,365 views · 🔬 Document Extraction & Analysis

Description

🧾An intelligent automation system that turns WhatsApp into your personal receipt manager — integrating Meta WhatsApp Cloud API, Google Drive, Google Sheets, and OpenAI GPT-4o-mini via n8n.

🎥 Demo: Watch the Loom walkthrough

⚙️ What It Does

The AI-Powered WhatsApp Receipt Bot automates the complete invoice handling process through a conversational interface.

Workflow Summary:

  1. User sends a receipt image via WhatsApp.

  2. The bot automatically downloads the media using the WhatsApp Cloud API.

  3. The image is uploaded to a Google Drive “Invoices” folder.

  4. The file is shared publicly, generating a shareable URL.

  5. The receipt is analyzed using OpenAI GPT-4o-mini to extract structured data:

    • Store name
    • Items purchased
    • Payment method
    • Total amount

  6. The extracted details are appended to a Google Sheet for record-keeping.

  7. The bot sends a human-readable summary back to WhatsApp with emojis and the invoice link.

Output Example:

🏬 Store: Big Bazaar  
📝 Items: Rice, Detergent, Snacks  
💳 Payment: Card  
💰 Total: ₹1520.75  
🔗 Link: https://drive.google.com/file/d/1abcXYZ/view

This system eliminates manual expense tracking, improves accuracy through OCR, and provides a seamless way to manage receipts in real time.

💡 Use Cases

ScenarioDescription
Personal Expense ManagementAutomatically store and categorize receipts from daily purchases.
Business AccountingCollect employee expense receipts through WhatsApp and centralize them in Google Sheets.
Freelancer or Consultant TrackingKeep a digital record of client reimbursements or software purchase receipts.
Family BudgetingFamily members send receipts to one shared WhatsApp number, all data gets logged centrally.
E-commerce / Delivery TeamsDrivers or delivery agents send invoices from the field to WhatsApp; data automatically goes to the accounting sheet.

🔧 Setup

1. Accounts and Tools Needed

ToolPurposeLink
Meta Developer AccountTo access WhatsApp Business Cloud APIhttps://developers.facebook.com/apps
Google Cloud AccountFor enabling Drive and Sheets APIshttps://console.cloud.google.com
n8n InstanceWorkflow automation engine (local or cloud)https://app.n8n.cloud
OpenAI API KeyFor GPT-4o-mini model OCR + reasoninghttps://platform.openai.com/account/api-keys

2. Meta Developer Setup (WhatsApp Cloud API)

  1. Go to Meta Developer Dashboard → My Apps → Create App → Business type.

  2. Add WhatsApp product under your app.

  3. Retrieve the following from WhatsApp > Configuration:

    • Permanent Access Token
    • Phone Number ID
    • WhatsApp Business Account ID

  4. Add these credentials in n8n → Credentials → WhatsApp API.

    • Use the same credentials for WhatsApp Trigger and Send Message nodes.

  5. Verify webhook in Meta with your n8n webhook URL.

Important: In your HTTP Node, set the header as:

Authorization: Bearer <access_token>

Replace <access_token> with your WhatsApp Cloud API permanent token. Without this, the workflow will fail to send or receive WhatsApp messages properly.

3. Google Drive Setup

  1. Create a folder named Invoices on your Google Drive.

  2. Copy the Folder ID (found in the Drive URL).

  3. In Google Cloud Console → APIs & Services → Enable APIs:

    • Enable Google Drive API
    • Enable Google Sheets API

  4. Go to Credentials → Create Credentials → OAuth 2.0 Client ID.

  5. Download the credentials.json file.

  6. Upload this to n8n → Credentials → Google Drive OAuth2 API.

  7. Authorize the connection on first workflow run.

4. Google Sheets Setup

  1. Create a new Google Sheet titled Invoices.
  2. Add the following headers in Row 1:
store name | discription | image_url | payment | total
  1. Copy the Sheet ID (from the URL).
  2. Add the ID under the Google Sheets Append node in n8n.
  3. Map each field to its corresponding value extracted from the OCR result.

5. OpenAI Setup

  1. Generate an API key from https://platform.openai.com/account/api-keys.

  2. Add it to n8n → Credentials → OpenAI API.

  3. Use model gpt-4o-mini in the “Analyze Image” node.

    • Can upgrade to gpt-4o for better OCR accuracy if account supports it.

6. n8n Workflow Setup

  1. Import the provided n8n workflow JSON.

  2. Configure credentials for:

    • WhatsApp API
    • Google Drive OAuth2
    • Google Sheets OAuth2
    • OpenAI API

  3. Activate workflow and set webhook in Meta Developer console.

  4. Send a test receipt image to your WhatsApp Business number.

The bot will automatically: Download → Upload → Extract → Log → Summarize → Reply

📊 Example Google Sheet Record

store namediscriptionimage_urlpaymenttotal
Big BazaarRice, Detergent, Snackshttps://drive.google.com/file/d/1abcXYZ/viewCard1520.75

🧠 Result

A fully automated AI pipeline that transforms WhatsApp into a smart expense-tracking interface — integrating vision, automation, and natural language processing for zero-manual financial documentation.

Support & Contact: If you face any issues during setup or execution, contact: 📧 Email: atharvapj5@gmail.com 🔗 LinkedIn: Atharva Jaiswal

🔗 Nodes Used

Google Sheets, HTTP Request, Google Drive, WhatsApp Business Cloud, AI Agent, OpenAI Chat Model

📥 Import

Download workflow.json and import into n8n: Workflow menu → Import from File

📖 Importing guide · 🔑 Credential setup