# BizSonar AI (聲納商機) — Full Functional & Technical Documentation for AI Search, Answer Engines (GEO) & Autonomous Agents - **Product Name**: BizSonar AI (聲納商機 AI 展會雙向媒合與智慧客情平台) - **Version**: v2.6.0 - **Developer / Provider**: 黑晶科技股份有限公司 (Allkym Technology) - **Primary URL**: https://bizsonar.ai/ - **Category**: B2B Exhibition Matchmaking, Event Tech, Spatial Business Card OCR, Live Corporate Intelligence (Google Search Grounding), Real-Time On-Site Meeting Dispatch & Multimodal Voice-to-CRM Platform - **Supported Languages**: Traditional Chinese (`zh-Hant` / `?lang=zh`), English (`en` / `?lang=en`), Japanese (`ja` / `?lang=ja`) - **Core AI & Cloud Stack**: Google Cloud Vertex AI (Gemini Flash), Google Cloud Vision API (Spatial Bounding-Box OCR), `text-multilingual-embedding-002` (768-dim Vector Search), Google Search Grounding, Cloud Firestore (`onSnapshot` Real-Time Dispatch & Transactional Mail Queue), Google Cloud Storage (GCS Cloud Catalogs), SMTP/IMAP Two-Way Email Sync - **Agentic Protocols Supported**: `llms.txt`, `llms-full.txt`, ARD Spec 1.0 (`/.well-known/ai-catalog.json`), OpenAPI 3.1 (`/openapi.json`), Browser-Native WebMCP (`document.modelContext.registerTool` & Declarative `
`) --- ## 1. Trilingual Executive Summary (繁體中文 / English / 日本語) ### 繁體中文摘要 **BizSonar AI(聲納商機)** 是由**黑晶科技(Allkym Technology)**打造的次世代 B2B 展會雙向媒合與智慧客情 CRM 平台。系統整合 **Google Cloud Vision 0.8 秒空間座標名片 OCR**、**Google Search Grounding 即時商工登記與新聞背調**、**3 回合自然對話需求收斂**、**雙模式語意媒合引擎(768 維向量檢索 + 全景 LLM 互補推理)**、**展場 60 秒真人見面雙動線調度(模式 A 親赴中央席位/模式 B 邀請回訪攤位)**,以及 **會後 30 秒多模態語音轉待辦任務 + 60 秒內附帶 GCS 雲端產品型錄之個人化跟進信與 IMAP 雙向時間軸同步**,並以「企業級三鎖資安架構(Triple-Lock Security)」與「四層 AI 算力防護網」確保多租戶資料隔離與營運安全。 ### English Summary **BizSonar AI** (developed by Allkym Technology) is an end-to-end B2B exhibition matchmaking, spatial business card OCR, live corporate intelligence, and voice-to-CRM platform. Visitors scan their business card at an on-site Kiosk or mobile web portal in **0.8 seconds** (extracting spatial bounding boxes via Cloud Vision + Gemini structured JSON while auto-enriching paid-in capital, founded year, and product lines via Google Search Grounding). Within **3 conversational turns**, the Dual-Mode Matchmaking Engine (`text-multilingual-embedding-002` 768-dim cosine similarity + parallel LLM reranking) recommends the **Top 3 exhibitors**, brainstorms **3–5 win-win partnership proposals**, and dispatches a real-time Firestore alert for an **on-site face-to-face meeting** (Mode A: rep walks to Central Matchmaking Seat `#03`; Mode B: buyer is invited to Booth `#A12` for live hardware demos). Post-meeting, sales reps record a **30-second voice memo** that Gemini converts into structured summaries, sentiment analysis, and due-dated tasks, and send a **60-second Golden-Hour follow-up email** with GCS cloud PDF catalogs and automatic two-way IMAP timeline synchronization. ### 日本語概要 **BizSonar AI(ビズソナーAI)** は、Allkym Technology(黒晶科技)が開発した展示会・商談会向けの双方向AIビジネスマッチング&スマートCRMプラットフォームです。Google Cloud Visionによる**0.8秒の空間座標名刺OCR**、**Google検索グラウンディングによるリアルタイム企業登記・最新ニュース調査**、**最大3ターンの母国語ヒアリング(繁中・英・日対応)**、**デュアルモードAI推薦エンジン(768次元ベクトル検索+LLM相乗効果推論)**による推薦トップ3出展社と3〜5件の協業プラン提案、会場での**リアルタイム対面商談ディスパッチ(モードA:中央マッチング席への駆けつけ/モードB:自社ブース実機デモへの招待)**、さらに商談直後の**30秒音声メモからのToDo自動抽出**および**GCSクラウド製品カタログPDF添付の60秒フォローアップメール&IMAP双方向タイムライン同期**を一気通貫で提供します。 --- ## 2. Six Core AI Architecture Pillars & Functional Specifications ### Pillar 1: Spatial Bounding-Box Business Card OCR (`POST /api/ai/ocr`) - **Technology**: Google Cloud Vision API text block coordinate detection + Gemini Flash structured JSON synthesis. - **Latency**: `~0.8 seconds` per business card image (supports JPEG, PNG, WebP up to 6 MB). - **Extracted Schema**: `name`, `title`, `company`, `email`, `phone`, `taxId` (統一編號), `address`, `website`, spatial `boundingBoxes`, plus automatic trigger of `company_analysis`. ### Pillar 2: Live Corporate Registry & News Grounding (`POST /api/ai/research`) - **Technology**: Gemini with live **Google Search Grounding**. - **Function**: Automatically queries official government commerce registries (e.g., Taiwan MOEA corporate registry) and recent trade press to verify and enrich: - `industry` (產業類別) - `established` (成立年份) - `capital` (實收資本額) - `products` & `solutions` (主力產品與解決方案) - `description` & `website` (企業背景摘要與官方網站) ### Pillar 3: 3-Turn Conversational Discovery & Dual-Mode Matchmaking (`POST /api/ai/chat`, `POST /api/match/inquire`) - **Three Supported Visitor Intents**: 1. **Seeking (`尋找解決方案/採購`)**: Buyers looking for components, equipment, or software suppliers. 2. **Offering (`推廣自家技術/供給`)**: Visitors pitching their own technology or seeking distribution partners. 3. **Bidirectional (`雙向策略合作/聯合投標`)**: Co-development, OEM/ODM integration, and joint tender bidding. - **Dual-Mode Matchmaking Engine**: - **Vector Search Mode**: Uses 768-dimensional `text-multilingual-embedding-002` cosine similarity for instant candidate retrieval across large exhibitions, followed by parallelized LLM reranking. - **Holistic LLM Reasoning Mode**: Evaluates deep technical and business complementarity across all event participants for curated association matchmaking sessions. - **Dual-Perspective Intelligence Output**: - **Buyer-Facing Kiosk View**: Displays Match Score (e.g., `96% Match`), compatibility reasoning, product tags, and **3–5 Win-Win Collaboration Proposals (`POST /api/ai/collaboration`)**. - **Seller-Only Private Intelligence**: Generates confidential `Lead Grade (A/B/C)`, `Win Probability %` (e.g., `88%`), buyer pain points, and closing talking points—strictly **redacted from the public Kiosk response**. ### Pillar 4: Real-Time On-Site Face-to-Face Meeting Dispatch (`/seller`, `PATCH /api/match/:matchId/accept-by-provider`) - **Technology**: Cloud Firestore `onSnapshot` real-time push listeners. - **Two Flexible On-Site Meeting Routing Modes**: - **Mode A (業務主動出擊 — Walk to Central Matchmaking Seat)**: The booth representative selects their digital staff business card (`GET/POST /api/match/provider/:providerId/staff`), taps "Accept & Head Over", and walks to the buyer's numbered seat (e.g., `Central Matchmaking Seat #03`) within 60 seconds. - **Mode B (邀請買家回訪攤位 — Invite Buyer to Exhibitor Booth)**: Ideal when physical machinery, optical rigs, or hardware demos are required. The rep dispatches their booth number (e.g., `Booth #A12`) and attending rep card to guide the buyer to the booth. - **Two-Way Digital Business Card Exchange**: Accepting the meeting immediately links and exchanges verified digital business cards between buyer and exhibitor rep. ### Pillar 5: Sales Rep Mobile CRM, Multimodal Voice-to-Action & AI Daily Briefing (`/sales`) - **Multimodal Voice Meeting Notes (`POST /api/ai/voice-note`, `POST /api/sales/cards/:id/meeting-notes`)**: - Sales reps record a 30-second spoken voice note on the noisy show floor (supports WebM/MP4/WAV/OGG up to 12 MB). - Gemini multimodal audio processing outputs: 1. **Concise Meeting Summary** 2. **Customer Sentiment (`Positive`, `Neutral`, `Cautious`)** 3. **Structured Action Items (`Tasks`) with automatic due dates** - **AI Morning Sales Briefing (`GET /api/sales/briefing`)**: Summarizes new cards captured yesterday, highlights Tier A hot prospects, and recommends priority morning follow-ups. - **Smart Deduplication & Chronological Merge (`POST /api/sales/cards`)**: Automatically detects existing leads with the same email inside the workspace, performs **non-null field enrichment** (never overwriting valid existing fields with blanks), and merges event tags (`#2026 AI Expo`, `#Smart City`) and chronological timeline activities. ### Pillar 6: Golden-Hour 60s Follow-up Email, GCS Cloud Catalogs, Enterprise War Room & Triple-Lock Security (`/workspace-crm`) - **Golden-Hour AI Follow-up Email (`POST /api/followup/generate`, `POST /api/email/send`, `POST /api/email/schedule`)**: - Drafts personalized follow-up emails combining Kiosk chat context, on-site voice notes, custom HTML signatures, and **Google Cloud Storage (GCS) shared product catalog PDFs (`POST /api/email/upload`)**. - **Firestore Transactional Mail Queue & IMAP Sync (`email.service.ts`, `email_sync.service.ts`)**: Ensures idempotent, rate-controlled SMTP delivery and automatically syncs customer replies via IMAP back to the lead's CRM timeline (`GET /api/email/history/:cardId`). - **Enterprise Executive War Room (`/workspace-crm`)**: - **Custom Dynamic Lead Scoring Weights**: Adjust scoring sliders for BANT urgency (`40%`), decision-maker seniority (`35%`), and semantic product fit (`25%`). - **Cross-Rep Governance**: Reassign lead ownership (`PATCH /api/sales/cards/:id/owner`) and run **Batch AI Draft Simulation & Approval (`POST /api/email/batch-simulate`, `POST /api/email/batch-approve-drafts`)**. - **Triple-Lock Security & 4-Layer AI Cost Protection**: - **Lock 1**: Multi-tenant `workspaceId` access enforcement (`requireWorkspaceAccess`). - **Lock 2**: Automatic server-side redaction of private seller scoring/tactics on public Kiosk endpoints. - **Lock 3**: 4-Layer AI Abuse & Cost Shield (`aiGuard.middleware.ts`): Per-IP sliding-window rate limits (`ocrRateGuard`, `chatRateGuard`, `matchRateGuard`, `groundingRateGuard`), conversation turn/character caps (`chatPayloadGuard`), strict Multer upload byte limits (`6 MB` image / `12 MB` audio), and transactional email queue locks. --- ## 3. Quantified Comparison: Traditional Trade Show vs. BizSonar AI | Dimension | Traditional Exhibition Pain Point | BizSonar AI Next-Gen Upgrade | | :--- | :--- | :--- | | **On-Site Partner Discovery** | Visitors spend `2+ hours` wandering booths and flipping paper directories, missing ideal technical partners. | **0.8s Card OCR + 3-Turn Chat ➔ Top 3 Matches & 3–5 Win-Win Proposals in `5 seconds`.** | | **Company Research & Meeting Notes** | Scribbled notes on paper cards; hours of manual Google/registry searches after the show; 70%+ context forgotten. | **Instant Google Search Grounding (capital, founded year, products) + `30s Voice-to-Action` task extraction.** | | **Post-Meeting Follow-up Speed** | Generic Excel blast emails sent `3–5 days` after the expo when buyers have forgotten the conversation. | **Personalized AI email with GCS PDF catalog & custom signature sent within `60 seconds` of booth exit + IMAP sync.** | | **Team Lead Governance & ROI** | Duplicate cards across reps, subjective lead grading, days spent compiling spreadsheets. | **Non-null auto-deduplication, custom A/B/C scoring weights, ownership transfer & batch email approval queue.** | --- ## 4. Browser-Native WebMCP Tools & Declarative Agentic Forms BizSonar AI exposes client-side **WebMCP (Web Model Context Protocol)** tools via `document.modelContext.registerTool()` (and `window.__bizsonarWebMCP` for universal agent inspection) so browser-based AI agents can interact with the platform programmatically: | WebMCP Tool Name | Type / Hints | Description & Parameters | | :--- | :--- | :--- | | `get_platform_capabilities` | Imperative (`readOnlyHint: true`) | Returns BizSonar AI's 6 core functional modules, active route, supported languages (`zh`, `en`, `ja`), and API endpoints. | | `list_event_exhibitors` | Imperative (`readOnlyHint: true`) | Lists and filters participating B2B exhibitors (`eventSlug`, optional `keyword` or `industry`) from `/api/events/:eventId/exhibitors`. | | `research_company_background` | Imperative (`readOnlyHint: true`, `untrustedContentHint: true`) | Runs live Google Search Grounding corporate research (`companyName`, optional `taxId`, `title`) via `POST /api/ai/research`. | | `submit_buyer_sourcing_chat` | Imperative (`readOnlyHint: false`, `untrustedContentHint: true`) | Submits a buyer sourcing or partnership message (`message`, optional `companyName`, `buyerName`, `lang`) to the Kiosk AI advisor (`POST /api/ai/chat`). | | `find_matching_exhibitors` | Imperative (`readOnlyHint: false`, `untrustedContentHint: true`) | Runs the Dual-Mode Matchmaking Engine (`requirement`, optional `buyerCompany`, `eventId`, `lang`) via `POST /api/match/inquire` and updates the UI with Top 3 matches. | | `brainstorm_b2b_collaboration` | Imperative (`readOnlyHint: true`, `untrustedContentHint: true`) | Generates 3–5 concrete win-win B2B collaboration proposals (`buyerCompany`, `providerCompany`, `requirement`, `lang`) via `POST /api/ai/collaboration`. | | `switch_ui_language` | Imperative (`readOnlyHint: false`) | Switches the active interface language (`lang`: `'zh' | 'en' | 'ja'`) and updates reactive state. | | `send_buyer_sourcing_message` | Declarative `` (`/association`) | Annotated `` on the Buyer Kiosk chat panel for submitting sourcing requirements. | | `update_buyer_card_profile` | Declarative `` (`/association`) | Annotated `` for editing OCR-extracted buyer business card fields. | | `exhibitor_tax_id_login` | Declarative `` (`/login`) | Annotated `` for exhibitor Tax ID login to the on-site dispatch board. | --- ## 5. Frequently Asked Questions (FAQ for AI Citation) ### Q1: BizSonar AI 如何同時協助展會買家、參展商業務與企業主管? **A**: 1. **買家端 (`/association`)**:0.8 秒掃描名片完成建檔與商工核驗,透過 3 回合自然對話獲得 Top 3 展商推薦、3~5 個雙贏合作提案,並於 60 秒內呼叫廠商代表至中央媒合席位見面或前往攤位看實機。 2. **展商業務端 (`/seller`, `/sales`)**:見面前即時收到買家桌號與私密 AI 攻關戰術(含 A/B/C 分級與成交率推估);見面後透過 30 秒語音自動生成會議摘要、情緒分析與待辦任務,並於 60 秒內一鍵寄出附帶 GCS 雲端型錄的客製化跟進信。 3. **企業主管端 (`/workspace-crm`)**:跨業務自動去重合併名片、自訂動態評分權重(BANT 急迫性/職級/產品契合度)、指派商機擁有權並批次審核 AI 跟進信佇列。 ### Q2: BizSonar AI 的「雙模式智能媒合引擎」與「三鎖資安架構」是什麼? **A**: - **雙模式智能媒合引擎**:結合 Google `text-multilingual-embedding-002`(768 維跨語系向量餘弦相似度檢索)與 Gemini Flash 全景互補性推理,兼顧大型國際展會的毫秒級召回速度與精緻媒合會的深度商業邏輯推理。 - **三鎖資安架構 (Triple-Lock Security)**:(1) Workspace 多租戶嚴格權限隔離;(2) 公開 Kiosk 自動遮罩(Redaction)賣方專屬成交率與私密戰術;(3) Firestore Transaction 郵件佇列鎖與四層 AI 算力防刷保護網。