multi-video-summarizer

name multi-video-summarizer description Summarize video/audio content from multiple platforms into structured notes with keyframe screenshots. Supports Bilibili (B站), YouTube, Douyin (抖音), Xiaohongshu (小红书), TikTok, and 1800+ sites via yt-dlp. Triggers on video URLs from any of these platforms, or Chinese requests like '总结视频', '视频笔记', '视频内容'. Detects URLs containing bilibili.com, youtube.com, youtu.be, douyin.com, xiaohongshu.com, tiktok.com, and more. Multi-Platform Video Summarizer Extract subtitles/transcripts from video platforms and generate structured notes. No login or cookies required. Supported Platforms Platform URL patterns Extraction method Bilibili (B站) bilibili.com/video/ , b23.tv/ , BV* Public API (WBI signing) YouTube youtube.com/watch , youtu.be/ , youtube.com/shorts/ youtube-transcript-api Douyin (抖音) douyin.com/ , v.douyin.com/ yt-dlp Xiaohongshu (小红书) xiaohongshu.com/ , xhslink.com/ yt-dlp TikTok tiktok.com/ yt-dlp Any other Any URL supported by yt-dlp (1800+ sites) yt-dlp Prerequisites Ensure Python 3 is available: python --version Dependency Check Before running the extraction script, check and install required dependencies based on the video platform: For Bilibili videos -- no extra dependencies needed (uses Python stdlib only). For YouTube videos: pip install youtube-transcript-api For Douyin, Xiaohongshu, TikTok, or any other platform: pip install yt-dlp Optional -- Whisper transcription (for videos without subtitles): OpenAI API mode: pip install openai Local mode: pip install faster-whisper Configure in config.json (see Whisper Setup below) Only install what is needed. If the user provides a Bilibili URL, skip dependency installation entirely. Workflow Step 1: Install Dependencies (if needed) Check the video URL to determine the platform. If it's NOT a Bilibili URL, ensure the required package is installed: pip install youtube-transcript-api yt-dlp If these are already installed, skip this step. Step 2: Extract Subtitles Run the extraction script with the video URL: python "<skill_path>/video_subtitle.py" "<VIDEO_URL>" Replace <skill_path> with the absolute path to this skill's directory, and <VIDEO_URL> with the video URL provided by the user. The script automatically: Detects the platform from the URL Tries platform-specific subtitle APIs (fast, free) Falls back to yt-dlp subtitle extraction if needed Falls back to Whisper audio transcription if configured The script outputs a JSON object to stdout containing: title - Video title author - Uploader name duration - Video duration description - Video description platform - Detected platform: bilibili , youtube , douyin , xiaohongshu , tiktok , or generic url - Canonical video URL source - Extraction method: subtitle , ai_conclusion , transcript_api , yt_dlp_subs , whisper_local , whisper_api subtitle_text - Full subtitle/transcript text (if available) frames - Array of keyframe screenshots (if ffmpeg is installed and extract_frames is enabled in config.json). Each frame has path (absolute file path) and timestamp (e.g. "01:30") error - Error message (if extraction failed) Step 3: Handle Errors If the output contains an error field: Check if the required dependencies are installed for that platform If the error mentions missing packages, install them and retry If Whisper is not enabled and no subtitles were found, suggest the user enable Whisper in config.json After fixing, retry the extraction Step 4: Generate Structured Notes (BibiGPT Style) When subtitle text is successfully extracted, summarize it into this BibiGPT-style format. Use the EXACT structure below, including emojis, section naming, and formatting. If frames array is present in the JSON output , embed one screenshot per content section using the Read tool to view the frame image file, then insert it with markdown image syntax right after the section header. Match frames to sections by timestamp order -- assign one frame per section sequentially. If there are more sections than frames, some sections will have no image. If there are more frames than sections, distribute evenly. # AI 一键总结：[ {title} ]( {url} ) # 🤖 {title} — 通俗解释 ### 🏷️ {Section 1 Title} ![ {Section 1 Title} ]( {frame_path_for_section_1} ) - {Key point from transcript, preserving original examples and analogies} - {Another key point} * {Sub-point or example} * {Sub-point or example} ### 💡 {Section 2 Title} ![ {Section 2 Title} ]( {frame_path_for_section_2} ) - {Content organized by topic} - {Preserve vivid analogies from the video} ### 🧠 {Section 3 Title} ![ {Section 3 Title} ]( {frame_path_for_section_3} ) - {Continue grouping content logically} ### 🍎 {Section 4 Title} ![ {Section 4 Title} ]( {frame_path_for_section_4} ) - {More content sections as needed} (... more sections using rotating emojis: 🏷️ 💡 🧠 🍎 🔑 🔢 🧱 🎯 ...) ### Summary - {One paragraph summarizing the entire video content concisely} ### Highlights * 🧠 {Highlight 1 with emoji} [#tag1] [#tag2] [#tag3] * 🔪 {Highlight 2 with emoji} [#tag1] [#tag2] [#tag3] * 🧮 {Highlight 3 with emoji} [#tag1] [#tag2] [#tag3] * 🔢 {Highlight 4 with emoji} [#tag1] [#tag2] [#tag3] * 🧱 {Highlight 5 with emoji} [#tag1] [#tag2] [#tag3] [#tag1] [#tag2] [#tag3] [#tag4] [#tag5] ### Questions * {Thought-provoking question 1 related to the video content} * {Thought-provoking question 2 that extends the topic} Guidelines for summarization: Use the original language of the subtitle (Chinese for Chinese videos, English for English videos, etc.) Use emoji-prefixed section headers (### 🏷️, ### 💡, ### 🧠, etc.) Use - for main bullet points and * (with 4 spaces indent) for sub-points/examples Group content into logical sections based on topic flow Preserve vivid examples, analogies and metaphors from the video Keep the summary concise but comprehensive Generate 5 highlights with emojis and 3 hashtags each Generate 2 thought-provoking follow-up questions Add 5 relevant hashtag topics at the end If the source is "ai_conclusion", note that the summary comes from B站's built-in AI summary feature If the source is "whisper_local" or "whisper_api", note that the transcript was generated via speech recognition and may contain minor inaccuracies Keyframe images : When frames are provided, embed them using ![title](absolute_path) syntax. Each section should have at most one image, placed directly after the ### header line. Use the absolute path value from the frames array as-is Whisper Setup (Optional) For videos without subtitles, Whisper can transcribe the audio. Edit config.json in this skill's directory: Option A -- OpenAI Whisper API (fast, requires API key, costs ~$0.006/min): { "whisper_mode" : "api" , "openai_api_key" : "sk-your-key-here" , "language" : "zh" } Option B -- Local faster-whisper (free, requires model download ~1-3GB): { "whisper_mode" : "local" , "whisper_model" : "base" , "language" : "zh" } Model sizes: tiny (fast, less accurate) / base (balanced) / small / medium / large (slow, most accurate). Douyin / Xiaohongshu / TikTok Cookie Setup These platforms require browser cookies for yt-dlp to access video content. The script tries --cookies-from-browser automatically, but on Windows with Chrome 127+ this often fails due to DPAPI encryption. Recommended: export cookies.txt manually Install the browser extension " Get cookies.txt LOCALLY " Open douyin.com (or xiaohongshu.com ) in your browser (login is NOT required, just visit the page) Click the extension icon and export cookies Save the file as cookies.txt in this skill's directory ( <skill_path>/cookies.txt ) The script will automatically detect and use this file for Douyin/Xiaohongshu/TikTok requests. Keyframe Screenshots (Optional) The script can extract keyframe screenshots from videos to embed in the summary. This requires ffmpeg to be installed. To enable/disable, edit config.json : { "extract_frames" : true , "frames_per_video" : 6 } extract_frames : true (default) to capture keyframes, false to skip frames_per_video : number of evenly-spaced frames to extract (default 6 ) Screenshots are cached in the screenshots/ directory. If ffmpeg is not installed, frame extraction is silently skipped.