About This Project
I built WhispFlow for the Talent Exhibition (PROMA2 course) in the BTS Cloud Computing programme at Lycée Guillaume Kroll. I chose a real documentation problem, designed a working solution, and applied the cloud and AI concepts from the semester.
The Problem
During meetings and lectures, important information often gets lost. Taking notes manually splits attention between listening and writing, and reviewing long recordings afterward is time-consuming. I wanted a simple way to leave each session with useful notes instead of another recording to search through.
The Solution
I built WhispFlow to turn a meeting or lecture into organized notes: record once, get a transcript, then receive key points, decisions, and action items ready to share. Everything runs on the computer by default, and you choose whether transcription or summaries use an online service.
Under the Hood
Desktop App
- Desktop shell with audio capture via the MediaRecorder API, session management UI, live waveform visualization, and organized file storage.
- Session management with search, tags, sorting, and context menus
Transcription Engines
- A built-in local engine (faster-whisper or whisper.cpp, models from tiny to large) or any OpenAI-compatible transcription API: Groq, OpenAI, or a self-hosted server. Chosen per run, with a fallback to the local engine if an API fails.
- Local or API transcription, chosen per run
AI Summarization
- One AI gateway for summaries in four styles, action items and transcript cleanup. Works with OpenAI, Mistral, Anthropic, Groq, Cohere, Ollama, LM Studio or any OpenAI-compatible endpoint, with model discovery. Only the transcript text is sent.
- AI summaries from eight providers, cloud or local
Local Storage & Versioning
- Session folders hold the audio, versioned transcripts, and cached summaries. Everything stays on your device in an organized structure that's easy to back up and export.
- Re-transcribe with a different model or language - no data is overwritten. Switch between transcript versions (v1, v2, v3...) via dropdown. Each version tracks the model, language, and timestamp. Summaries are keyed by transcript version and language (e.g. v1_en, v2_fr).
Core Workflow
Record - One-click recording or keyboard shortcut (Ctrl+R). Three modes: Microphone, System Audio, or Hybrid. Audio files can also be imported. Live waveform and timer during recording.
Transcribe - Pick the engine for each run: the local engine (faster-whisper or whisper.cpp, tiny to large models) or a transcription API such as Groq, OpenAI or a self-hosted server. Live captions have their own setting, so they can use a different engine than full transcripts.
Summarize - AI generates key points, decisions, action items and a full summary in four styles. Choose from eight providers, cloud or fully local, or add any OpenAI-compatible endpoint. Generate in any language.
Export - Export to PDF, DOCX or TXT with the transcript, summary and action items. Share with colleagues or classmates.
Lessons Learned
Hybrid architecture works
Local by default for privacy and offline use, with cloud engines as an option, so each user picks their own balance of speed, cost and privacy.
Model selection matters
Letting users choose between speed and accuracy (tiny vs. large Whisper models) solved the hardware-limitation problem elegantly.
Never overwrite user data
Versioning means you can always go back. Users trust the tool more when they know nothing gets deleted.
Cache everything expensive
Caching AI summaries by transcript version and language prevents needless API calls and keeps costs under control.
Project Phases
Phase 1 (Done) - Local-First: Desktop recording, local transcription, AI summaries, versioning, session management and export.
Phase 2 (In progress) - Open Engines: Transcription APIs (Groq, OpenAI, self-hosted), separate live captions, a local fallback when an API fails, and one provider list shared by transcription and AI are working. Cloud storage, sync, accounts and collaboration are still planned.