Upload
Meeting or lecture recording → local media storage + meeting ID
Local Speech AI · Full-Stack Application / v0.5.0
A local-first full-stack AI application that turns meeting and lecture recordings into transcripts, summaries, key points, action items, and searchable knowledge without sending meeting content to a cloud AI service.
Meeting recordings can contain sensitive information, while cloud transcription and AI services introduce privacy and dependency concerns. I wanted to explore an end-to-end workflow where speech recognition, language-model processing, and meeting history stay on the machine running the backend.
I combined faster-whisper for multilingual speech-to-text with FastAPI orchestration, Ollama for structured analysis and transcript-grounded Q&A, SQLite persistence, and a Next.js interface. The Whisper model is cached per backend process and processing timings are exposed in the UI to make local-model latency visible.
Audio or video recordings are uploaded to the FastAPI backend and stored locally under a generated meeting ID.
faster-whisper performs multilingual speech-to-text locally; the model is reused within the backend process to avoid repeated initialization.
The transcript is analyzed by a local Ollama model into a title, summary, key points, and action items, then persisted in SQLite.
Users can ask questions grounded in the stored transcript, revisit meeting history, export notes or transcripts, and delete local meeting data.
Meeting or lecture recording → local media storage + meeting ID
faster-whisper → multilingual local transcript
Transcript → Ollama → structured summary, key points, and action items
Stored transcript + question → grounded local answer
The multilingual faster-whisper small model runs on CPU with int8 compute, VAD, and model reuse for a practical local transcription workflow.
Ollama converts transcript content into validated meeting fields while the backend normalizes model output before persistence.
Questions are answered from the selected meeting transcript, with instructions to state when requested information is absent instead of inventing it.
Separated and measured transcription and analysis time, cached the Whisper model, and tuned the local workflow so performance bottlenecks are visible and can be optimized independently.
Improved backend parsing and normalization after malformed JSON responses during development so analysis failures do not silently corrupt meeting data.
Designed the application around local speech recognition, local LLM inference, SQLite, and local media/transcript storage rather than a hosted AI API.
Version 0.5.0 implements the complete upload-to-knowledge workflow: local transcription, structured AI analysis, persistent meeting history, grounded transcript Q&A, deletion controls, exports, and visible Whisper/AI timing. GitHub Actions verifies the Python backend and production Next.js build.
The key learning: a useful local meeting assistant is more than a transcription model. Speech recognition, robust structured LLM output, persistent history, grounded answers, and visible processing time have to work as one coherent system.
This case study is based on the project’s own documentation.
Agentic AI · Production Engineering
A production-oriented agentic workflow platform with structured decisions, tool calling, human approval, asynchronous processing, and AWS Infrastructure as Code.
Evidence-Based AI · Full-Stack Application
A local-first CV-to-job matching assistant with transparent scoring, evidence states, and guarded AI writing.
Local RAG · Full-Stack AI Application
A privacy-first document assistant with local AI, streaming answers, and visible sources.