System map
Windows second-screen coaching system
Squidly
North star / never-ending improvementThe quiet second brain beside every high-stakes conversation.
A native C++ Windows orchestration system connecting desktop and audio capture, OCR, live transcription, context retrieval, configurable AI guidance, and a paired local Advisor UI.
- Hear the conversation, read the screen, and find the right reference at once.
- Keep the help private on a phone or second screen while you stay present.
- Switch between coding, conversation, local, and cloud brains without changing flow.
A fresh CMake build passes both native and browser smoke lanes. Squidly is still an explicitly Windows-first scaffold: richer shell, persistence, document extraction, backend packaging, and physical-device validation remain open work.
Scaffold - Windows prototypeSystem route
Follow the whole machine.
The public tour shows the shape. Members can open every chapter, search the atlas, follow related systems, and download eligible releases.
01screen + audio
02OCR + STT
03context assembly
04Advisor + session record
17 connected chapters
Every subsystem has a door.
Native host
One Windows process coordinates the system
config -> services -> sessionSecond screen
Three lanes keep different kinds of help separate
guidance | work | conversationVisual input
Desktop evidence enters through explicit capture actions
pixels -> text + meaningConversation input
Microphone and rendered audio stay distinct
two streams -> named turnsSpeech recognition
Manual and live speech routes are independently configurable
audio -> partial -> final turnText recognition
Fast local OCR and deeper image analysis coexist
image -> ordered evidenceGrounding
Current evidence is assembled with durable context
evidence + memory + referencesReference library
Folder-backed references become ranked snippets
folder -> chunks -> ranked contextModel boundary
Guidance is pluggable and visibly degraded
grounded prompt -> bounded helpLocal boundary
A small token-gated server connects the Advisor
token -> action + status streamDurable record
Each session leaves an inspectable local trail
session id -> inspectable recordOperations
Failures stay named and latency stays measurable
state + reason + latencyEvidence boundary
The scaffold has broad automated coverage and named limits
2/2 fresh lanes; scope remains narrowRuntime profile
One shipped config makes the active route visible
one profile, visible choicesLive loop
Turns can be refined without rewriting prior work
turn -> helper -> next turnLocal output
Guidance is joined to the evidence that produced it
evidence -> guidance -> record●
Unlock the manualMember library
Open the complete Squidly atlas.
Deep explanations, diagrams, cross-links, evidence, release history, and the latest eligible repository archive.