
Air-Gapped Healthcare AI Assistant
15 · Case Study
Air-Gapped Healthcare AI Assistant
An offline conversational AI assistant designed for privacy-sensitive healthcare environments and live congress demonstrations.
- Role
- Privacy-first AI experience lead
- Context
- Healthcare congress · Offline demonstration environments
- Collaborators
- Security reviewMedical legalDemo training
The Situation
Healthcare buyers asked sharp questions about AI, privacy, and data handling — often within earshot of competitors. Cloud-dependent demos created hesitation; compliance teams blocked anything that felt like patient context leaving the device.
Goal & Expectations
Deliver a conversational assistant that worked fully offline for live congress demonstrations. Keep interactions grounded in approved knowledge while feeling responsive walk-up, not like a lab prototype.
Challenges
The hard parts were rarely just creative. They were floor reality, feasibility and the people who had to run it live.
Trust without connectivity
Visitors assumed “offline” meant limited or fake. The experience had to feel immediate and credible while never phoning home.
Demonstrator control
Staff needed clear reset, topic boundaries, and graceful answers when questions crossed into unsupported territory.
Show hardware reality
Congress machines varied in performance. Local inference had to stay stable through long demo days without mysterious slowdowns.
Where I Came In
I joined to design demonstration flows and guardrails around a fully local assistant — what visitors see first, how answers cite approved material, and how demonstrators recover from edge questions.
Approach
Focused on conversation paths that showcase usefulness within compliance bounds. Rehearsed with legal and medical reviewers using real floor questions, not sanitized scripts.
What We Built
Visitors and demonstrators held natural Q&A grounded in a local knowledge base — no external network calls. The booth could discuss AI seriously in environments where cloud demos were non-starters.
Other Teams Involved
Security architecture, medical legal for response policy, and field demo trainers for staff scripts.
On the Floor
Benchmarked on congress-grade hardware before ship. Documented daily restart and cache procedures booth staff could run without engineering on site.
End Result
Healthcare demonstrations ran a working offline conversational experience suitable for privacy-sensitive congress settings.
Final Thought
Air-gapped demos are a promise problem: you are asking people to believe nothing leaves the room. I am proud when a compliance officer relaxes enough to let staff invite visitors in — that nod is the whole project.
Capability notes
For teams who want the build detail: the experience drew on the tools and patterns below. The story above is what visitors and stakeholders felt on the floor.
- Llama 2
- RAG
- ChromaDB
- LangChain
- Python
- Local / offline inference
Client confidential — delivered for a brand presenting in this context. The client name is withheld under NDA.