Explorations
Field Notes
The full archive
Log of experiments in interaction design. Each entry documents what I built, what I used to build it, and what I learned. Most include an artifact: a prototype, a video, or something you can try.
Multimodal work
I am evaluating tools to create AI agents and virtual humans powered by the latest AI models, with a focus on designing multimodal communication patterns. I'm interested in how these tools can facilitate more natural interactions between humans and technology.
Tiny experiments in multimodal AI interaction design
PrivacySim: Practice at the Counter
A virtual human that coaches pharmacists to protect personal information at the counter. Prototyped with Tavus to test my privacy patterns.
PharmAssist: Show, Don't Speak
Designing privacy for the pharmacy counter. Learning Voiceflow along the way.
Multimodal AI should fit like broken-in denim
From years of designing with people with disabilities, what I believe multimodal AI still needs to get right.
Design concept glossary
Concepts named across the experiments above.
- Deictic privacy
- Speaking in words that only resolve with shared context, using pronouns and spatial references ("that," "there," "it") instead of explicit details.
- Default-private
- Ensuring that sensitive details and personally identifiable information remain protected by making non-disclosure the standard setting.
- Channel splitting
- Strategically utilizing diverse communication paths to time and tailor content delivery, ensuring messages are optimized for the specific situation and audience.
- Show, don't speak
- In the context of conversation design, the "show, don't speak" principle utilizes visual aids to convey information. This approach keeps details private or provides necessary context by displaying the specific items or concepts under discussion, rather than relying solely on verbal explanation.
- Context-released information
- The strategic practice of timing the delivery of information based on an AI's real-time understanding of the user's immediate social or physical environment.
- Cooperative recording
- A mutual agreement to record and transcribe a dialogue so participants can capture complex spoken details, particularly during consultations with specialists like doctors or pharmacists.
Past entries
Can AI Teach Design Theory? Designing Strain and Recovery Icons for my Fitness Wearable
How I used AI-powered tools to reconnect design theory and practice in a one-day UX experiment.
My First Tiny Experiment: Digitizing Physical Spaces
What happens when you try to map a physical room into a digital interface in one week.
Learning in Public: Why I'm Sharing a Week of Tiny Experiments
On why showing unfinished work is more useful than waiting for the perfect case study.