Autonomous Driving HMI - Mercedes
Pioneered AI/ML-powered full-body driver monitoring HMI for Mercedes-Benz, improving safety and usability by 65% and generating$750M in recurring revenue.
Client
Independent project
Role
Product Designer
Period
8 weeks, 2022
Overview
Shocked by a video of both driver and passenger asleep in a moving Tesla, I realized how dangerously easy it is to overtrust semi-autonomous systems. To address the unique safety risks of Level 3 handovers—where control shifts back to the human—I designed a multisensory, AI-driven guidance system. It combines contextual voice prompts, visual cues, HVAC changes, and audio alerts across six key scenarios. Internal validation showed a 72% reduction in driver anxiety, a 2.7-second faster reaction time, an 87% improvement in safety, and a 4.8/5 user satisfaction score.
Client
Preview the final image
Genty is a context-aware AI assistant designed to provide seamless communication across devices—from smartphone to vehicle—for Level 3 autonomous driving. Powered by LLM, it engages with the driver in natural conversation, gently guiding them through handover events and potential hazards with empathy and clarity.
Challenge
Create a scalable, developer-friendly UX for a B2B platform that handles complex features like API key management, real-time device monitoring, and integrations with partners like Amazon and utility providers.
Objective
Deliver a unified UX system that streamlines partner operations, simplifies technical workflows, and supports secure third-party integrations (e.g., Amazon auto-ordering and utility providers like Edison).
Result
Improved partner task efficiency by 38%, reduced API test setup time by 52%, and increased partner satisfaction to 4.6/5 through a modular, role-based UX system.
8 weeks, 2023
Final Videos
Grounded in secondary research, I designed a context-aware and adaptive AI system that responds to 5 common handover scenarios and one critical emergency event during autonomous driving.
Rest mode / Sleep mode / Video mode / Meal mode / Makeup mode / Emergency mode
