Back to Work
AI Product

SherpaNova

AI cooking companion with real-time Simli avatar. Melissa guides users through recipes with live video, voice interaction, and step-by-step chapter navigation — a full interactive cooking experience.

SimliReal-time AvatarNext.jsAI Voice
2025
SherpaNova
SherpaNova screenshot
SherpaNova screenshot
SherpaNova screenshot
SherpaNova screenshot
SherpaNova screenshot

Overview

SherpaNova is a hands-free AI cooking companion built around Simli's real-time avatar technology. Users interact with 'Melissa' — a live AI avatar who guides them through recipes via video and voice, with chapter-based navigation and real-time conversation.

01

The Challenge

Building a seamless real-time experience where an AI avatar responds naturally to cooking questions, syncs with recipe steps, and handles voice interaction — all while the user has flour on their hands.

02

Our Solution

Integrated Simli's real-time avatar API for live video/voice, built a chapter-based recipe navigation system, and designed a hands-free UX with microphone controls. The avatar responds contextually to the current recipe step.

Results & Impact

01

Real-time AI avatar cooking companion — fully interactive

02

Voice-controlled, hands-free cooking experience

03

Chapter-based recipe navigation with step tracking

04

Live AI avatar via Simli with natural conversation

05

Production-ready cooking platform

Technology

Next.jsSimli APIWebRTCAI VoiceTypeScriptTailwind CSS