NVIDIA Tokkio Reference Workflow
Intelligent interactive avatars for customer service
Meet James, an interactive digital human knowledgeable about NVIDIA and our products. James uses a collection of NVIDIA NIM microservices, NVIDIA ACE, and ElevenLabs digital human technologies to provide natural and immersive responses. To create your own digital human, developers can access the digital human NIM Agent Blueprint.
Interact with James
Built on NVIDIA ACE
Tokkio is an NVIDIA ACE customer service reference workflow. NVIDIA ACE is a suite of technologies for bringing digital humans to life with generative AI. Built on NVIDIA AI, graphics, and simulation technologies, NVIDIA ACE encompasses technology for every part of the digital human—from speech and translation, vision and intelligence, to realistic animation and behavior, to lifelike appearance.
Animation AI
Audio2Face™ simplifies animation of a 3D character to match any voice-over track—whether you’re animating characters for a game, film, real-time digital assistants, or just for fun. You can use the app for interactive real-time applications or as a traditional facial animation authoring tool. Run the results live or bake them out—it’s up to you.
Conversational AI
With NVIDIA’s conversational AI solutions—including NVIDIA® Riva for speech AI and NeMo™ framework for natural language processing—developers can quickly build and deploy cutting-edge applications that deliver high accuracy and respond in far less than 300 milliseconds, the speed for real-time interactions.
Vision AI
NVIDIA Metropolis enables the end-to-end computer vision (CV) workflow—from model development to deployment—for individual developers, higher education, research, and enterprises. Start with NVIDIA pretrained models, TAO, and DeepStream to make the end-to-end computer vision AI development process easier.
Recommendation AI
NVIDIA Merlin™ is an open-source framework for building high-performing recommender systems at scale. It includes libraries, methods, and tools that streamline the building of recommenders by addressing common preprocessing, feature engineering, training, inference, and deploying to production challenges.
See Customer Service Agents in Action
QSR Customer Service
See customers interact with Project Tokkio, an ACE-powered conversational-AI kiosk. This reference application utilizes NVIDIA Metropolis vision AI and NVIDIA Riva speech AI technology to communicate with the user. It uses NVIDIA’s NeMo Megatron-Turing 530B, a state-of-the-art language model for understanding intent, and NVIDIA Merlin to make meaningful recommendations. The 3D avatar is animated and visualized with NVIDIA Omniverse™ to deliver a visually stunning customer service experience—all in real time.
Natural, Expert Q&A Assistant
In this demo, we see one example of Project Tokkio—a “talking kiosk” reference application featuring a photorealistic, lifelike autonomous avatar responding to challenging domain-specific questions. The avatar, built in Omniverse, is a reference application that uses several key NVIDIA technologies, including NVIDIA Riva for speech AI, NVIDIA’s NeMo Megatron Megatron-Turing 530B large language model, and a combination of NVIDIA Omniverse animation systems for facial and body animation.
DRIVE Concierge
ACE enables NVIDIA DRIVE Concierge™ to serve as everyone’s digital assistant—helping them make recommendations, book reservations, make phone calls, and provide alerts. It’s personalized to each driver and passenger, giving every vehicle occupant their own personal concierge. Passengers can have a natural conversation with the vehicle and use voice to control many functions that previously required physical controls or touch screens.