Skip to content
This repository has been archived by the owner on Aug 9, 2019. It is now read-only.

Home

Jump to bottom
Scott D'Angelo edited this page Jun 5, 2017 · 13 revisions

Use Watson services for Virtual Reality Voice Interactions with Google Cardboard

Create voice commands for Cardboard VR experiences with Watson services

This journey will allow developers to explore adding IBM's Watson Speech-to-Text and Watson Conversation to a Virtual Reality environment in Android Cardboard VR, built in Unity.

By Scott D'Angelo

Intro

In Virtual Reality, where you truly “inhabit” the space, speech can feel like a more natural interface than other methods. Providing speech controls allows developers to create more immersive experiences. Google Cardboard is by far the most popular VR headset platform, with 84 million sold in 2016 (http://www.hypergridbusiness.com/2016/11/report-98-of-vr-headsets-sold-this-year-are-for-mobile-phones) in 2016.

Flow

NOTE TO PUBLISHING TEAM: "HTC Vive" label should be changed to "Google Cardboard Android App".

  1. User builds the Speech Sandbox Playground using Unity and deploys to an Android Phone or runs in the Unity emulator.
  2. While speaking into the phone, commands are issued and translated using Watson's Speech-to-Text service.
  3. Watson's conversation service is used to communicate with the Cardboard application.

Included components

  • IBM Watson Conversation: Watson Conversation allows you to quickly build, test and deploy a bot or virtual agent across mobile devices, messaging platforms like Slack or even on a physical robot. Conversation has a visual dialog builder to help you create natural conversations between your apps and users, without any coding experience required.

  • IBM Watson Speech-to-Text: Converts audio voice into written text.

Featured technologies

  • Systems
  • Virtual Reality
  • Gaming
  • Artificial Intelligence
Clone this wiki locally