Skip to content
This repository has been archived by the owner on May 25, 2021. It is now read-only.
/ 1999 Public archive

React proof of concept for web ASR and TTS

Notifications You must be signed in to change notification settings

pylon/1999

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

1999

We could all die any day 1999 / I don't wanna die / I'd rather dance my life away 1999 / Listen to what I'm tryin' to say...

A simple copycat web app that will listen for what you say and repeat it back.

Run

npm install
npm start

Motivation

The experiment had a two-fold purpose:

  1. Proof of concept for in-browser companion voice support using react.
  2. Explore built-in browser support for Web Speech API vis-á-vis a single controlled implementation.

Web Speech API Support

Browser OS ASR TTS Status
Safari macOS Partial Supported
Safari iOS Partial Supported
Chrome macOS Fully Supported
Chrome iOS Partial Supported
Chrome Android Partially Supported
Firefox macOS Partial Supported
Silk FireOS Partial Supported

Notes

https://caniuse.com/#feat=speech-recognition is the most accurate browser support matrix, but it's incomplete for mobile browsers.

Safari docs say that Web Speech API is fully supported, but that is a lie.

Most places say Firefox supports Web Speech API, but that is a lie too.

Chrome probably uses a Google ASR service. However, a Chromium contributor warns that there is discussion about deprecating Web Speech API.

Chrome on Android/FireOS probably works, but more debugging needed.

Backend

Web Speech API, cf https://developer.mozilla.org/en-US/docs/Web/API/Web_Speech_API

NLU

Unimplemented

ASR

Browser-specific, but only Chrome supports ASR, and it's ASR service is obfuscated but probably uses Google Speech API

TTS

Browser-specific, but all that I checked use the platform OS TTS service.

Frontend

React, using React Voice Components

Alternatives

License

Copyright 2018 Pylon, Inc.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0 Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.

About

React proof of concept for web ASR and TTS

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published