Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Wanting to disable recording from the App Voice Service #93

Open
ElDuderini opened this issue Jul 29, 2024 · 1 comment
Open

Wanting to disable recording from the App Voice Service #93

ElDuderini opened this issue Jul 29, 2024 · 1 comment

Comments

@ElDuderini
Copy link

Having trouble setting up a more custom implementation of this SDK where I want to manage transcription with the Open AI whispers for on-device transcription so I can also utilize that API for a wake word to activate voice commands.
https://github.com/Macoron/whisper.unity

However since there isn't an option for the microphone to not be recording while the script is active, there is a conflict in terms of getting access to the microphone. I tried workarounds for this where the Wit voice experience game object was enabled and disabled based on when the wake word was triggered. This would work for the first command, but then the activation would cease to function like it should when the 2nd voice command was issued.

I know this SDK offers Activate(String) as a function, so I want to just fully manage transcription via the whispers API and then send the string to WIT for processing after the wake word is triggered.

Version 66 of the Oculus voice SDK

@yolanother
Copy link
Contributor

yolanother commented Aug 20, 2024

Sorry for the delay. This is definitely possible. There is a hook for custom transcription services that will plug in directly to the activation process or you can do as you asked call AVE.Activate(String); If you are having mic conflicts there are ways to work around that by using a shared mic buffer. I think I put up a video on doing that at some point where I hooked up one of the unity on device ASR assets. I'm working on a project now to do this as well so I will be reverifying this works soon. I think I set up something similar to this a while back using PocketSphinx a while back that might help you as well (https://www.youtube.com/live/jeSx6VzpMhk)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants