Offline speech recognition on mobile

[JRMeyer]

>>> Allenlee
[December 4, 2017, 5:44pm]

Can DeepSpeech let me implement local, offline speech recognition on
mobile?

[This is an archived TTS discussion thread from discourse.mozilla.org/t/offline-speech-recognition-on-mobile]

[JRMeyer]

>>> reuben
[December 6, 2017, 1:11pm]

Right now, you could do it on a high end phone, but it would be slow. We
haven't yet created models optimized for inference on mobile devices,
but it's on the roadmap.

[
[[madbilly
[March 25, 2018, 9:13pm]

I was just wondering how to use Mozilla Deep Speech in Android instead
of the Google Voice service. I guess it's not possible yet? What's the
roadmap, roughly? How can someone with little coding experience help? slash
Cheers
![:slight_smile:](

[Archived Post]

[JRMeyer]

>>> tonytopper
[December 5, 2019, 10:32pm]

Any update on getting Deep Speech on to an iOS device?

[Archived Post]

[JRMeyer]

>>> reuben
[December 5, 2019, 11:34pm]

There's been progress, in that the model is actually convertible to
CoreML now: mozilla/DeepSpeech#642 and
tf-coreml/tf-coreml#309

Next steps would be:

1. Adding a class that implements the ModelState API using CoreML,
similar to how we currently have TFModelState and
TFLiteModelState implementations.
2. Figuring out how to compute features, as I've had to remove the
feature computation sub-graph to get the CoreML conversion to
finish. I don't think the AudioSpectrogram/MFCC ops are supported in
CoreML. I'd start by simply vendoring TensorFlow's kernels and
building those into libdeepspeech.so. We could even use this work in
all model types, to reduce overhead.
3. Figuring out packaging for iOS. Nobody on our team has iOS
experience so I don't have any suggestions for this. Basically, make
it possible to build a DeepSpeech package with the format used for
iOS dependency management.

[Archived Post]

[JRMeyer]

>>> reuben
[December 5, 2019, 11:33pm]

Step 3 would possibly also involve adding Swift bindings to the C API.

[Archived Post]

[JRMeyer]

>>> kezakool
[February 7, 2020, 5:31pm]

sorry if i missed something, but does it mean that for now, the best way
to make a deepspeech model run streaming inferences on IOS is :

thxs

[Archived Post]

[JRMeyer]

>>> imart
[August 19, 2020, 10:10am]

could you update this thread?
Is the DeepSpeech library available on iOS? If isn't yet could you share
maybe plans regarding these activities?

[Archived Post]

[JRMeyer]

>>> lissyx
[August 19, 2020, 11:08am]

It is available as documented in the 0.8 release notes, as a preview for
feedback.

[Archived Post]

[JRMeyer]

>>> imart
[August 19, 2020, 11:21am]

Great, thanks for update! slash
Is there any demo or example how use the library in iOS app?

[Archived Post]

[JRMeyer]

>>> lissyx
[August 19, 2020, 11:24am]

Please: https://github.com/mozilla/STT/tree/master/native_client/swift

[Archived Post]