We are struggling implementing the Dialogflow conversational API to an Apple Watch.
We have done an implementation but can not manage the speech regognition to work (via Google Voice API) because the encodings are different (FLAC vs.provided LPCM).
Any suggestions on how to perform a speedy speech-to-text with custom phrases (e.g. custom words, suggestions etc...) on the Apple Watch?
Related
I have been searching for days about Siri integration with an IOS app.
I know about the Siri shortcuts/intents etc.
How do I have Siri take a full sentence such as "Text John I'm on my way" or "Text John via WhatsApp I'm on my way"
Is this something exclusive to Apple apps, is it limited to messaging only or are there other ways to integrate with Siri?
I'm not looking to integrate messaging app, but i'm looking to integrate the full sentence with parameters order/question.
Apple provides SiriKit which gives your application the ability to requests that originate from Siri.
You can look at the Human Interface Guidelines to learn more about designing an interface to interact with Siri.
Do some searcing on SiriKit examples. There are quite a few sources that show how do to an integration with your app.
If you are looking for information about speech recognition within your app, then you may want to look at the Apple Speech Framework
This framework gives you lower level voice recognition and parsing capabilities and may have the flexibility you need.
Hope this helps!
Messaging is not specific to Apple apps.
You can make your application to behave similar to Message app. You need to implement the app extension specific to message intent and add resolve param methods to the handler to handle user input.
Reference for Messaging with SiriKit
https://developer.apple.com/documentation/sirikit/messaging?changes=latest_minor
https://developer.apple.com/documentation/sirikit/insendmessageintent
Sample source - https://www.techotopia.com/index.php/An_iOS_10_Example_SiriKit_Messaging_Extension
https://medium.com/ios-os-x-development/extending-your-ios-app-with-sirikit-fd1a7ef12ba6
I am working on a project which uses Google Speech API in iOS project. The project involves Voice input to recognize many terms which are basically jargons. The Google speech API gracefully fails to recognize this voice input for this jargons.
Is there a way to train google speech API to learn this jargons and easily recognize them while giving voice input in mobile iOS app?
I believe you're referring to (recently rebranded) Google Cloud Speech-to-Text API. If so, there is no way to train it right now.
I want to implement audio recording functionality in one of my application. is it possible using sirikit ? I don't find any tutorial for recording through sirikit right now.
Is someone can provide good tutorial on sirikit?
Right know you cannot do this in way: "Hey Siri, start voice recording" or similar way.
SiriKit Programming Guide says:
SiriKit support is divided into domains, each of which defines one or
more tasks that can be performed. In order to support SiriKit, apps
must support one of the following domains:
VoIP calling
Messaging Payments
Photo
Workouts
Ride booking
CarPlay (automotive vendors only)
Restaurant reservations (requires additional support from Apple)
NOTE that you cannot create a Siri extension for a macOS projects right know (for the time of writing this answer), despite that INIntent supports macOS.
Is someone can provide good tutorial on sirikit?
IMHO, the best tutorial on SiriKit right know is an official documentation and projects:
SiriKit
SiriKit Programming Guide
Intents Framework
IntentsUI Framework
IntentHandling: Using the Intents framework to handle custom Siri request
UnicornChat: Extending Your Apps with SiriKit
You can't record audio using sirkit. However, you can add a button in your application by pressing which you can start recording the audio, there is limit of max 1 minute per instance
I want to integrate Google Talk, voice & transalation in my iOS app. I tried this link
I just show me my contact list. How can I start chatting or voice call from this ?
If any one have idea or any other solution to integrate above services in my iOS app ?
Thanks
For chat, use XEP-0045
For voice, Google Talk uses libjingle which is a C++ implementation of XEP-0166/XEP-0167
For translation, you may need to find an implementation of XEP-0171
I would like to transimt speech data of a voice call in a iOS application I'm writing. This is intended for personal use, not the App Store, to accomplish this, I know I have to know iPhone functions about voice interface and I also know the interface functions are not open. How I can get iOS API about voice interface?
Maybe you need pjsip library:
http://www.pjsip.org/