How to make Siri launch app on specific keyword? - ios

When I say "Translate English to Spanish" Siri opens the app Google Translate.
How does Siri know to launch this app and is it possible to register your app for certain keywords with Siri?

Usually you can open an app telling Siri something like:
"Open [APP NAME]"
My guess
In your case I guess Siri is not interpreting the sentence. When you say Translate English to Spanish Siri does try to understand what action should take and since no action with an hight Matching Rate is found then Siri tries to open the App having a name equals to the first word of your sentence.
Test 1
In Italian language the app is named Traduttore. When I say Traduci dall'italiano all'inglese (Translate English to Spanish) Siri does NOT open the translator because Traduttore does not match Traduci.
Test 2
If I say: Musica dall'italiano all'inglese (Music italian to english) which is not a real command, Siri does open the Music app.
Siri and third parties apps
Right now the interaction between Siri and third parties apps is pretty limited, however maybe in the future Apple will provide the tools for a deeper interaction.
Maybe something like what is happening with HomeKit where Apple created an interface to make Siri and Home Devices to talk each other.

You should look at Siri's custom vocabulary.
At the moment it is limited to your App's name and Apple specified domains e.g. Workouts or Ride Booking
But if you're lucky enough that your application falls within those categories you can map some more app specific terminology.
For example, if you had a rock climbing application, Ascent, you could start with a voice command similar to "Hey Siri, start climb" rather than "Hey Siri, start workout with Ascent"
All of your localized vocab choices should be placed into their appropriate language-specific project directories (.lproj).

Related

react-native run siri shortcut without opening the app

I am using "react-native-siri-shortcut' library to make shortcuts.
suggestedInvocationPhrase for my shortcut is "It's Tea Time" so when the user says "Hey Siri, It's Tea Time" then Siri opens the app and gives the whole shortcut object via addShortcutListener, but this listener only works when the app is in foreground or background.
This listener is not working when the app is completely closed.
So now what I want is to make an one shortcut that work's without opening the app. I just want to call a single API whenever the user say "Hey Siri, It's Tea Time" and once the API called Siri have to say back "Your order was placed successfully..." (I want all this process without opening the app).
here are some reference:
https://medium.com/simform-engineering/how-to-integrate-siri-shortcuts-and-design-custom-intents-tutorial-e53285b550cf
https://github.com/Gustash/react-native-siri-shortcut/issues/87

Limits of SiriKit?

I'm thinking a lot about how Siri could improve the UX of my App.
I'm coding an app dedicated to fitness, to log your workouts and your personal records.
I would like to let the user use Siri to use features of my App, but I don't really understand if it's possible or not. I read the documentation but it's not very clear for me, I don't know if Siri is limited to "start / stop / pause / resume a workout" or if we can do more.
( https://developer.apple.com/documentation/sirikit/workouts )
I would like to add things like that:
"Hey Siri, what's my personal record for deadlift?"
"Hey Siri, log 230 reps for my workout of the day"
"Hey Siri, what is the workout of the day?"
Could you tell me if it's possible to do that? Is it possible to connect Siri with your app and your database / functions?
The possible actions that Siri can initiate (the "intents") are pre-defined by Apple. From https://developer.apple.com/documentation/sirikit:
SiriKit defines the types of requests—known as intents—that users can
make. Related intents are grouped into domains to make it clear which
intents you might support in your app. For example, the messages
domain has intents for sending messages, searching for messages, and
marking messages as read or unread.

How does SiriKit parse commands for Pinterest

Could anyone enlighten me how does Siri recognise this sentence for Pinterest?
Pinterest: Find specific ideas you've saved: "Hey Siri, find women's
fashion Pins on Pinterest." https://www.imore.com/siri-apps-faq
I suspect its using INSearchForPhotosIntentHandling since the sentence has the closest reference to photos. The second thing I suspect is the use of Custom Vocabulary by swapping out "photo" with "Pins".
https://developer.apple.com/documentation/sirikit/registering_custom_vocabulary_with_sirikit
These are my current speculations for now, but I would like some clarity on this.
Use Case
I have an app that is centered around food reviews and I am hoping to integrate Siri to assist in Searching for food.
An example command:
"Hey Siri, find Japanese food in MY_APP."
"Hey Siri, find Japanese food reviews in MY_APP."
My keywords could be Food or Food Reviews or Reviews.
Siri process the request for your app based on the Intent that is supported by the app. There are only limited categories that is supported by Siri now.
So the siri know the vocabulary for these categories and it also uses your apps custom vocabulary to process the user given string to call the corresponding Intent from your extension.
IMO, you can consider reviews as notes and support INSearchForNotebookItemsIntentHandling by modifying the siri vocabulary.
Or the best way is to write to apple to add your corresponding domain in the siri's list of domains

Swift 3 - Run an app with specific keyword by using Siri

According to Intents and thanks to this thread, I know that you can open your app via Siri with "Open [APP NAME]",
What I want to know is if it is possible to tell to Siri just only one word like 'Cheese' to open the Camera app or an other specific keyword set beforehand to open your own app using Siri.
Is it possible ? If yes, I have to use Intents to do that or there is another way ?
Siri runs on the OS level, so in order to use any intents you have set within your app, the user must specify your app.
"Get a ride with Lyft" or "Message Mom in Facebook" etc..
More examples in the doc:
https://developer.apple.com/sirikit/
You can use shortcuts app which comes inbuilt in all iOS devices, for knowing more about Siri Shortcuts refer below links.
https://developer.apple.com/documentation/sirikit/adding_user_interactivity_with_siri_shortcuts_and_the_shortcuts_app
https://www.pocket-lint.com/phones/news/apple/144718-what-is-siri-shortcuts-and-how-does-it-work

How to detect language of the WatchKit voice-to-text input?

I am trying to get some input from the user on the Apple Watch using presentTextInputControllerWithSuggestions. I wonder what happens if user speaks multiple languages – is there a way to detect which language has he spoken?
Also, is there a way to find out what languages are set in his preferences?
Not having a Watch on hand, I don't think anyone here knows. (Edit: this was first posted before the Watch launched.) But even though it'd be really cool if there were dictation software that could guess cual idioma で話しています from word to word, watchOS is no different than iOS in that respect.
In iOS, Siri listens only in the language you set in Settings, and dictation listens only in the language of the active keyboard (whose microphone button you pressed to start dictation).
In watchOS, Siri likewise has a set language. Dictation is based on the keyboard language last used on your paired phone, but you can also change the language during text entry with a force press. That's a user choice for a system service, so it's opaque to the app, just like choice of keyboard is to an iOS app. (You're welcome to perform some sort of text analysis of you want to know what language of text the user has entered.)

Resources