How to make Google Assistant reply - google-assistant-sdk

I got the Google Assistant running on a Raspberry. Everything is working fine but there is one thing that I cannot figure out.
I know that ifttt.com has the ability to make the Google Assistant reply with spoken language using text that you can predefine.
How can I do that using Python? I cannot find anything about that subject on the Google Assistant SDK page. How can I make the Google Assistant talk back? Is there documentation about this subject?
Example:
If I tell the Assistant:
"Light's out."
I want it to reply:
"Yes sir, the lights are out."

By hosting your backend fulfillment from your Raspberry Pi you can build an action in Google Assistant which can control both your GPIO pins and can send out custom replies as you wanted above. I used flask and ngrok to host from my Raspberry Pi and create a webhook.

Related

Google Assistant Account Linking via OAuth does not transfer from Speaker to Phone

I am working on an Action on Google for one of our customers.
We are currently trying to transition from pure Google SignIn to Google SignIn + OAuth (Auth Code - docs).
For that we use the OAuth implementation of said customer, which works fine.
When testing on the phone or the Google Assistant App, there is a pop-up that allows to link the action to the Auth provider. This works as intended.
However when testing on the speaker (Google Home + Google Home mini), the documentation says, that it should trigger a transfer to the phone via a notification on the device.
This does not happen unfortunately - we do not get any activity on our device.
We already asked the (AoG) support for help or known issues, but they could not help us with this and asked us to post our question over here.
More Information:
both devices are logged in with the same Google Account
Google Assistant App + Google Home App is installed
tested with Google Workspace account + with #gmail account
tested on iOS (14.5.1 - iPhone 11)
Notifications for Google Assistant are turned on
Web & App Activity is turned on (activity)
"include Chrome History" is also checked
Did someone of you encounter a similar problem in the past?
If so, were you able to solve it?
Would be happy to hear from you.
Thanks in advance!

How do I build Google smart home action that only need to communicate with my IoT Gateway?

As I looked into Google's references about smart home, I got to know that Google Home connects directly with the end device. But I wanted to specifically connects it with my gateway and sync with it so Google Assistant would only need to send command to the gateway to fulfill a user's request like "Turn on the light". Is this possible or Google need to connect to every end devices for it to work?
If you want, you can create a Hub device that talks to the Cloud and acts as a gateway to smaller, low-powered devices. In that case, you would still return all of your devices in the SYNC response but then handle all of the EXECUTE requests in your Cloud by forwarding to the Hub. From there the Hub can handle it however is needed.

Can we use Alexa skill from custom iOS app?

Can I use Alexa skill from my iOS application (just like we do it from the Echo dot etc)?
I checked a few old links which are working as follows, and I think it can be done using AVS:
record the message
upload it and get Alexa's response
Play it using some player
For that, it needs token (which can be obtained if a user logs in).
I checked a few SO links (link1, link2) as well but didn't get the answer.
Is there any SDK or API to do it? I didn't get enough info from AWS documentation.
Is it even possible? How to use AVS in my iOS app?
I believe you need to explore AWS LEX. It is the same service that powers Alexa. It allows you to create conversational bots, that can consume voice or text input and can give back voice or text output. You can integrate lex in any application whether it is mobile, web or voice application.
Here is a useful link that you can follow to understand how you can utilize LEX for your iOS app.
Deploying an Amazon Lex Bot in Mobile Applications

Is it possible to have google assistant launch a mail client on a phone

We noticed Google assistant can launch other apps like spotify
Is it possible to have google assistant launch a mail client on a phone
Similar to use mailto: on the web, and be able to pass over the subject and body
Not directly. But you can use IFTTT to send mails or automate other stuff.

can we use OAUTH /OPenID in corporate LAN where Social network sites are blocked?

I am developing one website,in which I have implemented google oauth but when I am trying to run the sample in my office where there is a corporate LAN it is giving an error but the code works fine on my personal machine # my home.
Also one more question how stackoverflow is using google login I can access this site in office as well using google login.
Please give me suggestions/answers on it do we really need open internet coonection for oAuth/openID.
or will it work in corporate LAN?
Thanks
Is it blocked in your office? Or is it behind a proxy? My work puts everything behind a proxy, so I need to account for that in any OAuth code (or connect through our approved gateway).

Resources