I am referrring to the demo Kris gives here, especially the separate active transcriptions that show up for Stuart and Kris. I am familiar with conference, gather, dial but I am not able to replicate the entire architecture. I am interested in placing 2 people on a conference and somehow receive their transcriptions in real-time as the wonderful demo shows. I have enabled Agent-Conference tried the coach feature, but still can't figure out how to use Gather with conference participants. If I put a participant in Gather mode the other participant can't hear her. Can anyone please throw some pointers, I am sure I'm missing something basic here.
Till now I have tried:
Call call1 = Call.creator(new PhoneNumber("MyNumber"), new PhoneNumber("VerifiedTwilioNumber"),
new URI("https://mywebsite/gather.xml")).create();
https://mywebsite/gather.xml returns
<?xml version="1.0" encoding="UTF-8"?>
<Response>
<Gather input="speech" speechTimeout="auto" partialResultCallback="https://mywebsite/gather_twilio_webhook_servlet">
</Gather>
</Response>
Using this I speak to no-one but whatever I speak gets shown real-time on my gather_twilio_webhook_servlet.
I have also made conferences using :
Call call1 = Call.creator(new PhoneNumber("MyNumber"), new PhoneNumber("VerifiedTwilioNumber"),
new URI("https://mywebsite/conf.xml")).create();
Call call2 = Call.creator(new PhoneNumber("MyFriendsNumber"), new PhoneNumber("VerifiedTwilioNumber"),
new URI("https://mywebsite/conf.xml")).create();
https://mywebsite/conf.xml returns:
<?xml version="1.0" encoding="UTF-8"?>
<Response>
<Dial>
<Conference startConferenceOnEnter="true" endConferenceOnExit="true">Room 123</Conference>
</Dial>
</Response>
I am trying combinations thereof but not able to find a documentation to replicate Kris's exact use case. Any help will be much appreciated. Thanks!
Update, more trials:
If I try something like:
<?xml version="1.0" encoding="UTF-8"?>
<Response>
<Gather input="speech" speechTimeout="auto" partialResultCallback="https://mywebsite/gather_twilio_webhook_servlet" language="en-IN">
<Dial>
<Conference record="record-from-start">room-2</Conference>
</Dial>
</Gather>
</Response>
I get ErrorCode "13320" Msg "Gather: Invalid nested verb"
Twilio developer evangelist here.
The demo Kris showed is not available right now to use publicly. I know it was a while back, but bringing it to market was not as high a priority as other things we have launched since.
If you are interested in features like this, I recommend you get in touch with sales and discuss what you would like to use it for.
This is probably late now. But, you can check out these apps if it helps -
Video Conferencing built using Twilio Video SDK with live captions - https://github.com/symblai/symbl-twilio-video-react
Twilio Media Streams Integration - https://github.com/symblai/symbl-twilio-media-streams-integration
Related
I have the following code:
<?xml version="1.0" encoding="UTF-8"?>
<!-- page located at http://example.com/simple_gather.xml -->
<Response>
<Pause length="2"/> <Play>https://welcomehisheart.com/wp-content/uploads/2021/10/congress-invitation.mp3</Play>
<Pause length="1"/>
<Say>If you would no longer like to receive information about the Sacred Heart, press 2</Say>
<Gather/>
<Pause length="1"/>
</Response>
The TwiML URL is:
https://handler.twilio.com/twiml/EHe23193a659bfcf74b1061864aea9b224
The code works as expected. You can enter a selection during the phone call.
How to access the information gathered?
Thanks
Twilio developer evangelist here.
It looks like you are working with a TwiML Bin there, which is great for a static piece of TwiML like this first message. However, there are a couple of issues.
Firstly, you are not giving the user the proper time to enter their input. The <Gather> element is best used with the message nested within it, so that a user can press at any time. You can also set a timeout to better control how long they have to respond once the nested <Say> is complete. The default value of timeout is 5 seconds.
Secondly, if you are just waiting for the user to press a single digit, you can add the numDigits="1" attribute to the <Gather>. This will complete the <Gather> once the user presses a single digit.
Finally, and the subject of your question, you need to give the <Gather> a URL as the action attribute. Then, when a user presses a key, Twilio will make an HTTP request to that URL with the results of their input. You need to build an application that will handle that request and do something with the result of the key press.
So, you should update your TwiML to:
<?xml version="1.0" encoding="UTF-8"?>
<!-- page located at http://example.com/simple_gather.xml -->
<Response>
<Pause length="2"/>
<Play>https://welcomehisheart.com/wp-content/uploads/2021/10/congress-invitation.mp3</Play>
<Pause length="1"/>
<Gather numDigits="1" action="https://example.com/gather">
<Say>If you would no longer like to receive information about the Sacred Heart, press 2</Say>
</Gather>
</Response>
and you need to create an application that can receive an HTTP request, in this case at the URL example.com/gather, though you should provide your own URL here.
There are tutorials on how to gather user input in a phone call that will walk through this in more depth with code examples, that you should read next.
I have an app that dials a phone number, gives a set of instructions, and then forwards the call to a specified phone number. Currently when I press the digit to transfer the call it just pauses and hangs up. Not sure what im doing wrong.
This is the initial instructions. If the number 1 is pressed it is supposed to transfer to transfer.xml, which is under # 2.
<?xml version="1.0" encoding="UTF-8"?>
<Response>
<Gather timeout="10" action="http://1.1.1.1/twimlet/transfer.xml" numDigits='1' finishOnKey='1'>
<Say>"Dummy Text Dummy Text"</Say>
<Say>"Please press 1 to transfer this call. Or nothing to hang up."</Say>
</Gather>
</Response>
If the caller presses #1 then it is supposed to send them to this xml file, and transfer the current call to the number under dial. But currently it just hangs for 2 seconds and drops the call.
<?xml version="1.0" encoding="UTF-8"?>
<Response>
<Say>"Transferring you to a court clerk"</Say>
<Dial timeout="60" callerID='+14393523419'>
<Number>8125277222</Number>
</Dial>
</Response>
Am I doing something wrong with my xml? Not sure why it is dropping.
Twilio developer evangelist here.
Your action in your <Gather> is pointing towards the URL http://1.1.1.1/twimlet/transfer.xml. That looks like a local network address rather than a publicly available URL. If that IP address is not available to Twilio, then the call will not be able to continue.
Try using relative URLs instead of absolute ones. Twilio will happily follow the path /twimlet/transfer.xml.
Let me know if that helps!
Hm could it be because finishOnKey is set to 1 in your <Gather> verb? So, it's taking it as you end the call? Have you tried setting it to finishOnKey=""?
Does anyone know the best way to programmatically set the name/id of the conference room in the Twilio noun ?
<Response>
<Say>Joining a conference room</Say>
<Dial>
<Conference>MyRoom</Conference>
</Dial>
</Response>
My system will dole out new conference room ID's, dynamically, to keep the conferences small but I'm not sure how to associate the assigned user's room id in the to twiml app's code...
Ricky from Twilio here. Wanted to add some example code for anyone who may stumble on this question.
You need to return TwiML to give Twilio the instructions of what to do with a call but you can generate that TwiML however you'd like. For example, here is a simple PHP script that returns TwiML that places callers in a random conference room.
<?php
header("content-type: text/xml");
echo "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n";
?>
<Response>
<Say>Joining a conference room</Say>
<Dial>
<Conference>Room<?php echo rand(0,2); ?></Conference>
</Dial>
</Response>
I am building a simple conference using Twilio where a conference is started by Agent using Twilio client and a contact is called and added to this conference. Just before adding this contact to conference, we would like to announce the name of the contact in the conference room (for ex: <Say>Now Joining Sam Carter </Say>). The name of the person is figured out based on their phone number from database.
When a call is connected, the following TwiML is executed which connects the contact to the conference:
<Dial callerId="+1415xxxxxxx" record="true" action="/my/action/url">
<Conference endConferenceOnExit="true" >ConferenceRoom1</Conference>
</Dial>
Is there any way to play a message into conference just before <DIAL> verb is executed. If i write <SAY> verb before <DIAL> then it plays message to the contact, not in the CONFERENCEROOM1.
Are there any events like onConferenceEnter, which can be used to fire another TwiML whenever some participant enters the conference? Please suggest what would be the best way to achieve this behavior.
The short answer to the question is that it can't be done through a Twiml Event however it can be done with a kind of hack using their REST API.
The question has already been asked on SO and the answer is available here:
Use Say verb to all Conference participants
Incase the question/answer is ever deleted/removed i've pasted it below:
Here's something that should resemble a good end-to-end solution.
First, the user dials in and you go through the standard prompts to get the PIN for the conference room and their name.
<?xml version="1.0" encoding="UTF-8"?>
<Response>
<Gather action="/conference/pin" finishOnKey="#">
<Say>Please the conference pin number followed by the pound key.</Say>
</Gather>
</Response>
<?xml version="1.0" encoding="UTF-8"?>
<Response>
<Say>Say your name and then press the pound key.</Say>
<Record action="/conference/name" finishOnKey="#" />
</Response>
Now, once you have the user's pin and recording, two things will happen; the response from the post to /conference/name will contain the verb, placing the user in the room:
<?xml version="1.0" encoding="UTF-8"?>
<Response>
<Dial>
<Conference>{conference ID}</Conference>
</Dial>
</Response>
...and, asynchronous to that, it will use the REST API to initiate a new call back into the conference room.
POST /2010-04-01/Accounts/{AccountSid}/Calls
From = {your conference phone number}
To = {your conference phone number}
SendDigits = wwww{conference PIN}#
Url = /conference/announce?name={name ID}
Now, the next bit gets confusing. Twilio will now be talking to your callback URL for the incoming end of the call, and the URL you specified above for the outgoing end of the call. Your incoming call handler will need to detect that the conference line is calling back into itself and behave differently; it will first need to respond with simple TwiML that allows the outgoing end of the call to enter the pin for the conference room.
<?xml version="1.0" encoding="UTF-8"?>
<Response>
<Gather action="/conference/announce-pin" finishOnKey="#" />
</Response>
The SendDigits parameter of the POST will provide the digits that bit of TwiML is expecting. That action should then respond by conferencing in the new call.
<?xml version="1.0" encoding="UTF-8"?>
<Response>
<Dial>
<Conference>{conference ID}</Conference>
</Dial>
</Response>
The last piece of the puzzle is the TwiML emitted by the URL you specified in the POST. That's the markup that will run once the loopback call is added to the conference.
<?xml version="1.0" encoding="UTF-8"?>
<Response>
<Play>/conference/name-recordings/{name ID}</Play>
<Say>has joined the call.</Say>
<Hangup />
</Response>
That markup runs, plays the caller's name and a message into the conference room, and then hangs up.
For benefit of others, this is how I have implemented this behavior :
An agent has started the conference using Twilio client and he is already in conference. As soon as a participant is about to join the same conference, using REST API, modify the URL of the live conference call.
TwilioRestClient client = new TwilioRestClient(ACCOUNT_SID, AUTH_TOKEN);
Map<String, String> filter = new HashMap<String, String>();
filter.put("From", "client:AGENT1");
filter.put("Status", "in-progress");
CallList callList = account.getCalls(filter);
Call agentsCall = null;
for (Call inProgressCall : callList) {
agentsCall = inProgressCall;
break; //return the first one only..there shouldn't be more
}
Map<String, String> agentsCallParams = new HashMap<String, String>();
agentsCallParams.put("Url", "http://myserver.com/twiml/agentmessage.xml");
agentsCallParams.put("Method", "GET");
agentsCall.update(agentsCallParams);`
The above code snippet will update the twiml of existing call as below.
<?xml version="1.0" encoding="UTF-8"?>
<Response>
<Say>Now joining {name of the participant}</Say>
<Dial>
<Conference>Conference1</Conference>
</Dial>
</Response>
The above Twiml will update the call to play the message in <SAY> verb and then put the agent back into the conference.
Now, make the participant join the same conference by returning the below Twiml:
<?xml version="1.0" encoding="UTF-8"?>
<Response>
<Dial>
<Conference>Conference1</Conference>
</Dial>
Hope this helps !!!
I'm setting up a pretty simple conference call system, where the user enters a PIN and is connected to a conference associated with that. I'm also setting it up so they record their name before entering the room.
My plan is to take the recording URL, then get the list of participants and make the REST API call to each caller modifying their call to to the Say "Now entering", then Play the recording url. I think I'm going to have to send them back into the room after that as well, I'm not sure.
I think that modifying each call will take them out of the Conference room, which is not ideal. Is there an easier way to use Say/Play to all members of a conference built into the REST API?
As of July 13th 2018, Twilio now allows you to send a POST request to the Conference (to announce something to the whole conference) or Conference Participant (to announce something to a single caller) resources with an AnnounceUrl property that links to either:
a WAV or MP3 audio file, or
a TwiML document that uses the <Say /> and/or <Play /> verbs.
Along with that property, you can also specify an AnnounceMethod property that lets you specify whether to GET or POST (the default) that URL.
A good place to send the aforementioned POST to play back your recorded name might be in a status callback that's set when you use the <Conference /> verb to put each user into the conference, like so:
<?xml version="1.0" encoding="UTF-8"?>
<Response>
<Dial>
<Conference statusCallback="/conference/join-callback"
statusCallbackEvent="join">
{conference ID}
</Conference>
</Dial>
</Response>
The old workaround remains below for posterity.
Someone on the Twilio forums was interested in the very same question, and the answer is currently that there isn't a direct REST API call for that.
What you'll need to do is, when a participant joins the conference, you'll use the REST API to make Twilio dial back in to your application. You can choose how to detect that you're calling into your own conference however you like (for example, comparing the outbound and inbound phone numbers for equality); once you've detected that, you can join that call directly to the conference and use the TwiML <Say /> and <Play /> verbs to play back the introduction for everybody.
It's a little bit convoluted, but this way you won't be removing each participant from the conference (preventing them from hearing each other for a moment) and then rejoining them.
Here's something that should resemble a good end-to-end solution.
First, the user dials in and you go through the standard prompts to get the PIN for the conference room and their name.
<?xml version="1.0" encoding="UTF-8"?>
<Response>
<Gather action="/conference/pin" finishOnKey="#">
<Say>Please the conference pin number followed by the pound key.</Say>
</Gather>
</Response>
<?xml version="1.0" encoding="UTF-8"?>
<Response>
<Say>Say your name and then press the pound key.</Say>
<Record action="/conference/name" finishOnKey="#" />
</Response>
Now, once you have the user's pin and recording, two things will happen; the response from the post to /conference/name will contain the <Conference> verb, placing the user in the room:
<?xml version="1.0" encoding="UTF-8"?>
<Response>
<Dial>
<Conference>{conference ID}</Conference>
</Dial>
</Response>
...and, asynchronous to that, it will use the REST API to initiate a new call back into the conference room.
POST /2010-04-01/Accounts/{AccountSid}/Calls
From = {your conference phone number}
To = {your conference phone number}
SendDigits = wwww{conference PIN}#
Url = /conference/announce?name={name ID}
Now, the next bit gets confusing. Twilio will now be talking to your callback URL for the incoming end of the call, and the URL you specified above for the outgoing end of the call. Your incoming call handler will need to detect that the conference line is calling back into itself and behave differently; it will first need to respond with simple TwiML that allows the outgoing end of the call to enter the pin for the conference room.
<?xml version="1.0" encoding="UTF-8"?>
<Response>
<Gather action="/conference/announce-pin" finishOnKey="#" />
</Response>
The SendDigits parameter of the POST will provide the digits that bit of TwiML is expecting. That action should then respond by conferencing in the new call.
<?xml version="1.0" encoding="UTF-8"?>
<Response>
<Dial>
<Conference>{conference ID}</Conference>
</Dial>
</Response>
The last piece of the puzzle is the TwiML emitted by the URL you specified in the POST. That's the markup that will run once the loopback call is added to the conference.
<?xml version="1.0" encoding="UTF-8"?>
<Response>
<Play>/conference/name-recordings/{name ID}</Play>
<Say>has joined the call.</Say>
<Hangup />
</Response>
That markup runs, plays the caller's name and a message into the conference room, and then hangs up.