Screen sharing and camera stream with Twilio SDK - ios

I'm trying to implement an app a'la google hangout where you can create a video conference and share your screen when needed using Twilio SDK.
Screen recording should go system-wide so I'm using Replay Kit 2 and the Broadcast Upload Extension.
The problem is how can I upload screen data from the extension to the same Twilio room started in the app?
I'm looking at Twilio example code: https://github.com/twilio/video-quickstart-swift/tree/master/ReplayKitExample
What they do is connect to the room from within the extension.
My flow is different though - I initiate the call from the main app and then I can initiate screen sharing.
I imagine Twilio SDK could generate presigned URL which is shared with the extension and then it uploads data stream there.
And idea if this is achieveable with Twilio?

Related

Does Twilio chat support recording audio messages

We are using Twilio chat in one of our website and some users are asking if it is possible to record audio recordings to be sent as chat messages (like it happens on Whatsapp and other chatting App).
Does Twilio API support this kind of messages ?
Twilio developer evangelist here.
Twilio Chat supports the upload and sharing of media of all types to a maximum of 150MB size. You will need to implement the audio recording for your app, but once you've done that you can share over the chat platform.

Twilio video calling between clients

last two week I am playing around with Twilio Video SDK
In my demo application I have integrated both voice and video SDK, I do have following question please help me out
1)how make/receive video call just by using client name (client to client call)( same as Voice client to client call )?
2)how to switch between voice and video call ?
3)how to invite participant in an ongoing video call ?
Thanks

Draw annotation on Twilio Video Chat

I want to use twilio for Remote assistance.
Where user can share camera feed and Technician can assist by drawing annotations on the screen.
similar to the demo video on https://www.twilio.com/video
I was able to get the Video Chat running on my iOS devices.
Can you please guide me how to make annotations on one device which will be shown on the other device.
Twilio Video does not provide support for annotating videos as part of the SDK. There is also no current support for using the WebRTC data channel to send that across. You need to provide your own websocket solution for this I'm afraid.
Edit
Twilio Video does support the data channel now, under the Data Tracks API. You can see the documentation here: https://www.twilio.com/docs/video/javascript-v1-using-the-datatrack-api.
You might also consider using Twilio Sync for something like this too.

Cordova ios watch live video streaming ApiRTC

I am using cordova ios app for live streaming. I am able to stream video from iphone but when i try to join stream it never calls remoteStreamAddedHandler function to display streaming video.
I am using cordova-plugin-iosrtc plugin. It also shows status that "someone has joined room" but not calling that remoteStreamAddedHandler where i can append video tag from. It is working fine in andriod phone.
Thanks
remoteStreamAddedHandler event is fired when a remote user has already joined the room and published his stream.
On apiRTC tutorial : 11-VIDEO CALL STREAMING, user only subscribe to available streams (there is no video publish)
You need to have an user connected with tutorial 10-GROUP CALL, this user will publish his stream and subscribe to remote streams.
The tutorial 12-GROUP CALL - ADVANCED shows you an advanced sample where user can choose to publish/subscribe streams.

What can we implement using native WebRTC in iOS? How much approx. time it will take in Screen sharing, Audio, Video and Text Chat implemetaion?

I want to develop a native iOS app using WebRTC that have almost similar functionality to skype. I have few queries :
Q 1) I know we can implement Audio and Video call using WebRTC but is
it possible to implement Text Chat and Screen Sharing in iOS app
using native WebRTC ?
Q 2) I need to provide time estimation of **Audio Call,Video Call,
Group Audio call, Group Video call, single user text(share media as well) chatting, multi user text (share media as well) chatting and
Screen Sharing.
Please let me know approx. development time of individual functionality if single developer works on it, who have good hands in iOS development.
Thank you....:)

Resources