Video Sometimes Not Shown when using Apizee

[AleksandarTokarev]

Hello,
We are seeing issues with the Video on various IPhone devices running on different IOS Versions (12-14 at the time)
When app is initially opened (from killed state) and a video call is established, the IOS video is OK and running.
After repeating the call with the app open several times, video starts to not show.
There are several states that i am seeing:

1. Video sometimes does not show only on the IOS device (white screen)- but it shows for the other person on the call
2. Video sometimes does not show for both sides (white screen instead of video)
3. Video sometimes is black for both sides

In all of the cases, Audio is working fine.

We are using Apizee as WebRTC provider (https://www.apizee.com/)

Also in the logs sometimes we are seeing this error

Error: getStats() must be called with null or a valid MediaStreamTrack instance as argument", url: "http://localhost:12710/plugins/cordova-plugin-iosrtc/dist/cordova-plugin-iosrtc.js", lineNo: 2263, columnNo: 106, error: {}, stack: "http://localhost:12710/plugins/cordova-plugin-iosrtc/dist/cordova-plugin-iosrtc.js:2263:18\nhttps://cloud.apizee.com/apiRTC/apiRTC-latest.min.js:2:651202"

Versions affected

• Plugin version (6.0.11, 6.0.14, 8.0.0-RC2):
• iOS version (13.X):
• Xcode version (11.6):

Steps to reproduce

Start a Video Call several times in a row

Expected results

Video should always show up

Actual results

Video sometimes does not show up

[hthetiot]

Sorry this is most likely related to Apizee usage of WebRTC itself that is not in the officially supported list of libraries.
We are investigating MediaStream recyclying issue that may be related to what you experience but we also found it itmostly depend the way you use WebRTC and manage MediaStream (stopping them) and VideoMediaElement (empty them).

1. " I have provided steps to reproduce (e.g. sample code or updated extra/renderer-and-libwebrtc-tests.js file)."
   https://github.com/cordova-rtc/cordova-plugin-iosrtc/blob/master/.github/ISSUE_TEMPLATE.md

You did not provide step to reproduce your issue using Apizee API.

2. "If the checkboxes above are not checked (which you do after the issue is posted), the issue will be closed, removing this checkbox will result in automatic closed issue."

You removed checkboxes and therefor the issue is closed, as you would have seen if you had read the ISSUE requirement.

You can always update this issue to match requirement (mainly "I have provided steps to reproduce"), but it unlikely I will help since i not paying or using Apizee and it will be to Apizee itself or the community to assist you with a fix once you updated the issue and its re-openned.

[hthetiot]

Error: getStats() must be called with null or a valid MediaStreamTrack instance as argument", url: "http://localhost:12710/plugins/cordova-plugin-iosrtc/dist/cordova-plugin-iosrtc.js", lineNo: 2263, columnNo: 106, error: {}, stack: "http://localhost:12710/plugins/cordova-plugin-iosrtc/dist/cordova-plugin-iosrtc.js:2263:18\nhttps://cloud.apizee.com/apiRTC/apiRTC-latest.min.js:2:651202"

Visibly they dont know how GetStats work since it does take a MediaStream or null... since 2014 (6 years ago):

• https://developer.mozilla.org/en-US/docs/Web/API/RTCPeerConnection/getStats

[hthetiot]

Never heard about white screen before in my years of webrtc, i guess that Apizee MCU/SFU doing that...

[hthetiot]

It will be inestigated once #575 that is most likely a duplicate

[AleksandarTokarev]

@hthetiot
Apizee = ApiRTC. This is stated in the "Who Uses It" section
https://github.com/cordova-rtc/cordova-plugin-iosrtc/blob/master/WHO_USES_IT.md
I guess it should be supported by this plugin?

One thing we noticed is, this thing always happens on the Callee side. If we have an user with IPHONE calling an user with IPHONE, the video and the stream ALWAYS works on the Caller side (means caller gets his own video and the Caller video is displayed on the Callee). On the callee side, the first 2-3 times it works but after that the video does not (means the Calle e video is not shown on Callee side and Callee video is NOT shown on Caller side as well).
We are basically using the 1 on 1 call scenario specific here
https://dev.apirtc.com/tutorials/peertopeer/call

 .on("localStreamAvailable", function (stream) {
            console.log('localStreamAvailable');
            //document.getElementById('local-media').remove();
            addStreamInDiv(stream, 'local-container', 'local-media-' + stream.getId(), {width : "160px", height : "120px"}, true);
            stream
                .on("stopped", function () { //When client receives an screenSharing call from another user
                    console.error("Stream stopped");
                    $('#local-media-' + stream.getId()).remove();
                });
        })
        .on("streamAdded", function (stream) {
            console.log('stream :', stream);
            addStreamInDiv(stream, 'remote-container', 'remote-media-' + stream.getId(), {width : "640px", height : "480px"}, false);
        })
        .on('streamRemoved', function (stream) {
            // Remove media element
            document.getElementById('remote-media-' + stream.getId()).remove();
        })
        .on('userMediaError', function (e) {
            console.log('userMediaError detected : ', e);
            console.log('userMediaError detected with error : ', e.error);

            //Checking if tryAudioCallActivated
            if (e.tryAudioCallActivated === false) {
                $('#hangup-' + call.getId()).remove();
            }
        })
        .on('desktopCapture', function (e) {
            console.log('desktopCapture event : ', e);
            $('#hangup-' + call.getId()).remove();
        })
        .on('hangup', function () {
            $('#hangup-' + call.getId()).remove();
        });

Also what you posted above, i can confirm that the MediaStreamObjects are piling up if subsequent calls are being made.
I tried to do cordova.plugins.iosrtc.mediaStreams = undefined but nothing changed, the behavior is same

[hthetiot]

@hthetiot
Apizee = ApiRTC. This is stated in the "Who Uses It" section
https://github.com/cordova-rtc/cordova-plugin-iosrtc/blob/master/WHO_USES_IT.md
I guess it should be supported by this plugin

In fact it does not implicitly make them supported, it simply that they use it.

Thank you for providing way to reproduce, let see if 6.0.14 fix your problem, if not we can try to address it in 6.0.15. please try master this way to confirm if incoming 6.0.14 fix some of your problems.