In just two weeks, online grip from a silent industry into a wind industry, from hardware to software architecture, profitable to investment, from operation to promotion, all-round interpretation. Only H5 catch doll (Specially referred to mobile web, WeChat catching doll), still mysterious.
Is H5 catching a baby really so mysterious? This article is freely announced.
I. What is the H5 catching doll that most people say?
H5 grasps, refers to the web side of the HTML5. It can be divided into two categories: PC side and mobile terminals.
The H5 grip doll of the PC side, as long as the WebRTC browser can use the Agora Web SDK directly. Of course, it is also possible to use WebRTC self-research, solve several server transmission, equipment adaptation, echo, usage, etc., it can be used. The H5 grip dolls in the PC have a mature solution.
The mobile H5 gripping doll is more complicated. The mobile H5 grip doll refers to two types: mobile web browser and WeChat intra web pages catch dolls. Most of the demand for doll manufacturers is to promote web pages in WeChat, not mobile browsers other than WeChat.
So, the problem is very clear, the H5 catching dolls that most people refer to WeChat built-in browser, which is convenient for the narrative, and referred to as WeChat H5 catching dolls.
II. What is the difference between WeChat H5 catch doll and naive app?
At present, mature PC ports are implemented through WebRTC. Most browsers have better support for WebRTC. But WeChat's built-in browser does not support WebRTC.
The above figure is a general processing process of real-time video streaming online grip. In the business scene of the doll, the collection is achieved by placing the motherboard or PC on the doll machine, rendering / playing is the doll machine operation. The only difference between WeChat H5 grasping doll and app grasping doll is the doll machine operation. The former is the WeChat built-in browser, the latter is a native app.
III. How to achieve the WeChat H5 catching doll?
Next, the mystery of WeChat H5 caught dolls is uncovered by the WeChat H5 program of Voice Network.
As mentioned earlier, WeChat H5 is to solve is the last link - the operational playback video. The strategy used by the sound network is to play in the WeChat browser using JSMPEG.
Voice network Agora online catching doll technology architecture
JSMPEG is a video player implemented with JavaScript, which includes an MPEG separator, MPEG1 video, and MP2 audio decoder, webgl, and canvas2d rendering and WebAudio sound output.
JSMPEG is relatively small, and it works well on most browsers, and can decode 720p with a frame rate of 30fps on the iPhone 5S.
Since JSMPEG only supports the MPEG1 format, add a transcoded server in the decoding link to convert the video format to MPEG1. Then send the video to the WeChat browser through the relay Server, play with JSMPEG.
Other links, WeChat H5 protocol is exactly the same as non-WeChat H5 solutions.
The doll machine is connected to two cameras through the motherboard or PC, collecting video data.
Optimization of video streams through Agora's patented encoder.
Video real-time transmission via real-time virtual communication network SD-RTNTM globally deployed by Agora
Finally, reach the operation, decoding, play
The operator transmits the control command to the doll apparatus through the service server, and real-time feedback is obtained through the video stream.
You can separate from SD-RTNTM to RTMP flows to the audience from the SD-RTNTM
It can be seen from the technical architectural diagram that WeChat H5 caught the doll, and finally through mature open source projects, this is also the implementation of most mainstream WeChat H5 catching dolls. So, what is the difference between the WeChat H5 catching doll experience?
IV. Decideting the WeChat H5 catching dolls to experience different differences?
The most critical experience of catching dolls has the following three aspects:
Delay
Usage
Service stability
Delay
The delay is operative to delay the doll machine, and the doll machine to the video delay of the operating end.
Directive delay: Due to the command to the doll machine, the data package is extremely small, so the delay is very low, generally dozens milliseconds.
Video delay: If the video delay is within 400ms, the player can accept.
The key to deciding to grasp the doll delay experience is the video delay.
Video clarity and delay are two opposite each other. When the bandwidth is unchanged, the clearer the video, the higher the frame rate, the higher the code rate, the higher the delay. Therefore, a balance point is to be obtained between video clarity and delay.
The sound network passes through private patented codecs to reduce the code rate as much as possible under the premise of ensuring clarity. By packet loss, FEC, bandwidth detection, dynamic code rate adjustment, etc., the user can also obtain a smooth experience when network quality is not good.
The sound network is deployed nearly 100 nodes worldwide to form an SD-RTNTM communication network. The SD-RTNTM system can automatically assign the best, the most smooth transmission path to the user's distance and the response time, the load condition, and the user's distance and response time, and to achieve the quality assurance level required for real-time transmission.
2. Available
According to CallStats.io data, 89% of WebRTC-based real-time communication based on WebRTC can be successfully established. The SD-RTNTM of the acoustic network has increased the success rate of 99% by the intensive cloth in each region.
3. Service stability
Average 400ms delay and stable 400 milliseconds of delay, the user's experience is different. Stable 400ms delay, (there will be expected in the user's heart), compared to 200, 800 will have a better experience.
The key issue after catching the doll is fast online, that is, the remaining. Remove business model, determine whether the user is not allowed to experience the quality. Abandoning the user experience and seeking fast, it is the original invert. Regression quality, user experience is the road to long-lasting development.
Voice network online catching the overall solution has been wow 叽 叽 doll, happy to catch the doll, music, second, caught a lot, catch the doll, love, beauty, the doll, doll chicken, catch the grab, etc. Almost all mainstream vendors are adopted. , Read the full text, original text title: H5 catching doll, not as difficult as you think
Article Source: [Micro Signal: Shengwang-Agora, WeChat public number: Voice Network Agora] Welcome to add attention! Please indicate the source of the article.
Our other product:
