Ultra Low Latency H.265 Solution
Home » Advanced Teleoperation » Ultra Low Latency H.265 Solution
Introducing the World's first 35ms Latency Mobile Video Transmission Encoder/Transmitter for Teleoperation, 5G and other applications
Developed in Japan, Smart-telecaster Zao-SH is a 5G compatible H.265 ultra-low latency live video transmitter equipped with next-generation video processing and transmission technology that reduces the glass to glass latency to 35 milliseconds. The latency in live video transmission has been a critical challenge, but we are now able to transmit live video from anywhere to anywhere near real time.
In addition to live broadcasting, the Zao-SH is also capable of remotely controlling automobiles and construction equipment for teleoperation applications. Leveraging 5G networks with the Zao-SH, high-quality videos with two-way audio and remote control signals can be transmitted within a very short network delay.
Core IP
Definition of Terms
| Shoot: | The period from when the light enters the lens of the camera until video data is output to SDI/HDMI terminal (camera dependent part) |
|---|---|
| Capture: | The period from capturing video data from SDI/HDMI and performing color space conversion until it is input to the encoder |
| Encode: | The encoding (compression) time |
| Transfer: | The period in which compressed data is extracted from the encoder and divided into communication packets for multilink transmission/reception. Includes time for error correction and packet sorting between each connection |
| Decode: | The decoding (uncompression) time |
| AV Sync: | The time until adjusting audio and video timing and outputting to SDI/HDMI |
| Display: | The period from SDI/HDMI output of the receiver to display the video on monitor (monitor-dependent part) |
The core IP of our ultra low latency technology is RASCOW2, a robust H.265 HEVC encoding engine, and successor to our original codec management/communication protocol RASCOW (Realtime Auto Speed Control based On Waterway-model). RASCOW2 was developed to further solve the delay problem that occurs during simple transmission, and it achieves a faster and more efficient encoding process while controlling all transmission settings. This feature enables a significant reduction in the delay associated with compression.
Remote Control Function
If you can reduce your video transmission from "seconds" to "35 milliseconds", what new use cases can you create? Zao-SH will open up a multitude of new possibilities for near zero real time applications.
For example, a receiver can be used to remotely control a car or construction equipment connected to Zao-SH in a remote location. Until now, the network delay was too large in live transmission systems and remote operation while watching the live video from the remote location was difficult. With the ultra low latency Zao-SH, teleoperation is smooth, and the live video displayed is close to real time from the remote location.
Control signals from the controller connected to the receiver are sent to the Zao-SH main unit and used to control a car or any type of machine.
Package Includes:
- Industrial Camera
- Zao-SH Encoder
- Receiver System hardware
- Receiver software
- Hi-Speed Display
Customization options available with other cameras/displays
Zao-SH Encoder in Connected Car Architecture
Video from multiple special cameras installed in a remote-controlled vehicle are compressed and transmitted to the remote-control seat in real time via LTE (radio waves of ordinary mobile phones). The control side decodes the received video and other information such as vehicle vibration to operate the accelerator, steering, brakes, etc. while watching the monitor. In this system, the time (latency/delay) until the video from the camera is compressed and transmitted back to the control side and displayed is an important factor. Soliton Systems has achieved under 200ms (1/5th of a second).
Use Cases
Click or tap to each icons to see details.
Ultra Low Latency H.265 Solution Video
Specifications
| Transmission hardware | Weight | 350g |
|---|---|---|
| Dimensions | 77(W) × 128(H) × 35(D)mm | |
| Video Input | HD-SDI (75ohm din1.0/2.3) ×１/HDMI×１ | |
| Audio Output | 3.5φ Stereo pin jack | |
| Internal battery | Operation for about 1 hour | |
| USB | Miocro USB × 3/USB 2.0 × 1 | |
| GNSS | GPS Only (WGS84) | |
| Power consumption | 20W (Typical) | |
| Video input terminal | Equipped with BNC (75Ω din1.0/2.3) x 1 and HDMI x 1 | |
| Communication terminal | Equipped with micro USB2.0 x 3 and USB 2.0* x 1 *Only for WiFi/USB Ethernet adapter |
|
| Operation temperature | 0~40℃ / 20 to 80% RH (No condensation) | |
| External Battery | Weight | 430g |
| Dimensions | 84(W) × 135(H) × 34(D)mm | |
| Capacity | 56Wh (Operation for about 1 hour) | |
| Communication | Applicable line | 5G, LTE, WiFi, Ethernet |
| Error correction | ARQ, packet sorting | |
| Protocol | UDP/IP, TCP/IP (RASCOW2) | |
| Multi link | 3 lines (up to 4 lines) | |
| Serial communication | Expansion by USB serial cable | |
| Video | Encoding method | H.265 Main Profile |
| Supported input format | HDMI: 1080p/ 25fsp, 29.97fps, 30fps, 50fps, 59.94fps, 60fps720p / 50fps, 59.94fps, 60fps SDI: 1080p / 29.97fps, 30fps 720p / 59.94fps, 60fps *Coming soon for interlaced input | |
| Bit rate | 100kbps ~ 15mbps | |
| Frame rate | Maximum 29.97fps ( when input video is 1080p 59.94/29.97) Maximum 59.94fps (when input video is 720p 59.94) |
|
| Voice | Encoding method | Opus |
| Channel | Stereo | |
| Sampling | 48KHz | |
| Input | Embedded Audio |
