基于ARM的无人机HEVC实时视频传输系统设计
|
摘要
针对目前无人机实时视频的实时性、低功耗、小型化需求,设计了一种基于ARM嵌入式的实时视频传输系统;该系统采用NXP i.MX6Q作为视频采集端的核心处理器;搭载嵌入式Linux操作系统,使用HEVC(高效率视频编码)标准进行视频编码,扩展了RTMP对HEVC的支持,在云服务器端使用Nginx搭建流媒体服务器,使用4G移动网络通过RTMP实时消息传输协议对视频实时推流。视频接收端使用FFplay实时显示。实验结果表明,系统运行稳定,视频显示平均延迟在900 ms以下,播放流畅,图像清晰。
In view of the real-time, low-power and miniaturization characteristics of real-time UAV real-time video, an ARM-based embedded video transmission system is designed. The system uses NXP i.MX6Q as the core processor of the video acquisition terminal based on Linux operating system, using V4L2 interface technology to capture video, using FFmpeg to carry out HEVC(High Efficiency Video Coding) standard encoding for video, extending RTMP support for HEVC, using Nginx to carry streaming media server on cloud server side. The 4G mobile network pushes the video in real time through the RTMP real-time message transmission protocol. The video receiver uses FFplay for real-time display. The experimental results show that the system runs stably, the average delay of the video display is below 900 ms, the playback is smooth, and the image is clear.
In view of the real-time, low-power and miniaturization characteristics of real-time UAV real-time video, an ARM-based embedded video transmission system is designed. The system uses NXP i.MX6Q as the core processor of the video acquisition terminal based on Linux operating system, using V4L2 interface technology to capture video, using FFmpeg to carry out HEVC(High Efficiency Video Coding) standard encoding for video, extending RTMP support for HEVC, using Nginx to carry streaming media server on cloud server side. The 4G mobile network pushes the video in real time through the RTMP real-time message transmission protocol. The video receiver uses FFplay for real-time display. The experimental results show that the system runs stably, the average delay of the video display is below 900 ms, the playback is smooth, and the image is clear.
引文
[1]罗敏,李辉,罗亚东.基于H264的数码摄影无线传输系统的设计与实现[J].计算机与数字工程,2016,44(11):2271–2275.
[2]Hell P,Mezei M,Varga P J. Drone communications analysis[C]//Applied Machine Intelligence and Informatics(SAMI),2017 IEEE 15th International Symposium on. IEEE,2017:000213-000216.
[3]陶金牛,钱坤,刘凯,等.基于4G移动网络的无人机及其应用前景分析[C]//中国航空学会,2014:596-597.
[4]谢相博,徐光辉,范凯鑫,等.基于4G的无人机远程巡逻系统[J].通信技术,2015,48(11):1305–1309.
[5]Grois D,Marpe D,Nguyen T,et al. Comparative assessment of H. 265/MPEG-HEVC,VP9,and H. 264/MPEG-AVC encoders for lowdelay video applications[C]//Applications of Digital Image Processing XXXVII. International Society for Optics and Photonics,2014,9217:92170Q.
[6]胡博,赵旦峰,王中刊.基于H. 265编解码高清视频传输系统[J].应用科技,2017,44(1):27–32.
[7]Fossum E R,Hondongwa D B. A review of the pinned photodiode for CCD and CMOS image sensors[J]. IEEE J. Electron Devices Soc,2014,2(3):33–43.
[8]徐家,陈奇.基于V4L2的视频设备驱动开发[J].计算机工程与设计,2010,31(16):3569–3572.
[9]唐浩漾,荆倩,程颖涛,等.一种HEVC帧内编码的快速算法[J].计算机工程与应用,2017,53(18):182–185.
[10]Sullivan G J,Ohm J R,Han W J,et al. Overview of the high efficiency video coding(HEVC)standard[J]. IEEE Transactions on Circuits and System for Video Technology,2012,22(12):1649–1668.
[11]Soni R. Nginx core architecture[M]//Nginx. Apress,Berkeley,CA,2016:97-106.
[12]Prabhakar B,Reddy D K. Analysis of video coding standards using PSNR and bit rate saving[C]//Signal Process And Communication Engineering System(SPACES),2015 International Conference on. IEEE,2015:306-308.
[13]Tanchenko A. Visual-PSNR measure of image quality[J]. Journal of Visual Communication and Image Representation,2017,25(5):874–878.
[2]Hell P,Mezei M,Varga P J. Drone communications analysis[C]//Applied Machine Intelligence and Informatics(SAMI),2017 IEEE 15th International Symposium on. IEEE,2017:000213-000216.
[3]陶金牛,钱坤,刘凯,等.基于4G移动网络的无人机及其应用前景分析[C]//中国航空学会,2014:596-597.
[4]谢相博,徐光辉,范凯鑫,等.基于4G的无人机远程巡逻系统[J].通信技术,2015,48(11):1305–1309.
[5]Grois D,Marpe D,Nguyen T,et al. Comparative assessment of H. 265/MPEG-HEVC,VP9,and H. 264/MPEG-AVC encoders for lowdelay video applications[C]//Applications of Digital Image Processing XXXVII. International Society for Optics and Photonics,2014,9217:92170Q.
[6]胡博,赵旦峰,王中刊.基于H. 265编解码高清视频传输系统[J].应用科技,2017,44(1):27–32.
[7]Fossum E R,Hondongwa D B. A review of the pinned photodiode for CCD and CMOS image sensors[J]. IEEE J. Electron Devices Soc,2014,2(3):33–43.
[8]徐家,陈奇.基于V4L2的视频设备驱动开发[J].计算机工程与设计,2010,31(16):3569–3572.
[9]唐浩漾,荆倩,程颖涛,等.一种HEVC帧内编码的快速算法[J].计算机工程与应用,2017,53(18):182–185.
[10]Sullivan G J,Ohm J R,Han W J,et al. Overview of the high efficiency video coding(HEVC)standard[J]. IEEE Transactions on Circuits and System for Video Technology,2012,22(12):1649–1668.
[11]Soni R. Nginx core architecture[M]//Nginx. Apress,Berkeley,CA,2016:97-106.
[12]Prabhakar B,Reddy D K. Analysis of video coding standards using PSNR and bit rate saving[C]//Signal Process And Communication Engineering System(SPACES),2015 International Conference on. IEEE,2015:306-308.
[13]Tanchenko A. Visual-PSNR measure of image quality[J]. Journal of Visual Communication and Image Representation,2017,25(5):874–878.