城市轨道交通列车运行数据实时压缩方案

李德祥王林美王曙

Real-Time Compression Scheme for Urban Rail Transit Train Operation Data

LI DexiangWANG LinmeiWANG Shu
摘要:
[目的]针对目前城市轨道交通列车运行数据存在的磁盘存储空间需求增加、磁盘频繁损伤及高带宽占用等问题,研究数据压缩对于减少存储空间需求,缓解磁盘负担,以及减少带宽浪费具有重要意义。[方法]分析了列车运行数据的特性,从数据自身的时间相关性、空间相关性及整体冗余性等三个维度对其内部的冗余特性进行研究,提出帧间压缩+改进的RLE(游程编码)压缩+ZIP压缩的多维度实时压缩方案以降低数据的冗余性。通过算法的实时性验证试验,以及实际列车运行数据验证试验,证明此压缩方案的有效性。[结果及结论]提出的数据多维度实时压缩方案复杂度低,且具备压缩能力强、压缩速度快的优点。试验及应用表明,所提方案的数据实时压缩操作耗时仅为0.16ms,满足20.00ms的数据采集周期;所提方案的最终压缩率可达3.35%,同样成本的硬件能够存储更长时间数据;最终写入存储磁盘和无线传输的数据量缩减至原数据的11.83%,大幅减少了磁盘擦写的次数和无线传输的数据量,有效降低了磁盘存储故障率以及无线传输带宽占用。
Abstracts:
[Objective] In view of the current challenges such as increased requirements for disk storage space, frequent disk damage and high bandwidth occupation existing in urban rail transit train operation data, research on data compression is of great significance for reducing storage space requirements, alleviating disk burden, and cutting bandwidth waste. [Method] By analyzing the characteristics of train operation data, the internal redundant characteristics of the data are studied from three dimensions i.e. time correlation, spatial correlation and overall redundancy of the data itself. A multi-dimensional real-time compression scheme with inter-frame compression, improved RLE (Run-Length Encoding) compression and ZIP compression is proposed to reduce the data redundancy. The scheme is proved to be effective by the real-time verification test of algorithms and the verification test of the actual train operation data. [Result & Conclusion] The proposed multi-dimensional real-time data compression scheme features low complexity, strong compression ability and fast compression speed. Tests and applications show that it takes only 0.16 ms for the real-time data compression with the proposed scheme, meeting the 20.00 ms data acquisition cycle requirement. The final compression ratio with the proposed scheme can reach 3.35%, and hardware of the same cost can store data for a longer time. The final amount of data written to storage disks and wirelessly transmitted is reduced to 11.83% of the original one, greatly reducing the times of disk erasures and the amount of data wirelessly transmitted, and effectively lowering the disk storage failure rate and the occupancy of wireless transmission bandwidth.
论文检索