引用本文: | 韩文炳,陈小刚,李顺芬,等.基于新型非易失内存的远程零拷贝文件系统.[J].国防科技大学学报,2020,42(3):9-16.[点击复制] |
HAN Wenbing,CHEN Xiaogang,LI Shunfen,et al.A novel remote zero-copy file system based on non-volatile memory[J].Journal of National University of Defense Technology,2020,42(3):9-16[点击复制] |
|
|
|
本文已被:浏览 6531次 下载 5326次 |
基于新型非易失内存的远程零拷贝文件系统 |
韩文炳1,2,陈小刚1,李顺芬1,李大刚3,陈诗雁3,段有康1,2,宋志棠1 |
(1. 中国科学院上海微系统与信息技术研究所 信息功能材料国家重点实验室, 上海 200050;2. 中国科学院大学, 北京 100049;3. 北京大学深圳研究生院 信息工程学院, 广东 深圳 518055)
|
摘要: |
为提升物联网与边缘计算应用中前端节点间的数据访问效率,提出了一种新型远程零拷贝文件系统。该文件系统无须借助特殊硬件,可直接基于通用网卡设备实现零拷贝的数据传输框架;充分利用新型非易失内存的随机访问特性,尽可能减少数据缓存和拷贝,提高数据访问的吞吐量。建立缓冲区池,精简并融合传统网络栈和存储栈,从而缩短文件访问路径,减少软件冗余,降低数据访问延迟。最终提供高带宽、低延迟的远程数据访问性能。测试结果表明,远程零拷贝文件系统比传统网络文件系统减少了42.26%~99.19%的读写延迟,细粒度访问下的吞吐量最高可提升1297倍,显著降低了处理器开销和缓存失效次数。 |
关键词: 新型非易失内存 物联网 边缘计算 零拷贝 网络文件系统 |
DOI:10.11887/j.cn.202003002 |
投稿日期:2018-11-28 |
基金项目:国家重点研发计划资助项目(2017YFA0206101,2017YFB0701703,2017YFA0206104,2018YFB0407500,SQ2017YFGX020134);国家自然科学基金资助项目(61874129,61874178,61504157,61622408);中国科学院战略性先导科技专项资助项目(XDPB12);上海市科委资助项目(17DZ2291300,18DZ2272800) |
|
A novel remote zero-copy file system based on non-volatile memory |
HAN Wenbing1,2, CHEN Xiaogang1, LI Shunfen1, LI Dagang3, CHEN Shiyan3, DUAN Youkang1,2, SONG Zhitang1 |
(1. State Key Laboratory of Functional Materials for Informatics, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai 200050, China;2. University of Chinese Academy of Sciences, Beijing 100049, China;3. School of Electronic and Computer Engineering, Peking University Shenzhen Graduate School, Shenzhen 518055, China)
|
Abstract: |
In order to enhance data access efficiency between front-end nodes of Internet of things and edge computing applications, a novel RZCFS(remote zero-copy file system) was proposed. The zero-copy data transmission framework based on generic network interface card was realized without special hardware. The random-access character of non-volatile memory was fully utilized by RZCFS to reduce data caches and copies, which yields a significant throughput improvement for data access. A buffer pool was implemented, the traditional network stack and storage stack were simplified and converged to shorten the file access path, which can eliminate software overhead and reduce data access latency. As a result, RZCFS provides the low-latency and high-bandwidth remote data access. Simulation results show that it achieves 42.26%~99.19% latency reductions for traditional NFS (network file system). The throughput of fine-grained access can reach 1297 times faster than those of NFS. The RZCFS significantly reduces the processor cycles and cache misses. |
Keywords: non-volatile memory Internet of things edge computing zero copy network file system |
|
|
|
|
|