基于细节空间关系的自然语言组合描述方法

张珂, 丁巧林, 刘涛, 赵伟

清华大学学报(自然科学版) ›› 2014, Vol. 54 ›› Issue (3) : 341-347.

PDF(1760 KB)
PDF(1760 KB)
清华大学学报(自然科学版) ›› 2014, Vol. 54 ›› Issue (3) : 341-347.
论文

基于细节空间关系的自然语言组合描述方法

作者信息 +

Linguisticdescriptions based on detail spatial relations

Author information +
文章历史 +

摘要

如何自动生成图像或视频中空间对象间的空间关系描述是自然语言场景描述乃至图像理解的重要任务之一。针对以往空间关系自然语言描述方法仅考虑整体空间关系描述的问题,该文给出了细节空间关系的概念和表示方法,并基于四叉树直方图模型建立了不同参考框架下的细节空间关系自然语言组合描述方法。采用人工图片作为算例对该方法进行验证,结果表明该方法能够生成符合人类空间认知和描述习惯的细节空间关系自然语言描述语句。

Abstract

How to automatically generate linguistic descriptions of spatial relations between spatial objects in image or video is one of the important tasks in linguistic scene description and image understanding. This paper presents the concept and the representation of detail spatial relations, and proposes the linguistic description method of detail spatial relations under different reference frames to solve the problem that the past linguistic descriptions methods of spatial relations only consider the overall spatial relations. Excellent experimental results from synthetic image examples show that the linguistic descriptions of detail spatial relations are consistent with human cognition and description habits.

关键词

空间方向关系 / 细节空间关系 / 四叉树直方图 / 自然语言组合描述

Key words

spatial directional relations / detail spatial relations / quadtree histogram / linguistic descriptions

引用本文

导出引用
张珂, 丁巧林, 刘涛, 赵伟. 基于细节空间关系的自然语言组合描述方法[J]. 清华大学学报(自然科学版). 2014, 54(3): 341-347
Ke ZHANG, Qiaolin DING, Tao LIU, Wei ZHAO. Linguisticdescriptions based on detail spatial relations[J]. Journal of Tsinghua University(Science and Technology). 2014, 54(3): 341-347
中图分类号:     

参考文献

[1] Frank A. Qualitative spatial reasoning about distances and directions in geographic space[J]. Journal of Visual Languages and Computing, 1992, 3: 343-371.
[2] Papadias D, Theodoridis Y, Sellis T. Spatial relations, minimum bounding rectangles, and spatial data structures[J]. International Journal of Geographical Information Science, 1997, 11(2): 111-138.
[3] Miyajima K, Ralescu A. Spatial-organization in 2D segmented images: Representation and recognition of primitive spatial relations[J]. Fuzzy Sets and Systems, 1994, 65(2): 225-236.
[4] Matsakis P, Wendlling L. A new way to represent the relative position between areal objects[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1999, 21(7): 634-644.
[5] 闫浩文,郭仁忠.空间方向关系形式化描述模型研究[J].测绘学报, 2003, 32(1): 42-46. YANHaowen, GUO Renzhong. Research on formal description model of directional relationships[J]. Acta Geodaetica et Cartographica Sinica, 2003, 32(1): 42-46. (in Chinese)
[6] Santosh K C, Wendling L, Lamiroy B. Using spatial relations for graphical symbol description [C]// International Conference on Pattern Recognition. Isanbul, Turkey, 2010.
[7] Zhang K, Wang X J, Zhong Y X. Research on fundamental theory of spatial directional relation [C]// IEEE International Conference on Cloud Computing and Intelligence Systems. Beijing, China, 2011.
[8] Zhang K, Wang K P, Wang X J, et al.Spatial relations modeling based on visual area histogram [C]// ACIS International Conference on Software Engineering Artificial Intelligence Networking and Parallel/Distributed Computing. London, UK, 2010.
[9] 张珂,王小捷,钟义信.四叉树直方图空间方向关系形式化模型[J].计算机辅助设计与图形学学报, 2012, 24(7): 901-908. Zhang Ke, WANG Xiaojie, ZHONG Yixin. Quadtree histogram formal model of spatial directional relations[J]. Journal of Computer-Aided Design & Computer Graphics, 2012, 24(7): 901-907. (in Chinese)
[10] 张珂,王小捷,靳越.四叉树直方图的特殊方向关系表达[J].中国图像图形学报, 2013, 18(1): 101-106. ZHANG Ke, WANG Xiaojie, JIN Yue. Expression of special directional relation based on quadtree histogram[J]. Journal of Image and Graphics, 2013, 18(1): 101-106. (in Chinese)
[11] Keller J M, Wang X A. Fuzzy rule-based approach to scene description involving spatial relationships[J]. Computer Vision and Image Understanding, 2000, 80(1): 21-41.
[12] Matsakis P, Keller J M, Wending L. Linguistic descriptions of relative positions in images[J]. IEEE Transactions on Systems, Man, and Cybernetics, 2001, 31(4): 573-588.
[13] Skubic M, Matsakis P, Chronis G. Generating multi-level linguistic spatial descriptions from range sensor readings using the histogram of forces[J]. Autonomous Robots, 2003, 14(1): 51-69.
[14] Matsakis P, Wawrzyniak L, Ni J B. Relative positions in words: A system that builds descriptions around allen relations[J]. International Journal of Geographical Information Science, 2010, 24(1): 1-23.
[15] 张珂,王小捷,钟义信.在观察者参考框架下的空间关系自然语言描述[J].清华大学学报: 自然科学版), 2011, 51(12): 1831-1838. ZHANG Ke, WANG Xiaojie, ZHONG Yixin. Linguistic descriptions of spatial relations in observer reference framework[J]. Journal of Tsinghua Univ: Sci & Technol, 2011, 51(12): 1831-1838. (in Chinese)
[16] 张珂,钟义信,王小捷,等.在外部参考框架下的空间关系自然语言描述[J].北京邮电大学学报, 2012, 35(3): 11-15. ZHANG Ke, ZHONG Yixin, WANG Xiaojie, et al.Linguistic descriptions of spatial relations in extrinsic reference framework[J]. Journal of Beijing University of Posts and Telecommunications, 2012, 35(3): 11-15. (in Chinese)
[17] Franzosar E M. Point-set topological spatial relations[J]. International Journal of Geographical Information Systems, 1991, 5(2): 161-174.

基金

国家自然科学基金资助项目(61302163, 61302105);河北省自然科学基金资助项目(F2012502015);中央高校基本科研业务费专项资金项目

PDF(1760 KB)

Accesses

Citation

Detail

段落导航
相关文章

/