平行光场：基本框架与流程

doi:10.11959/j.issn.2096-6652.202112

智能科学与技术学报 ›› 2021, Vol. 3 ›› Issue (1): 110-122.doi: 10.11959/j.issn.2096-6652.202112

• 学术论文 • 上一篇

平行光场：基本框架与流程

王飞跃¹^,²^,³, 孟祥冰¹, 杜思聪¹^,², 耿征⁴

¹ 中国科学院自动化研究所复杂系统管理与控制国家重点实验室，北京 100190
² 青岛智能产业技术研究院平行光学技术创新中心，山东青岛 266000
³ 中国科学院大学人工智能学院，北京 100049
⁴ Genex科技公司，美国马里兰州肯辛顿 20895

修回日期:2020-08-25 出版日期:2021-03-15 发布日期:2021-03-01
作者简介:王飞跃（1961- ），男，博士，中国科学院自动化研究所复杂系统管理与控制国家重点实验室主任，中国科学院大学中国经济与社会安全研究中心主任，青岛智能产业技术研究院院长，主要研究方向为平行系统的方法与应用、社会计算、平行智能以及知识自动化。
孟祥冰（1990- ），男，博士，中国科学院自动化研究所复杂系统管理与控制国家重点实验室助理研究员，主要研究方向为视觉SLAM、真三维显示。
杜思聪（1996- ），男，中国科学院自动化研究所复杂系统管理与控制国家重点实验室硕士生，主要研究方向为视觉SLAM。
耿征（1957- ），男，博士，Genex 科技公司创始人，主要研究方向为真三维显示、三维成像、生物医学工程、智能视频监控系统、智能机器人。
基金资助:
国家重点研发计划基金资助项目(2018AAA0101502)

Parallel light field: the framework and processes

Fei-Yue WANG¹^,²^,³, Xiangbing MENG¹, Sicong DU¹^,², Zheng GENG⁴

¹ The State Key Laboratory for Management and Control of Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China
² Parallel Optics Technology Innovation Center, Qingdao Academy of Intelligent Industries, Qingdao 266000, China
³ School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China
⁴ Genex Technologies Inc., Kensington, MD 20895, the United States

Revised:2020-08-25 Online:2021-03-15 Published:2021-03-01
Supported by:
The National Key Research and Development Program of China(2018AAA0101502)

摘要/Abstract

摘要：

光场是环境中光线的集合，对光场信息的采集、计算以及显示是极具挑战性的复杂问题。基于 ACP 的平行光场理论为解决此问题提供了一条新的有效途径。平行光场利用采集得到的实际物理世界的光场信息构建了增强的人工世界的光场，并且以采集得到的实际物理世界的光场信息为引导，在增强的人工世界的光场中进行光场实验，得到最优的光场采集方案或者显示虚实方案，最后通过平行执行的过程建立起物理世界的光场和人工世界的光场的联动优化，使整个系统成为闭环，实现智能的光场采集和显示，建立光场信息处理和应用的虚实结合的全新理论体系。

关键词: 平行, ACP, 光场, 光场显示, 光场采集

Abstract:

The light field is the collection of lights in the environment, and the acquisition, calculation and display of light field information are extremely challenging and complex issues.The ACP-based theory of parallel light field provides a new and effective way to solve this problem.It used the acquired light field information from the actual physical world to construct an enhanced light field of artificial world.And guided by the light field and other information from the actual physical world, light field experiments were conducted in the enhanced light field in all artificial world to obtain the optimal light field acquisition or display schemes.Finally, the parallel optimization of the physical and artificial light fields was established through the process of parallel execution, so that the entire system become a closed-loop system.In this way, intelligent light field acquisition and display were achieved, and a real-virtual theoretical framework for light field information processing and utilization was established.

Key words: parallel, ACP, light field, light field display, light field acquisition

中图分类号:

TP37

王飞跃, 孟祥冰, 杜思聪, 等. 平行光场：基本框架与流程[J]. 智能科学与技术学报, 2021, 3(1): 110-122.

Fei-Yue WANG, Xiangbing MENG, Sicong DU, et al. Parallel light field: the framework and processes[J]. Chinese Journal of Intelligent Science and Technology, 2021, 3(1): 110-122.

图/表 18

图1

图2

图4

图3

图5

图6

图7

图8

图9

图10

图11

图12

图13

图14

图15

图16

图17

图18

参考文献 61

[1]	ELAINE M , KATJA H , PEARSON E ,et al. Human anatomy ＆ physiology:pearson new international edition/interactive physiology 10-syste[J]. Enfermedades Infecciosas y Microbiología Clínica, 2013,29(1): 72-73.
[2]	GERSHUN A . The light field[J]. Studies in Applied Mathematics, 1939,18(1-4): 51-151.
[3]	MOON P , SPENCER D E . The photic field[M]. Cambridge: MIT Press, 1981.
[4]	HONAUER K , JOHANNSEN O , KONDERMANN D ,et al. A dataset and evaluation methodology for depth estimation on 4d light fields[C]// Proceedings of the Asian Conference on Computer Vision. Berlin:Springer, 2016.
[5]	GENG J . Volumetric 3D display for radiation therapy planning[J]. Journal of Display Technology, 2008,4(4): 437-450.
[6]	GENG J . Three-dimensional display technologies[J]. Advances in Optics and Photonics, 2013,5(4): 456-535.
[7]	LEE B . Three-dimensional displays,past and present[J]. Physics Today, 2013,66(4): 36-41.
[8]	LEVOY M , . Light field rendering[C]// Proceedings of the ACM SIGGRAPH Conference. New York:ACM Press, 1996.
[9]	ADELSON E H , . The plenoptic function and the elements of early vision[C]// Proceedings of the Computational Models of Visual Processing.[S.l.:s.n.], 1991: 3-20
[10]	CHAI J X , TONG X , CHAN S C ,et al. Plenoptic sampling[C]// Proceedings of the ACM SIGGRAPH Conference. New York:ACM Press, 2000: 307-318.
[11]	王飞跃 . 平行系统方法与复杂系统的管理和控制[J]. 控制与决策, 2004,19(5): 485-489,514.
	WANG F Y . Parallel system methods for management and control of complex systems[J]. Control and Decision, 2004,19(5): 485-489,514.
[12]	WANG F Y . Parallel control and management for intelligent transportation systems:concepts,architectures,and applications[J]. IEEE Transactions on Intelligent Transportation Systems, 2010,11(3): 630-638.
[13]	王飞跃 . 平行控制:数据驱动的计算控制方法[J]. 自动化学报, 2013(4): 5-14.
	WANG F Y . Parallel control:a method for data-driven and computational control[J]. Acta Automatica Sinica, 2013(4): 5-14.
[14]	王飞跃 . 计算实验方法与复杂系统行为分析和决策评估[J]. 系统仿真学报, 2004,16(5): 893-897.
	WANG F Y . Computational experiments for behavior analysis and decision evaluation of complex systems[J]. Journal of System Simulation, 2004,16(5): 893-897.
[15]	LAM EDMUND Y . Computational photography with plenoptic camera and light field capture:tutorial[J]. Journal of the Optical Society of America a Optics Image Science ＆ Vision, 2015,32(11): 2021-2032.
[16]	SHI L X , HASSANIEH H , DAVIS A ,et al. Light field reconstruction using sparsity in the continuous fourier domain[J]. ACM Transactions on Graphics, 2014,34(1): 1-13.
[17]	GEORGEIV T , ZHENG K C , CURLESS B ,et al. Spatio-angular resolution tradeoffs in integral photography[C]// Proceedings of the 17th Eurographics Symposium on Rendering Techniques,Nicosia,Cyprus.[S.l.]: The Eurographics Association, 2006.
[18]	GEORGEIV T , INTWALA C . Light field camera design for integral view photography[R]. 2008.
[19]	LUMSDAINE A , GEORGIEV T , SYSTEMS A . Full resolution lightfield rendering[R]. 2008.
[20]	WILBURN B , JOSHI N , VAISH V ,et al. High performance imaging using large camera arrays[J]. ACM Transactions on Graphics, 2005,24(3): 765-776.
[21]	CAO X , GENG Z , LI T T . Dictionary-based light field acquisition using sparse camera array[J]. Optics Express, 2014,22(20): 24081-24095.
[22]	MARWAH K , WETZSTEIN G , BANDO Y ,et al. Compressive light field photography using over complete dictionaries and optimized projections[J]. ACM Transactions on Graphics, 2013,32(4): 1-12.
[23]	刘浩敏, 章国锋, 鲍虎军 . 基于单目视觉的同时定位与地图构建方法综述[J]. 计算机辅助设计与图形学学报, 2016,28(6): 855-868.
	LIU H M , ZHANG G F , BAO H J . A survey of monocular simultaneous localization and mapping[J]. Journal of Computer-Aided Design ＆Computer Graphics, 2016,28(6): 855-868.
[24]	CADENA C , CARLONE L , CARRILLO H ,et al. Past,present,and future of simultaneous localization and mapping:toward the robust-perception age[J]. IEEE Transactions on Robotics, 2016,32(6): 1309-1332.
[25]	BRESSON G , ALSAYED Z , YU L ,et al. Simultaneous localization and mapping:a survey of current trends in autonomous driving[J]. IEEE Transactions on Intelligent Vehicles, 2017,2(3): 194-220.
[26]	YOUNES G , ASMAR D , SHAMMAS E ,et al. Keyframe-based monocular SLAM:design,survey,and future directions[J]. Robotics and Autonomous Systems, 2017:S0921889017300647.
[27]	孟祥冰, 王蓉, 张梅 ,等. 平行感知:ACP 理论在视觉SLAM 技术中的应用[J]. 指挥与控制学报, 2017,3(4): 350-358.
	MENG X B , WANG R , ZHANG M ,et al. Parallel perception:an ACP-based approach to visual SLAM[J]. Journal of Command and Control, 2017,3(4): 350-358.
[28]	LEE S , JANG C , MOON S ,et al. Additive light field displays:realization of augmented reality with holographic optical elements[J]. ACM Transactions on Graphics, 2016,35(4): 1-13.
[29]	DEBEVEC P , WENGER A , TCHOU C ,et al. A lighting reproduction approach to live-action compositing[C]// Proceedings of the 29th Conference on Computer Graphics and Interactive Techniques. New York:ACM Press, 2002: 547-556.
[30]	TIM H , JONATHAN C , CHRIS T ,et al. Light stage 2.0[C]// SIGGRAPH Technical Sketches.[S.l.:s.n.], 2001.
[31]	ALEXANDER O , ROGERS M , LAMBETH W ,et al. Creating a photoreal digital actor:the digital Emily project[C]// Proceedings of the 2010 Conference for Visual Media Production. Piscataway:IEEE Press, 2010: 176-187.
[32]	ALEXANDER O , ROGERS M , LAMBETH W ,et al. The digital Emily project:achieving a photorealistic digital actor[J]. IEEE Computer Graphics ＆ Applications, 2010,30(4): 20-31.
[33]	STEUER J . Defining virtual reality:dimensions determining telepresence[J]. Journal of Communication, 1992,42(4): 73-93.
[34]	MILGRAM P , KISHINO F . A taxonomy of mixed reality visual displays[J]. IEICE Transactions on Information and Systems, 1994,77(12): 1321-1329.
[35]	AZUMA R , BAILLOT Y , BEHRINGER R ,et al. Recent advances in augmented reality[J]. IEEE Computer Graphics and Applications, 2001,21(6): 34-47.
[36]	ZHANGA Z , GENGA Z , LIA T ,et al. Integration of real-time 3D image acquisition and multiview 3D display[J]. Proceedings of SPIE the International Society for Optical Engineering, 2014: 8979.
[37]	CAO X , GENG Z , LI T T . Dictionary-based light field acquisition using sparse camera array[J]. Optics Express, 2014,22(20): 24081-24095.
[38]	PEI R J , GENG Z , ZHANG Z X . Subpixel multiplexing method for 3D lenticular display[J]. Journal of Display Technology, 2016,12(10): 1.
[39]	PEI R J , GENG Z , MA K ,et al. Three dimensional lenticular display synthetic image rendering based on light field acquisition[J]. Journal of the Society for Information Display, 2017,25(1-3): 117-125.
[40]	WANG R , GENG Z , ZHANG Z X ,et al. Visualization techniques for augmented reality in endoscopic surgery[C]// International Conference on Medical Imaging and Augmented Reality. Berlin:Springer, 2016.
[41]	WANG R , ZHANG M , MENG X B ,et al. 3D tracking for augmented reality using combined region and dense cues in endoscopic surgery[J]. IEEE Journal of Biomedical and Health Informatics, 2017: 1540-1551.
[42]	王飞跃 . 平行光场与平行光学,从光学计算实验到光学引导智能[R]. 2018.
	WANG F Y . Parallel light field and parallel optics,from optical computing experiment to optical guided intelligence[R]. 2018.
[43]	康孟珍, 王秀娟, 华净 ,等. 平行农业:迈向智慧农业的智能技术[J]. 智能科学与技术学报, 2019,1(2): 107-117.
	KANG M Z , WANG X J , HUA J ,et al. Parallel agriculture:intelligent technology toward smart agriculture[J]. Chinese Journal of Intelligent Science and Technology, 2019,1(2): 107-117.
[44]	吕宜生, 陈圆圆, 金峻臣 ,等. 平行交通:虚实互动的智能交通管理与控制[J]. 智能科学与技术学报, 2019,1(1): 21-33.
	LYU Y S , CHEN Y Y , JIN J C ,et al. Parallel transportation:virtual-real interaction for intelligent traffic management and control[J]. Chinese Journal of Intelligent Science and Technology, 2019,1(1): 21-33.
[45]	王飞跃, 张梅, 孟祥冰 ,等. 平行手术:基于 ACP 的智能手术计算方法[J]. 模式识别与人工智能, 2017,30(11): 961-970.
	WANG F Y , ZHANG M , MENG X B ,et al. Parallel surgery:an acp-based approach for intelligent operations, 2017,30(11): 961-970.
[46]	AGARWAL S , SNAVELY N , SIMON I ,et al. Building romein a day[J]. Communications of the ACM, 2011,54(10): 105-112.
[47]	GOODFELLOW I J , POUGET-ABADIE J , MIRZA M ,et al. Generative adversarial networks[J]. Advances in Neural Information Processing Systems, 2014,3: 2672-2680.
[48]	束越新 . 颜色光学基础理论[M]. 山东: 山东科学技术出版社, 1981.
	SHU Y X . Basic theory of color optics[M]. Shandong: Shandong Science and Technology Press, 1981.
[49]	WYSZECKI G , STILES W S . Color science[M]. New York: Wiley, 1982.
[50]	FAIRCHILD M D . Color appearance models[M]. New York: Wiley, 2013.
[51]	BERNS R S . Billmeyer and Saltzman’s principles of color technology[M]. New York: Wiley, 2019.
[52]	FINN C , ABBEEL P , LEVINE S . Model-agnostic meta-learning for fast adaptation of deep networks[J]. arXiv preprint, 2017,arXiv:1703.03400.
[53]	RADFORD A , METZ L , CHINTALA S . Unsupervised representation learning with deep convolutional generative adversarial networks[J]. Computer Science, 2015.
[54]	ZHU J Y , PARK T , ISOLA P ,et al. Unpaired image-to-image translation using cycle-consistent adversarial networks[C]// Proceedings of the 2017 IEEE International Conference on Computer Vision. Piscataway:IEEE Press, 2017: 2242-2251.
[55]	MITRA S , ACHARYA T . Gesture recognition:a survey[J]. IEEE Transactions on Systems,Man,and Cybernetics,Part C, 2007,37(3): 311-324.
[56]	RAUTARAY S S , AGRAWAL A . Vision based hand gesture recognition for human computer interaction:a survey[J]. Artificial Intelligence Review, 2015,43(1): 1-54.
[57]	LIU Y J , ZHANG J K , YAN W J ,et al. A main directional mean optical flow feature for spontaneous micro-expression recognition[J]. IEEE Transactions on Affective Computing, 2015,7(4): 299-310.
[58]	XU K , BA J , KIROS R ,et al. Show,attend and tell:neural image caption generation with visual attention[J]. Computer Science, 2015: 2048-2057.
[59]	POTAPOV D , DOUZE M , HARCHAOUI Z ,et al. Category-specific video summarization[C]// Proceedings of the 13th European Conference on Computer Vision. Berlin:Springer, 2014: 540-555.
[60]	李力, 林懿伦, 曹东璞 ,等. 平行学习——机器学习的一个新型理论框架[J]. 自动化学报, 2017,43(1): 1-8.
	LI L , LIN Y L , CAO D P ,et al. Parallel learning:a new framework for machine learning[J]. Acta Automatica Sinica, 2017,43(1): 1-8.
[61]	LI X , WANG K F , TIAN Y L ,et al. The paralleleye dataset:a large collection of virtual images for traffic vision research[J]. IEEE Transactions on Intelligent Transportation Systems, 2018,20(6): 2072-2084.

平行光场：基本框架与流程

Parallel light field: the framework and processes

在线阅读

PDF下载

可视化

摘要/Abstract

引用本文

使用本文

图/表 18

参考文献 61

相关文章 15

Metrics

推荐阅读 0

[1]	缪青海, 吕宜生. 元宇宙下的平行交通系统[J]. 智能科学与技术学报, 2023, 5(1): 32-40.
[2]	康孟珍, 孙贺全, 王秀娟, 王飞跃. 系统农业：结合农业社会经济属性的建模和控制[J]. 智能科学与技术学报, 2023, 5(1): 41-50.
[3]	王晓, 杨林瑶, 胡斌, 侯家琛. 平行推理：一种基于ACP方法的虚实互动的知识协同框架[J]. 智能科学与技术学报, 2023, 5(1): 69-82.
[4]	田永林, 陈苑文, 杨静, 王雨桐, 王晓, 缪青海, 王子然, 王飞跃. 元宇宙与平行系统：发展现状、对比及展望[J]. 智能科学与技术学报, 2023, 5(1): 121-132.
[5]	康孟珍, 邱文忠, 陈自富, 王猛, 许沙沙, 王秀娟, 倪爱东, 蒋玉洁, 陈世超, DEREFFYE Philippe, 王飞跃. 平行圆明园：从数字孪生园林到元宇宙智慧遗址公园[J]. 智能科学与技术学报, 2022, 4(3): 301-307.
[6]	郭超, 鲁越, 王晓, 易达, 王虓, 王飞跃. 人机物CPSS智能融合的平行创作架构与关键技术研究[J]. 智能科学与技术学报, 2022, 4(3): 344-354.
[7]	张向文, 王飞跃. 平行轮胎的基本架构与关键技术[J]. 智能科学与技术学报, 2022, 4(3): 445-457.
[8]	李小双, 王晓, 杨林瑶, 田永林, 王雨桐, 张俊, 王飞跃. 元电网MetaGrid：基于平行电网的新一代智能电网的体系与架构[J]. 智能科学与技术学报, 2021, 3(4): 387-398.
[9]	廖泽华, 梁子钰, 周天民, 卢经纬, 魏庆来. 基于平行控制的离散非线性系统的事件触发近似最优控制[J]. 智能科学与技术学报, 2021, 3(4): 435-443.
[10]	常方乐, 康孟珍, 王秀娟, 雷加强, 王飞跃. 平行智能风沙防护治理决策支持系统——塔克拉玛干沙漠公路及其防沙体系[J]. 智能科学与技术学报, 2021, 3(4): 499-506.
[11]	李亚玲, 杨林瑶, 葛俊, 覃缘琪, 王晓. 博弈5.0：基于平行系统和机器博弈的社会认知平行博弈[J]. 智能科学与技术学报, 2021, 3(4): 507-520.
[12]	王飞跃, 蒋怀光. 平行电池：智能生态化电池技术与服务体系的框架和流程[J]. 智能科学与技术学报, 2021, 3(4): 521-531.
[13]	王飞跃. 平行哲学与智能技术：平行产业与智慧社会的对偶方程与测试基础[J]. 智能科学与技术学报, 2021, 3(3): 245-255.
[14]	王春法, 王飞跃, 鲁越, 李华飙, 郭超. 平行博物馆：新时代博物馆运营的智能管理与控制[J]. 智能科学与技术学报, 2021, 3(2): 125-136.
[15]	吴宇震, 张俊, 高天露, 孙玉健, 刘金旭. 平行港口：智慧绿色时代下港口工业智联网新形态与体系结构[J]. 智能科学与技术学报, 2021, 3(2): 218-227.