高空间分辨率
概念相机 其它研究方向
景深范围增强
大视角采集(1)—Cata-Fisheye Camera
-12-
Cata-Fisheye Camera for Panoramic Imaging, Workshop on Applications of Computer Vision ’08
Prototype
DoF Extended Image
景深范围增强(1) —Flexible DoF
-38-
Sensor Motion
Sensor Motion

Columbia University Heads the Columbia Computer Vision Laboratory (CAVE) and co-directs the Columbia Vision and Graphics Center Best paper awards at ICCV ‘90, ICPR ‘94, CVPR ‘94, ICCV ‘95, CVPR’00 and CVPR’04 He is the recipient of the David Marr Prize (1990 and 1995), the David and Lucile Packard, … He was elected to the National Academy of Engineering
场景信息采集(1)—Coded Aperture Pair
1. Genetic Algorithm
Resolution: 2 x 11 x 11
-27-
2. Gradient Descent Search
Resolution: 2 x 33 x 33
1st Run:
2nd Run: 3. Prototyping 3rd Run:


涉及的研究领域
-4-
Computational Cameras
Physics-Based Vision
Representation & Recognition
Graphics & Displays
实验室人员
-5-
Shree Nayar
-6-
Professor at department of Computer Science at
CAVE的计算摄像学观点
-7-
CAVE的主要研究内容
-8-
Computational Sampling
Computational Reconstruction
提纲
一 二
-9-
CAVE实验室概要介绍 CAVE实验室计算摄像研究工作
提纲
一 二
-10-
CAVE实验室概要介绍 CAVE实验室计算摄像研究工作
-34-
Captured Image under Fluorescent
Multispectral Relit Image to LF
多光谱成像(2)—Temporal Modulation
-35-
提纲
一 二
-36-
CAVE实验室概要介绍 CAVE实验室计算摄像研究工作
高速运动采集
大视角采集
base
sensor
illumination
High frame rate High signal-noise-ratio
lm,n = k bk ( )cm ( ) d nq lq ( )d
k 1 q 1
Ks
Q
Optimizing multiplexing
d arg min || I mn,e (d ) I mn,e ||
高速运动采集
大视角采集
大动态范围采集
场景信息采集与计算 多光谱成像
高空间分辨率
概念相机 其它研究方向
景深范围增强
提纲
一 二
-11-
CAVE实验室概要介绍 CAVE实验室计算摄像研究工作
高速运动采集
大视角采集
大动态范围采集
场景信息采集与计算 多光谱成像
Camera
Captured Image
大视角采集(1)—Cata-Fisheye Camera
-13-
Mirror
Fisheye Lens
Detector
Field of View
大视角采集(1)—Cata-Fisheye Camera
-14-
Video Conference
大视角场景采集(2)—Flexible Mirror
-18-
Collage of Church
提纲
一 二ቤተ መጻሕፍቲ ባይዱ
-19-
CAVE实验室概要介绍 CAVE实验室计算摄像研究工作
高速运动采集
大视角采集
大动态范围采集
场景信息采集与计算 多光谱成像
高空间分辨率
概念相机 其它研究方向
景深范围增强
大动态范围采集(1)—Assorted Pixels
多光谱成像(1)—Multiplexed Illum.
Multispectral Imaging Using Multiplexed Illumination, ICCV 2007
Ks
-32-
lm ,n = k bk ( )cm ( )pn ( )d
k 1
image
surface
-21-
Reconstruction Stage :
Learned Structural Model Measured Neighborhood
Reconstructed Value
大动态范围采集(1)—Assorted Pixels
-22-
Inset: Stairs (Histogram Equalized) Ground Truth Image (12 bits per color channel)
Flexible Mirror Imaging, Workshop on Omnidirectional Vision, 2007
-15-
Prototype
Captured Image
(u, v)
Viewing Direction
Du ,v
Mirror Shape Estimation
u ,v A( Du i ,v j , Du 1i ,v j , Du i ,v 1 j )
大动态范围采集
场景信息采集与计算 多光谱成像
高空间分辨率
概念相机 其它研究方向
景深范围增强
景深范围增强(1) —Flexible DoF
Flexible Depth of Field Photography, ECCV 2008
-37-
Sensor Motion
Normal Image
Multi-Sampled Imaging With Structural Models, ECCV 2002
-20-
Base Pattern
Base Pattern
SVC : Spatially Varying Color ( Bayer Pattern )
SVE : Spatially Varying Exposure ( Nayar et. al., 00 )
?
Base Pattern
SVEC : Spatially Varying Color and Exposure
大动态范围采集(1)—Assorted Pixels
Learning Stage :
Sensor Model Compute Parameters of Structural Model Synthesized Neighborhood High quality Image dataset
大视角采集
大动态范围采集
场景信息采集与计算 多光谱成像
高空间分辨率
概念相机 其它研究方向
景深范围增强
场景信息采集(1)—Coded Aperture Pair
Coded Aperture Pairs for Depth from Defocus, ICCV 2009
多光谱成像(1)—Multiplexed Illum.
Illustration of multiplexing Illum. Prototype system
-33-
多光谱成像(1)—Multiplexed Illum.
Incandescent Fluorescent Blue Light Daylight
LCD Electronics
-24-
LCD Attenuator
attenuator element detector element
Tt+1
controller
It
Video Camera Imaging Lens
提纲
一 二
-25-
CAVE实验室概要介绍 CAVE实验室计算摄像研究工作
高速运动采集
-29-
Half-mirror
Camera
Projector
场景信息采集(3)—Diffusion
Depth from Diffusion, CVPR 2010
A Holographic Diffuser Five playing cards, 0.29mm thick each
-30-
~ 10 micron
i 0 j 0
1
1
大视角场景采集(2)—Flexible Mirror
-16-
大视角采集(3)—Scene Collages