autostereoscopic displays class 1 of 3 from optics for hire

An intermediate-level course presented by Gregg Favalora3-D Without Glasses: Autostereoscopic Displays : 

An intermediate-level course presented by Gregg Favalora3-D Without Glasses: Autostereoscopic Displays Class 1 of 3

Ubiquitous Portrayal of “Holography” : 

Ubiquitous Portrayal of “Holography” “CSI:NY” (2008)

About these online classes : 

About these online classes What will I learn? Why things “look” 3-D, some hopefully new to you The underlying challenges of 3-D display Survey of lenticular, barrier, volumetric, holographic, and other displays What are the prerequisites? General scientifically-minded background No math or optics beyond the basics Some sections are more techy than others www.opticsforhire.com 4

John, Gregg, and the OFH team : 

www.opticsforhire.com 5 John, Gregg, and the OFH team Boston • L’viv • Minsk – 25 creative, experienced engineers – 100+ projects John Ellis President Gregg Favalora Principal Optics for Hire: We invent and improve optics-based products LEDs – Lens systems – “Physics-heavy” product design

Slide 6: 

www.opticsforhire.com 6 Imaging Illumination, NonImaging Gratings Electronics Systems

Agenda : 

Agenda The Vision Fundamentals Seeing in 3-D Components (MEMS, etc.) Fundamental “limits” Obvious snake oil Display Technologies Stereoscopes Parallax-barrier displays Integral photography Lenticular displays Multi-view displays Volumetric displays Holograms Holographic video More exotic stuff Inverse super-resolution Piecewise lightfield reconstruction So? Here’s what we wish existed. The methods I like Wrap-up Where to learn more

Fundamentals : 

Fundamentals Depth Cues Common 3-D Architectures Billions of bits Two enabling technologies The currently impossible Snake oil

Fundamentals : 

Fundamentals Depth Cues Common 3-D Architectures Billions of bits Two enabling technologies The currently impossible Snake oil

Monocular depth cues : 

Credit: N. A. Dodgson, Cambridge Univ. Monocular depth cues

“Illusory” depth cues : 

“Illusory” depth cues Using one eye Seeing larger pictures farther away Changing the convergence of the eyes (from normal) Looking through a small hole Intentional defocus Looking at a picture in a mirror Blurring one eye’s focus when viewing in stereo (That is, due to environmental factors or viewing conditions.) M. Siegel, S. Nagata, “Just enough reality: comfortable 3-D viewingvia microstereopsis,” IEEE Trans. Circ. and Sys. for Video Tech., 10(3), (2000).

Why 3D?3D cues not provided by a 2D image : 

Why 3D?3D cues not provided by a 2D image stereo (binocular) parallax each eye sees a different image movement parallax different images are seen when the head is moved convergence our eyes converge on the object of interest accommodation (focus) our eyes’ lenses focus on the object of interest Credit: N. A. Dodgson, Cambridge Univ.

Your eyes perceive intersecting rays as points : 

Your eyes perceive intersecting rays as points Rendering Reconstruction

Fundamentals : 

Fundamentals Depth Cues Common 3-D Architectures Billions of bits Two enabling technologies The currently impossible Snake oil

Common 3-D display types : 

Common 3-D display types Stereo headwear Partitioning the 3-D scene into… Discrete viewpoints Discrete cross-sections of various dimensions Something undergoing a complex transform (e.g. holography) The extremes are only partially explored (e.g. monoscopic and physical 3-D)

Fundamentals : 

Fundamentals Depth Cues Common 3-D Architectures Billions of bits Two enabling technologies The currently impossible Snake oil

3-D: Back of the envelope : 

3-D: Back of the envelope If you want: 30 cm x 30 cm x 30 cm image @ 120 Hz and 24-bit color. Slice-stacking (27 Megavoxel volumetric) 1 mm3 resolution: 78 Gbits/sec Multi-view 120° field-of-view, 1 view/degree: 453 Gbits/sec Holography (i.e. “traditional”) Needs 2000 lpmm: 43 Tbits/sec, neglecting color

Fundamentals : 

Fundamentals Depth Cues Common 3-D Architectures Billions of bits Two enabling technologies The currently impossible Snake oil

Enabling Technologies (1:2) : 

Enabling Technologies (1:2) Modulate light with Texas Instruments DLP™. XGA resolution, 32,550 frames/sec.

Enabling Technologies (2:2) : 

Enabling Technologies (2:2) J. Molemaker, et al, “Low Viscosity Flow Simulations for Animation,” Eurographics / SIGGRAPH (2008) NVIDIA GeForce 8800 GT (GPGPU) Stream Processors: 112 Core Clock: 600 MHz Stream Clock: 1500 MHz Memory: 512 MB Memory Bandwidth: 57.6 GB/s

Fundamentals : 

Fundamentals Depth Cues Common 3-D Architectures Billions of bits Two enabling technologies The currently impossible Snake oil

There are limits… : 

There are limits…

A Real Limit: Window Violations : 

A Real Limit: Window Violations M. Halle, “Autostereoscopic displays and computer graphics,” Computer Graphics, ACM SIGGRAPH 31(2), May 1997, 58-62. “Our current understanding of physics does not include a practical way of forcing photons to change direction in the absence of an optical medium. Thus, a fundamental and general statement can be made about all spatial displays, whatever its particular technology: A display medium or element must always lie along a line of sight between the viewer and all parts of a spatial image.”

A Real Limit: Window Violations : 

A Real Limit: Window Violations M. Halle, “Autostereoscopic displays and computer graphics,” Computer Graphics, ACM SIGGRAPH 31(2), May 1997, 58-62.

A Real Limit: Window Violations : 

A Real Limit: Window Violations M. Halle, “Autostereoscopic displays and computer graphics,” Computer Graphics, ACM SIGGRAPH 31(2), May 1997, 58-62.

Fundamentals : 

Fundamentals Depth Cues Common 3-D Architectures Billions of bits Two enabling technologies The currently impossible Snake oil

Not Really 3-D : 

Not Really 3-D Fresnel re-imaging 2-D Projection onto holographicoptical element

In particular… : 

In particular… www.opticsforhire.com 29 …beware of so-called 3-D displays that look like a large arcade-game cabinet with a monitor inside. Look at the specifications sheet for the product you’re interested in. If there is a parameter called “video input” and it only requires a single XGA video input, then you need to be careful. Giving the vendor the benefit of the doubt, perhaps the system is able to extract 3-D data from a 2-D image, and somehow display it. But the more likely scenario is that the 2-D image is re-imaged into a plane in the air. That’s great if you want floating 2-D. But if you expected “walk-around” 3-D, in which you can inspect the imagery from different sides, then you should ask the manufacturer if that’s possible. 2-D Video In Magic 3-D Out!

Agenda : 

Agenda The Vision Fundamentals Seeing in 3-D Components (MEMS, etc.) Fundamental “limits” Obvious snake oil Display Technologies Stereoscopes Parallax-barrier displays Integral photography Lenticular displays Multi-view displays Volumetric displays Holograms Holographic video More exotic stuff Inverse super-resolution Piecewise lightfield reconstruction So? Here’s what we wish existed. The methods I like Wrap-up Where to learn more

Slide 31: 

Thank you! Gregg Favalora – Optics for Hire Gregg [at] opticsforhire.com Want to learn more? E-mail me, and introduce yourself. Go to www.stereoscopic.org (The 3-D conference: Stereoscopic displays & apps.) SPIE MS 171: Fundamental Techniques in Holography (Bjelkhagen & Caulfield) SPIE MS 162: Three-Dimensional Displays (Benton) Holographic Imaging (Benton & Bove – posthumous textbook from MIT holography) Volumetric Three-Dimensional Display Systems (Blundell & Schwarz)