Special Section on Stereoscopic Displays and Applications

Viewing zone of an autostereoscopic display with a directional backlight using a convex lens array

[+] Author Affiliations
Shuta Ishizuka

University of Tsukuba, 1-1-1 Tennoudai, Tsukuba 305-8573, Japan

Takuya Mukai

University of Tsukuba, 1-1-1 Tennoudai, Tsukuba 305-8573, Japan

Hideki Kakeya

University of Tsukuba, 1-1-1 Tennoudai, Tsukuba 305-8573, Japan

J. Electron. Imaging. 23(1), 011002 (Jan 30, 2014). doi:10.1117/1.JEI.23.1.011002
History: Received June 1, 2013; Revised October 18, 2013; Accepted November 7, 2013
Text Size: A A A

Open Access Open Access

Abstract.  When a directional backlight to each eye alternates synchronously with the alternation of left-eye and right-eye images on the display panel, the viewer can see a stereoscopic image without wearing special goggles. One way to realize a directional backlight is to place a convex lens array in front of dot matrix light sources to generate collimated light. To implement this method, however, defocusing and field curvature of the lens should be taken into account. The viewing zone of an autostereoscopic display with a directional backlight using a convex lens array is analyzed based on optical simulations.

Time-division multiplexing is one of the major methods to attain a stereoscopic display. With the advancement of liquid crystal display (LCD) technologies, LCD panels that can attain a short response time (120 Hz or faster) have been developed, which has enabled commercialization of three-dimensional (3-D) LCD TV sets based on the time-division multiplexing coupled with shutter glasses.

LCD panels operating at high refresh rates can also be applied to autostereoscopic displays with high resolution. Most autostereoscopic displays developed so far are based either on parallax barrier technology or on lenticular lens technology. Though multiple display pixels under a single aperture or lens can create multiple viewing zones, the cost to this is a significant loss in resolution. The time-division multiplexing has enabled the presentation of a stereoscopic image whose resolution is the same as that of the display panel.

One of the simplest ways to realize high resolution autostereoscopy with time-division multiplexing is to use an active parallax barrier.13 Fixed parallax barrier with two viewpoints reduces the resolution of the image by half. By alternating the position of the parallax barrier and the image on the display panel synchronously at a high refresh rate, a full resolution 3-D image can be delivered to the viewer. Another way to realize high resolution autostereoscopy is to use a directional backlight using a light guide film and a pair of light sources.46 The autostereoscopy can be realized by switching the light sources and the image on the display panel synchronously.

A common drawback of the time-division multiplexing autostereoscopic displays introduced so far is the limited number of viewers. Basically, they can display a stereoscopic image to a single viewer only. Though there have been a few trials to increase the number of possible viewers,7,8 the viewing position is still limited.

One way to achieve a directional backlight for multiple viewpoints is to use a subpixel-size light source coupled with a lenticular lens.9 This method, however, cannot secure many viewpoints because of the limitation on the microfabrication of the subpixel light source. A directional backlight with more viewing positions can be realized by the use of a large aperture convex lens.10,11 The same optics can also be attained by using a concave mirror.12 These systems, however, require a deep optical distance.

To solve the problem of display thickness, Hattori proposed the use of a coarse convex lens array in place of a large aperture convex lens.1316 This method, however, is not practical because the obtained 3-D image includes a distinct seam of the lens array. Ishizuka and Kakeya17 solved this problem by placing a vertical diffuser in front of the convex lens array.

One problem of the directional backlight composed of a convex lens array and a dot matrix light source is the defocusing and field curvature of the lens. These factors restrict the viewing zone of the autostereoscopic image. In this paper, the viewing zone of the autostereoscopic display using a convex lens array is analyzed based on optical simulations.

The principle of a directional backlight using a convex lens array is shown in Fig. 1. When the dot matrix light sources are placed behind the convex lens array so that the distance between them may be equal to the focal distance of the elemental lens of the lens array, collimated directional light is realized. By changing the position of the luminous light source, the orientation of the directional light can be controlled. When the directional backlight to each eye alternates synchronously with the alternation of left-eye and right-eye images on the LCD panel, the viewer can see a stereoscopic image without wearing special goggles. By increasing the number of light sources, multiple viewers can enjoy the stereoscopic image at the same time.

Graphic Jump LocationF1 :

Autostereoscopy with a directional backlight using a convex lens array.

The problem of the system shown in Fig. 1 is poor image quality due to the distinct seam of the coarse lens array as shown in Fig. 2. Also the intensity of the image is not uniform because the light going through the peripheral part of the elemental lenses is weaker than the light going through the center of the elemental lenses. To remove the seam of the lens and the nonuniformity of intensity of the image to be presented, the use of a hexagonal lens array and a vertical diffuser, as shown in Fig. 3, is effective. The diffuser is inserted to blur the seam and nonuniform intensity of the lens array. In the prototype system, a fine lenticular lens (0.02-mm radius, 0.04-mm pitch) is used as the diffuser and a pair of 24-in. Thin film transistor (TFT) panels (BenQ XL2420T), whose resolution is 1920×1080, is used as the front panel and the backlight panel to attain synchronized 120 Hz control. The antiglare film and the polarization films facing the other LCD panel are removed to let the light pass straight. Note that the LCD panels with large pixel apertures should be chosen for this system so that the effect of diffraction may not cause crosstalk.

Graphic Jump LocationF2 :

Image (Head and Lamp, Tsukuba) presented by the system shown in Fig. 1.

Graphic Jump LocationF3 :

Autostereoscopy with a directional backlight using a convex lens array and a vertical diffuser.

The image attained by the prototype system in Fig. 3 is shown in Fig. 4. To maintain autostereoscopy, the rays into the left eye and the right eye of the viewer should be separated. The ray diffused only in the vertical direction can maintain the directionality of the light in the horizontal direction, which does not destroy stereopsis. Thus, smooth stereoscopic images with little crosstalk are observed as shown in Fig. 5.

Graphic Jump LocationF4 :

Image (Head and Lamp, Tsukuba) presented by the system shown in Fig. 3.

Graphic Jump LocationF5 :

Images (Cones, Middlebury) observed from the left-eye position and the right-eye position.

In reality, however, the directional backlight using a convex lens array has two major optical problems when it is applied to autostereoscopic displays. One is the problem of defocusing and the other is the field curvature of the lens. Figure 6 illustrates how these two problems emerge. (Note that the effect of the vertical diffuser can be neglected because it does not affect the optical pathway in the horizontal direction.) To make the whole image uniformly bright, the light rays to the eye should go through all portions of the lens. In other words, the area where the light rays from the eye impinge on the light source plane through the lens array has to be all luminous. In case the distance l between the lens and the light source plane is the same as the focal distance f of the lens, the luminous area w has to be wider when the distance z between the observer and the lens becomes shorter. This is the problem caused by the defocusing of the lens. Here, the width w increases as the diameter d of the lens becomes larger. (d has to be large enough to maintain the number of observable viewpoints.) In case the distance x between the eye and the optical axis of the elemental lens is large, the light ray from the light source to the eye becomes strongly oblique, which leads to steep field curvature. Because of the field curvature, the light ray converges far from the light source and w widens as a result. When the angle of the light ray is moderate, the effects of defocusing and field curvature cancel each other out and the light converges most on the display plane.

Graphic Jump LocationF6 :

Defocusing and field curvature of the lens.

When w is excessively large, the luminous areas for the left eye and the right eye overlap with each other, which leads to the emergence of crosstalk. To avoid crosstalk, w should be shorter than the gap g between the centers of light sources for both eyes, which is given by Display Formula

g=elz,(1)
where e is the distance between the right eye and the left eye (Fig. 7). To be precise, crosstalk is avoided when the right side width of the backlight area for the right eye wRr plus the left side width of the backlight area for the left eye wLl is smaller than the gap g, as shown in Figure 8.

Graphic Jump LocationF7 :

Gap between the centers of light sources for the left eye and the right eye.

Graphic Jump LocationF8 :

Detailed condition to avoid crosstalk.

Graphic Jump LocationF9 :

The directions of vectors p,q,n.

The discussion in the previous section suggests that a couple of methods can be applicable to maintain a large viewing zone free from crosstalk. One possibility is to use a lens made of material whose refractive index N is large so that the field curvature may be shallower. Another possibility is to adjust the distance l between the lens and the light source plane. When l is short, the effect of field curvature can be reduced in the peripheral part of the display as the light source plane approaches the light condensing points. On the other hand, the defocusing effect becomes stronger in the central portion of the display. As long as the defocusing does not reach the level to cause crosstalk, however, a smaller l is expected to contribute to the expansion of the viewing angle.

To investigate the viewing zone free from crosstalk, numerical optical simulation is carried out in the case where e=65mm, f=25mm, d=22mm, and N=1.49. These parameters are based on the specifications of the prototype system shown in Fig. 3. Refracted light ray q=(qx,qy,qz) in the optical simulation is given by Display Formula

qx=(pxsnx)/N,(2)
Display Formula
qy=(pysny)/N,(3)
Display Formula
qz=(pzsnz)/N,(4)
Display Formula
s=t+t2+N21,(5)
Display Formula
t=pxnx+pyny+pznz,(6)
where p=(px,py,pz) is the incident light ray and n=(nx,ny,nz) is the normal vector of the lens surface. Here, note that p, q, and n should be unit vectors in the above calculation. The directions of vectors p,q,n are illustrated in Fig. 9. Since we use Fresnel lenses for elemental lenses and the large aperture lens, we can ignore the thickness of lenses. The Fresnel lens that we use has a focal point on the flat side of the lens. This type of Fresnel lens has the surface curvature whose normal vector is given by Display Formula
nx=x/x2+y2+f2,(7)
Display Formula
ny=y/x2+y2+f2,(8)
Display Formula
nz=1+N2(x2+y2)/(x2+y2+f2)(9)
at (x,y), where (0, 0) is the center of the lens and f is the focal distance of the lens.18 Validity of this optical simulation has been confirmed in the study of coarse integral volumetric imaging.19,20 An example of the optical simulation based on the above equations is shown in Fig. 10. Figures 11 and 12 show w calculated by the optical simulations when l=25mm and l=24mm, respectively.

Graphic Jump LocationF10 :

An example of output by the optical simulator.

Graphic Jump LocationF11 :

w under different x and z (l=25).

Graphic Jump LocationF12 :

w under different x and z (l=24).

As shown in Fig. 11, w becomes smaller as the distance z between the eye and the lens array plane becomes larger, while g also becomes smaller. When the distance x between the eye and the optical axis of the elemental lens is large, z has to be large to make w smaller than g. The distance x=100 gives the least w because the effect of defocusing and field curvature is balanced.

When l is smaller than the focal distance f, the curve of w is shifted upwards for small x and downwards for large x, as shown in Fig. 12. This is caused by the increase of the defocusing effect. Here, the curve is reversed after w reaches zero. With this shift, the width w becomes smaller than the gap g at small z even when x is large while it leads to larger w than g for a combination of small x and large z.

Figure 13 shows the results of optical simulation on the width of the viewing zone where the backlight areas for the right eye and the left eye do not overlap with each other on the whole display plane. Here, the width of the display plane is set to 286 mm (13 elemental lenses whose diameter is 22 mm), which is based on the specification of the prototype system shown in Fig. 3. The width of the viewing zone is defined as the length of the allowed head movement in the lateral direction to avoid crosstalk. As shown in the figure, the viewing angle is not wide when l=25. When l=24, the viewing angle is widened, whereas the viewing zone becomes shallower. (The point where the line is cut off indicates the limit of the range where crosstalk can be avoided in the central viewpoint.) Also it is confirmed that the use of a lens made up of material with a large refractive index widens the viewing angle.

Graphic Jump LocationF13 :

Viewing zone free from crosstalk.

We carried out a hardware experiment to confirm the validity of the above optical simulations. BenQ XL2420T, which was used for the dot matrix light source in the prototype system, was used in this experiment also. The backlight area was divided into two portions, as shown in Fig. 14 for simplicity. The backlight areas for the left eye and the right eye were illuminated with green and magenta, respectively, and the diffuser and the front LCD panel were removed to see the crosstalk clearly. In the experiment, z was fixed to 670 mm and the images observed by the left eye and the right eye were taken by FujiFilm Real3D W3, whose baseline is 75 mm. The lens parameters were as follows: f=25mm; d=22mm; N=1.49. With this configuration, the optical simulator predicts that the backlight for the left eye intrudes into the right eye when the distance between the center of the eyes and the elemental lens is larger than 170 mm for l=25 and 200 mm for l=24.

Graphic Jump LocationF14 :

Setup of the hardware experiment.

Figure 15 shows the result of the hardware experiment. When l=25, the magenta backlight intrudes into the elemental lenses whose centers are 167 mm or more away from the center of the camera (the midpoint of the two lenses). This value is close to the result of the optical simulation. When l=24, the magenta backlight intrudes into the elemental lenses whose centers are 200 mm or more away from the center of the camera. This value coincides with the result of the optical simulation. Thus, the credibility of the optical simulation and the validity of the proposed system to expand the viewing zone free from crosstalk are both confirmed.

Graphic Jump LocationF15 :

Results of the hardware experiment.

In this paper, the viewing zone of an autostereoscopic display using a directional backlight is composed of a convex lens array and a dot matrix light source is analyzed based on optical simulations. When the distance between the lens array and the light source plane is equal to the focal distance of the elemental lens, the viewing zone free from crosstalk becomes deeper in the central direction, whereas the viewing angle is not wide because of the field curvature of the lens. The viewing angle can be widened when the distance between the lens array and the backlight is shorter, whereas the viewing zone becomes shallower. This is due to the tradeoff between the effect of field curvature and defocusing of the lens, which should be balanced to meet with the requirement of practical stereoscopic vision. Use of a lens made up of material with a large refractive index can widen the viewing angle according to the effect of reducing field curvature.

This research is partially supported by the Grant-in-Aid for Scientific Research, MEXT, Japan, Grant number 25280070.

Perlin  K. et al., “An autostereoscopic display,” in  Proc. Int’l Conf. Computer Graphics and Interactive Techniques , pp. 319 –326 (2000).
Lee  H. J. et al., “A High Resolution Autostereoscopic Display Employing a Time Division Parallax Barrier,” in  SID 06 Digest , pp. 81 –84,  Society for Information Display  (2006).
Gaudreau  J. E., “Full-resolution autostereoscopic display with all-electronic tracking system,” Proc. SPIE. 8288, , 82881Z  (2012). 0277-786X CrossRef
Schultz  J. C. et al., “Full Resolution Autostereoscopic 3D Display for Mobile Applications,” in  SID 09 Digest , pp. 127 –130,  Society for Information Display  (2009)
Travis  A. et al., “Backlight for Viewsequential Autostereo 3D, in  SID 10 Digest , pp. 215 –217,  Society for Information Display  (2010).
Sykora  M. J., “Optical characterization of autostereoscopic 3D displays,” Proc. SPIE. 7863, , 78630V  (2011). 0277-786X CrossRef
Ting  C-H et al., “Multi-user 3D Film on Directional Sequential Backlight System, in  SID 11 Digest , pp. 460 –463,  Society for Information Display  (2011).
Kwon  H., Choi  H.-J., “A time-sequential multi-view autostereoscopic display without resolution loss using a multi-directional backlight unit and an LCD panel,” Proc. SPIE. 8288, , 82881Y  (2012). 0277-786X CrossRef
Huang  Y.-P. et al., “Development of time-multiplexed backlight on auto-stereoscopic LCD for multi-user and wide-viewing angle function,” in  Proc. IDW/AD , Vol. 12, pp. 1889 –1892,  Society for Information Display  (2012).
Hattori  T. et al., “Advanced autostereoscopic display for G-7 pilot project,” Proc. SPIE. 3639, , 66 –75 (1999). 0277-786X CrossRef
Hattori  T., “Stereoscopic picture display device,” JP Patent 11-289556, A (1999).
Hayashi  A. et al., “A 23-in. full-panel-resolution autostereoscopic LCD with a novel directional backlight system,” J. Soc. Inf. Disp.. 18, , 507 –512 (2010). 0734-1768 CrossRef
Hattori  T., “Stereoscopic picture display device,” JP Patent 08-160355, A (1996).
Hattori  T., “Stereoscopic picture display device,” JP Patent 08-160356, A (1996).
Hattori  T., “Stereoscopic video display device,” JP Patent 08-160556, A (1996).
Hattori  T., “Stereoscopic video display device,” JP Patent 08-163603, A (1996).
Ishizuka  S., Kakeya  H., “Flat Panel Autostereoscopic Display with Wide Viewing Zone Using Time-Division Multiplexing Backlight,” in  SID 13 Digest , pp. 1173 –1176,  Society for Information Display  (2013).
Kakeya  H., “Realization of undistorted volumetric multiview image with multilayered integral imaging,” Opt. Express. 19, (21 ), 20395 –20404 (2011). 1094-4087 CrossRef
Sawada  S., Kakeya  H., “Coarse integral volumetric imaging with flat screen and wide viewing angle,” J. Electron. Imaging. 21, (1 ), 011004  (2012). 1017-9909 CrossRef
Sawada  S., Kakeya  H., “Integral volumetric imaging using decentered elemental lenses,” Opt. Express. 20, (23 ), 25902 –25913 (2012). 1094-4087 CrossRef

Shuta Ishizuka received his bachelor’s degree in engineering in 2012 from the University of Tsukuba. He is currently a master’s candidate in the graduate school of systems information engineering at the University of Tsukuba.

Takuya Mukai received his bachelor’s degree in engineering in 2013 from the University of Tsukuba. He is currently a master’s candidate in the graduate school of systems information engineering at the University of Tsukuba.

Hideki Kayeka received his doctoral degree in engineering in 1998 from the University of Tokyo. He worked for the Communications Research Laboratory from 1998 to 2001. Since 2001, he has been a faculty member of the University of Tsukuba.

© The Authors. Published by SPIE under a Creative Commons Attribution 3.0 Unported License. Distribution or reproduction of this work in whole or in part requires full attribution of the original publication, including its DOI.

Citation

Shuta Ishizuka ; Takuya Mukai and Hideki Kakeya
"Viewing zone of an autostereoscopic display with a directional backlight using a convex lens array", J. Electron. Imaging. 23(1), 011002 (Jan 30, 2014). ; http://dx.doi.org/10.1117/1.JEI.23.1.011002


Figures

Graphic Jump LocationF1 :

Autostereoscopy with a directional backlight using a convex lens array.

Graphic Jump LocationF2 :

Image (Head and Lamp, Tsukuba) presented by the system shown in Fig. 1.

Graphic Jump LocationF3 :

Autostereoscopy with a directional backlight using a convex lens array and a vertical diffuser.

Graphic Jump LocationF4 :

Image (Head and Lamp, Tsukuba) presented by the system shown in Fig. 3.

Graphic Jump LocationF5 :

Images (Cones, Middlebury) observed from the left-eye position and the right-eye position.

Graphic Jump LocationF6 :

Defocusing and field curvature of the lens.

Graphic Jump LocationF7 :

Gap between the centers of light sources for the left eye and the right eye.

Graphic Jump LocationF8 :

Detailed condition to avoid crosstalk.

Graphic Jump LocationF9 :

The directions of vectors p,q,n.

Graphic Jump LocationF10 :

An example of output by the optical simulator.

Graphic Jump LocationF11 :

w under different x and z (l=25).

Graphic Jump LocationF12 :

w under different x and z (l=24).

Graphic Jump LocationF13 :

Viewing zone free from crosstalk.

Graphic Jump LocationF14 :

Setup of the hardware experiment.

Graphic Jump LocationF15 :

Results of the hardware experiment.

Tables

References

Perlin  K. et al., “An autostereoscopic display,” in  Proc. Int’l Conf. Computer Graphics and Interactive Techniques , pp. 319 –326 (2000).
Lee  H. J. et al., “A High Resolution Autostereoscopic Display Employing a Time Division Parallax Barrier,” in  SID 06 Digest , pp. 81 –84,  Society for Information Display  (2006).
Gaudreau  J. E., “Full-resolution autostereoscopic display with all-electronic tracking system,” Proc. SPIE. 8288, , 82881Z  (2012). 0277-786X CrossRef
Schultz  J. C. et al., “Full Resolution Autostereoscopic 3D Display for Mobile Applications,” in  SID 09 Digest , pp. 127 –130,  Society for Information Display  (2009)
Travis  A. et al., “Backlight for Viewsequential Autostereo 3D, in  SID 10 Digest , pp. 215 –217,  Society for Information Display  (2010).
Sykora  M. J., “Optical characterization of autostereoscopic 3D displays,” Proc. SPIE. 7863, , 78630V  (2011). 0277-786X CrossRef
Ting  C-H et al., “Multi-user 3D Film on Directional Sequential Backlight System, in  SID 11 Digest , pp. 460 –463,  Society for Information Display  (2011).
Kwon  H., Choi  H.-J., “A time-sequential multi-view autostereoscopic display without resolution loss using a multi-directional backlight unit and an LCD panel,” Proc. SPIE. 8288, , 82881Y  (2012). 0277-786X CrossRef
Huang  Y.-P. et al., “Development of time-multiplexed backlight on auto-stereoscopic LCD for multi-user and wide-viewing angle function,” in  Proc. IDW/AD , Vol. 12, pp. 1889 –1892,  Society for Information Display  (2012).
Hattori  T. et al., “Advanced autostereoscopic display for G-7 pilot project,” Proc. SPIE. 3639, , 66 –75 (1999). 0277-786X CrossRef
Hattori  T., “Stereoscopic picture display device,” JP Patent 11-289556, A (1999).
Hayashi  A. et al., “A 23-in. full-panel-resolution autostereoscopic LCD with a novel directional backlight system,” J. Soc. Inf. Disp.. 18, , 507 –512 (2010). 0734-1768 CrossRef
Hattori  T., “Stereoscopic picture display device,” JP Patent 08-160355, A (1996).
Hattori  T., “Stereoscopic picture display device,” JP Patent 08-160356, A (1996).
Hattori  T., “Stereoscopic video display device,” JP Patent 08-160556, A (1996).
Hattori  T., “Stereoscopic video display device,” JP Patent 08-163603, A (1996).
Ishizuka  S., Kakeya  H., “Flat Panel Autostereoscopic Display with Wide Viewing Zone Using Time-Division Multiplexing Backlight,” in  SID 13 Digest , pp. 1173 –1176,  Society for Information Display  (2013).
Kakeya  H., “Realization of undistorted volumetric multiview image with multilayered integral imaging,” Opt. Express. 19, (21 ), 20395 –20404 (2011). 1094-4087 CrossRef
Sawada  S., Kakeya  H., “Coarse integral volumetric imaging with flat screen and wide viewing angle,” J. Electron. Imaging. 21, (1 ), 011004  (2012). 1017-9909 CrossRef
Sawada  S., Kakeya  H., “Integral volumetric imaging using decentered elemental lenses,” Opt. Express. 20, (23 ), 25902 –25913 (2012). 1094-4087 CrossRef

Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging & repositioning the boxes below.

Related Book Chapters

Topic Collections

Advertisement
  • Don't have an account?
  • Subscribe to the SPIE Digital Library
  • Create a FREE account to sign up for Digital Library content alerts and gain access to institutional subscriptions remotely.
Access This Article
Sign in or Create a personal account to Buy this article ($20 for members, $25 for non-members).
Access This Proceeding
Sign in or Create a personal account to Buy this article ($15 for members, $18 for non-members).
Access This Chapter

Access to SPIE eBooks is limited to subscribing institutions and is not available as part of a personal subscription. Print or electronic versions of individual SPIE books may be purchased via SPIE.org.