Rendering system and method for images having differing foveal area and peripheral view area resolutions

• US 20040003409A1
• Filed: 06/27/2002
• Published: 01/01/2004
• Est. Priority Date: 06/27/2002
• Status: Active Grant

• Current Assignee: Tobii Technology AB
• Original Assignee: International Business Machines Corporation
• Inventors: Berstis, Viktors
• Granted Patent: US 7,129,981 B2
• Time in Patent Office: Days
• US Class Current: 725/105
• CPC Class Codes: H04N 21/2187 Live feed
• CPC Class Codes: H04N 21/2393 involving handling client requests scheduling or organising the servicing of application requests H04L67/60
• CPC Class Codes: H04N 21/4143 embedded in a Personal Computer [PC]
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/6587 Control parameters, e.g. trick play commands, viewpoint selection
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 5/265 Mixing
• CPC Class Codes: H04N 7/173 with two-way working, e.g. subscriber sending a programme selection signal
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A client-server arrangement for camera viewing using digital cameras across a computer network. A camera server controls a motorized gimbal which determines the viewing angles of a set of cameras according to signals from a client computer which is equipped with an eye movement tracking system. Movements of the viewer'"'"'s eyes result in changes in viewing angle of the remote cameras. A high resolution foveal field of view image centered on the user'"'"'s point of interest is captured and overlaid on a lower resolution full filed of view image, rendering a combined image having a low resolution peripheral area and a high resolution foveal area, and being significantly reduced in size compared to a full resolution, full field of view image. This combined image is transmitted to the client for display to the user.

Claims

1. A method for generating an image for user viewing comprising the steps of:

determining a point of interest of a user within a full field of view;

capturing a full resolution foveal field of view image within said full field of view, said foveal field of view being centered upon said point of interest;

capturing a full field of view image with a reduced resolution;

overlaying said foveal field of view image onto said full field of view image such that a combined image having a full resolution foveal area and a reduced resolution peripheral area is rendered;

providing said combined image for display to a user.

2. The method as set forth in claim 1 wherein said step of capturing a full resolution foveal field of view image comprises using a first camera having a telephoto lens, and wherein said step of capturing a full field of view image with a reduced resolution comprises using a second camera having a wide angle lens.

3. The method as set forth in claim 1 wherein said step of capturing a full resolution foveal field of view image comprises setting a camera lens to a telephoto setting, and wherein said step of capturing a full field of view image with a reduced resolution comprises setting a camera lens to a wide angle setting.

4. The method as set forth in claim 1 wherein said step of providing said combined image for display to a user comprises transmitting a digital image over a computer network.

5. A computer readable medium encoded with software for generating an image for user viewing, said software performing the steps of:

determining a point of interest of a user within a full field of view;

capturing a full resolution foveal field of view image within said full field of view;

capturing a full field of view image with a reduced resolution;

overlaying said foveal field of view image onto said full field of view image such that a combined image having a full resolution foveal area and a reduced resolution peripheral area is rendered;

providing said combined image for display to a user.

6. The computer readable medium as set forth in claim 5 wherein said software for capturing a full resolution foveal field of view image comprises software for receiving an image from a first camera having a telephoto lens, and wherein said software for capturing a full field of view image with a reduced resolution comprises software for receiving an image from a second camera having a wide angle lens.

7. The computer readable medium as set forth in claim 5 wherein said software for capturing a full resolution foveal field of view image comprises software for setting a camera lens to a telephoto setting, and wherein said software for capturing a full field of view image with a reduced resolution comprises software for setting a camera lens to a wide angle setting.

8. The computer readable medium as set forth in claim 5 wherein said software for providing said combined image for display to a user comprises software for transmitting a digital image over a computer network.

9. A system for rendering an image comprising:

a user point of interest tracking system which determines a user point of interest;

a full resolution image capturing means for capturing a foveal field of view image centered upon said user point of interest;

a reduced resolution image capturing means for capturing a full field of view image centered upon said user point of interest, said full field of view image being relatively broad compared to said foveal field of view image;

a combined image renderer adapted to overlay said full resolution foveal field of view image onto said reduced resolution full field of view image thereby creating a combined image having full resolution in a foveal area and reduced resolution in a peripheral area; and

a means for displaying said combined image to a user.

10. The system as set forth in claim 10 wherein said comprises an eye movement tracking system.

11. The system as set forth in claim 10 wherein said full resolution image capturing means comprises a first camera equipped with a telephoto lens, and wherein said reduced resolution image capturing means comprises a second camera equipped with a wide angle lens.

12. The system as set forth in claim 10 wherein said full resolution image capturing means and said reduced resolution image capturing means comprise a camera equipped with an adjustable lens having a telephoto and a wide angle setting.

13. The system as set forth in claim 10 wherein said means for displaying said combined image to a user comprises a web browser system.