Mechanism for facilitating enhanced viewing perspective of video images at computing devices

• US 9,060,093 B2
• Filed: 09/30/2011
• Issued: 06/16/2015
• Est. Priority Date: 09/30/2011
• Status: Expired due to Fees

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Chu, Michael M.
• Primary Examiner(s): Gauthier, Gerald
• Application Number:
  US13/976,965
• Publication Number:
  US 20130271553A1
• Time in Patent Office: 1,355 Days
• Field of Search: 345/419, 345/420, 345/440, 348/14.01, 348/77, 348/149, 348/220.1, 348/240.3, 348/43, 348/218.1, 348/376, 396/178, 396/380, 463/36, 701/23, 707/706, 382/154
• US Class Current: 1/1
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06T 15/205 Image-based rendering
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: G06V 40/167 using comparisons between temporally consecutive images
• CPC Class Codes: G09G 2320/0261 in the context of movement of objects on the screen or movement of the observer relative to the screen
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 7/141 between two video terminals, e.g. videophone telephonic communication systems combined with television receiver for reception of entertainment or information matter H04M11/085

Abstract

A mechanism is described for facilitating enhanced viewer perception of video images at computing devices according to one embodiment of the invention. A method of embodiments of the invention includes tracking, at a first computing device, movements associated with a first user within a camera range of one or more cameras coupled to the first computing device. Each movement of the first user may trigger an updated view of contents being displayed in real-time on the first computing device. The method may further include calculating a synthesized updated view of the contents in response to tracking a movement of the first user from a first position to a second position. The synthesized updated view may represent a realistic view of the contents in response to the movement of the first user from the first position to the second position. The method may further include displaying the synthesized updated view of the contents.

Claims

1. A computer-implemented method comprising:

tracking, at a first computing device, movements associated with a first user within a camera range of one or more cameras coupled to the first computing device, wherein the movements trigger and correspond to updated views of contents relating to the first user being displayed in real-time on the first computing device;

calculating synthesis data based on the updated views as triggered by the movements associated with the first user;

synthesizing the updated views into a synthesized view based on the calculated synthesis data, wherein the synthesized view represents a realistic view of the movements of the first user, wherein synthesizing further includes filling one or more occlusions exposed through the updated views and generating an illusion of a virtual portal; and

displaying the synthesized view of the first user, wherein displaying includes realistic rendering, in real-time and via the virtual portal, of the realistic view of the first user.

2. The computer-implemented method of claim 1, wherein the updated views include three-dimensional sampling of the movements, wherein the first user and a second user are in video communication via the first computing device and a second computing device, respectively.

3. The computer-implemented method of claim 1, wherein tracking movements comprises tracking one or more of the first user'"'"'s face, the first user'"'"'s eyes, the first user'"'"'s nose, and the first user'"'"'s forehead.

4. The computer-implemented method of claim 1, wherein the synthesis data comprises one or more measurements relating to changing angles or fields of views to the contents with respect to one or more positions of the first user.

5. The computer-implemented method of claim 1, further comprising requesting the second computing device to calculate the synthesis data, and receiving the synthesis data from the second computing device.

6. The computer-implemented method of claim 4, wherein the first and second computing devices comprise one or more of smartphones, personal digital assistants (PDAs), handheld computers, e-readers, tablet computers, and desktop computers.

7. A non-transitory machine-readable medium comprising instructions that, when executed by a machine, cause the machine to:

track, at the first computing device, movements associated with a first user within a camera range of one or more cameras coupled to the first computing device, wherein the movements trigger and correspond to updated views of contents relating to the first user being displayed in real-time on the first computing device;

calculate synthesis data based on the updated views as triggered by the movements associated with the first user;

synthesize the updated views into a synthesized view based on the calculated synthesis data, wherein the synthesized view represents a realistic view of the contents in response to the movements of the first user, wherein synthesizing further includes filling one or more occlusions exposed through the updated views and generating an illusion of a virtual portal; and

display the synthesized view of the first user, wherein displaying includes realistic rendering, in real-time and via the virtual portal, of the realistic view of the first user.

8. The non-transitory machine-readable medium of claim 7, wherein the updated views include three-dimensional sampling of the movements, wherein the first user and a second user are in video communication via the first device and a second computing device, respectively.

9. The non-transitory machine-readable medium of claim 7, wherein tracking movements comprises tracking one or more of the first user'"'"'s face, the first user'"'"'s eyes, the first user'"'"'s nose, and the first user'"'"'s forehead.

10. The non-transitory machine-readable medium of claim 7, wherein the synthesis data comprises one or more measurements relating to changing angles or fields of views to the contents with respect to one or more positions of the first user.

11. The non-transitory machine-readable medium of claim 7, wherein the machine is further to request the second computing device to calculate the synthesis data, and receiving the synthesis data from the second computing device.

12. An apparatus comprising:

a tracking module to track, at the first computing device, movements associated with a first user within a camera range of one or more cameras coupled to the first computing device, wherein the movements trigger and correspond to updated views of contents relating to the first user being displayed in real-time on the first computing device;

a calculator to calculate synthesis data based on the updated views as triggered by the movements associated with the first user;

a synthesizer to synthesize the updated views into a synthesized view based on the calculated synthesis data, wherein the synthesized view represents a realistic view of the contents in response to the movements of the first user, wherein synthesizing further includes filling one or more occlusions exposed through the updated views and generating an illusion of a virtual portal; and

a communication module to display the synthesized view of the first user, wherein displaying includes realistic rendering, in real-time and via the virtual portal, of the realistic view of the first user.

13. The apparatus of claim 12, wherein the updated views include three-dimensional sampling of the movements, wherein the first user and a second user are in video communication via the first device and a second computing device, respectively.

14. The apparatus of claim 12, wherein tracking movements comprises tracking one or more of the first user'"'"'s face, the first user'"'"'s eyes, the first user'"'"'s nose, and the first user'"'"'s forehead.

15. The apparatus of claim 12, wherein the synthesis data comprises one or more measurements relating to changing angles or fields of views to the contents with respect to one or more positions of the first user.

16. The apparatus of claim 12, wherein the machine is further to request the second computing device to calculate the synthesis data, and receiving the synthesis data from the second computing device.