System and method for providing three dimensional imaging in a network environment

• US 8,477,175 B2
• Filed: 03/09/2009
• Issued: 07/02/2013
• Est. Priority Date: 03/09/2009
• Status: Active Grant

• Current Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Original Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Inventors: Shaffer, Shmuel, Jouret, Guido
• Primary Examiner(s): Nguyen, Joseph J
• Application Number:
  US12/400,582
• Publication Number:
  US 20100225735A1
• Time in Patent Office: 1,576 Days
• Field of Search: 348 1401- 1616
• US Class Current: 348/14.08
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: H04N 13/117 the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
• CPC Class Codes: H04N 13/368 for two or more viewers
• CPC Class Codes: H04N 13/376 for tracking left-right translational head movements, i.e. lateral movements
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/152 Multipoint control units therefor
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A method is provided in one example embodiment and includes receiving data indicative of a personal position of an end user and receiving image data associated with an object. The image data can be captured by a first camera at a first angle and a second camera at a second angle. The method also includes synthesizing the image data in order to deliver a three-dimensional rendering of the object at a selected angle, which is based on the data indicative of the personal position of the end user. In more specific embodiments, the synthesizing is executed by a server configured to be coupled to a network. Video analytics can be used to determine the personal position of the end user. In other embodiments, the method includes determining an approximate time interval for the synthesizing of the image data and then delaying audio data based on the time interval.

Claims

1. A method, comprising:

receiving data indicative of a personal position of an end user;

receiving image data associated with an object located remotely from the end user, the image data being captured by a first camera at a first angle and a second camera at a second angle;

synthesizing the image data to create a plurality of three-dimensional renderings of the object, wherein each of the three-dimensional renderings is associated with one of a plurality of possible personal positions of the end user;

selecting one of the three-dimensional renderings for delivery to the end user, wherein the selecting is based on the data indicative of the personal position of the end user;

determining an approximate time interval for the synthesizing of the image data, wherein the approximate time interval is computed based on a number of pixels in the camera, a processing speed of image synthesization, and an amount of memory available for computation; and

providing an audio data delay in a video conference based on the time interval, wherein the audio data delay is used to provide lip synchronization for one or more participants involved in the video conference.

2. The method of claim 1, wherein the synthesizing is executed by a server configured to be coupled to a network.

3. The method of claim 1, wherein video analytics are used to determine the personal position of the end user.

4. The method of claim 1, wherein detection of the personal position of the end user is executed by a computer, which includes an embedded camera.

5. The method of claim 1, wherein the personal position is identified through one or more algorithms that detect facial positions, or eye positions.

6. The method of claim 1, wherein the synthesizing is executed by an image synthesizer element that is part of a server, which is configured to be coupled to a network.

7. The method of claim 1, wherein if multiple end users are detected at a computer screen, a default mechanism is triggered to provide a single view from one of the cameras.

8. The method of claim 1, wherein multiple synthesized images are calculated simultaneously from directions adjacent to the personal position of the user.

9. Logic encoded in one or more non-transitory tangible media for execution and when executed by a processor operable to:

receive data indicative of a personal position of an end user;

receive image data associated with an object located remotely from the end user, the image data being captured by a first camera at a first angle and a second camera at a second angle;

synthesize the image data to create a plurality of three-dimensional renderings of the object, wherein each of the three-dimensional renderings is associated with one of a plurality of possible personal positions of the end user;

select one of the three-dimensional renderings for delivery to the end user, wherein the selecting is based on the data indicative of the personal position of the end user;

determine an approximate time interval for the synthesizing of the image data, wherein the approximate time interval is computed based on a number of pixels in the camera, a processing speed of image synthesization, and an amount of memory available for computation; and

provide an audio data delay in a video conference based on the time interval, wherein the audio data delay is used to provide lip synchronization for one or more participants involved in the video conference.

10. The logic of claim 9, wherein video analytics are used to determine the personal position of the end user and the video analytics detect facial positions, or eye positions of the end user.

11. The logic of claim 9, wherein the synthesizing is executed by an image synthesizer element that is part of a server, which is configured to be coupled to a network.

12. An apparatus, comprising:

an image synthesizer coupled to a processor, wherein the apparatus is configured to;

receive data indicative of a personal position of an end user, wherein image data associated with an object located remotely from the end user is received, the image data being captured by a first camera at a first angle and a second camera at a second angle, wherein the image data is synthesized to create a plurality of three-dimensional renderings of the object, wherein each of the three-dimensional renderings is associated with one of a plurality of possible personal positions of the end use, wherein one of the plurality of three-dimensional renderings is selected for delivery to the end user, wherein the selecting is based on the data indicative of the personal position of the end user;

determine an approximate time interval for the synthesizing of the image data, wherein the approximate time interval is computed based on a number of pixels in the camera, a processing speed of image synthesization, and an amount of memory available for computation; and

provide an audio data delay in a video conference based on the time interval, wherein the audio data delay is used to provide lip synchronization for one or more participants involved in the video conference.

13. The apparatus of claim 12, wherein the image synthesizer is part of a server configured to be coupled to a network.

14. The apparatus of claim 12, wherein video analytics are used to determine the personal position of the end user.

15. The apparatus of claim 12, wherein if multiple end users are detected at a computer screen, a default mechanism is triggered to provide a single view from one of the cameras.

16. A system, comprising:

means for receiving data indicative of a personal position of an end user;

means for receiving image data associated with an object located remotely from the end user, the image data being captured by a first camera at a first angle and a second camera at a second angle;

means for synthesizing the image data to create a plurality of three-dimensional renderings of the object, wherein each of the three-dimensional renderings is associated with one of a plurality of possible personal positions of the end user;

means for selecting one of the three-dimensional renderings for delivery to the end user, wherein the selecting is based on the data indicative of the personal position of the end user;

means for determining an approximate time interval for the synthesizing of the image data, wherein the approximate time interval is computed based on a number of pixels in the camera, a processing speed of image synthesization, and an amount of memory available for computation; and

means for providing an audio data delay in a video conference based on the time interval, wherein the audio data delay is used to provide lip synchronization for one or more participants involved in the video conference.

17. The system of claim 16, wherein video analytics are used to determine the personal position of the end user.

18. The system of claim 16, wherein if multiple end users are detected at a computer screen, a default mechanism is triggered to provide a single view from one of the cameras.