Method to Control Perspective for a Camera-Controlled Computer

• US 20140168075A1
• Filed: 01/21/2014
• Published: 06/19/2014
• Est. Priority Date: 05/01/2009
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Markovic, Relja, Snook, Gregory N., Latta, Stephen, Geisner, Kevin, Lee, Johnny, Langridge, Adam Jethro
• Granted Patent: US 9,524,024 B2
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 3/20 Linear translation of whole images or parts thereof, e.g. panning
• CPC Class Codes: G06T 3/40 Scaling of whole images or parts thereof, e.g. expanding or contracting

Abstract

Systems, methods and computer readable media are disclosed for controlling perspective of a camera-controlled computer. A capture device captures user gestures and sends corresponding data to a recognizer engine. The recognizer engine analyzes the data with a plurality of filters, each filter corresponding to a gesture. Based on the output of those filters, a perspective control is determined, and a display device displays a new perspective corresponding to the perspective control.

Claims

1. A method for changing a perspective of a virtual scene displayed on a display device, comprising:

receiving data captured by a capture device, the capture device capturing movement or position of at least part of a user or an object controlled by the user;

analyzing the data to determine that the user or the object moved in a direction; and

in response to determining that the user or the object moved in the direction, modifying the perspective of the virtual scene displayed on the display device by moving the perspective of the virtual scene in the direction that the user or the object moved.

2. The method of claim 1, wherein analyzing the data to determine that the user or the object moved in the direction comprises determining that the user or the object moved to the user'"'"'s left;

and

wherein modifying the perspective of the virtual comprises moving the perspective of the virtual scene to the user'"'"'s left.

3. The method of claim 1, further comprising:

magnifying a text displayed on the display device in response to determining that the user has moved away from the display device.

4. The method of claim 3, further comprising:

maintaining a size of at least a portion of the virtual scene while magnifying the text.

5. The method of claim 3, further comprising:

maintaining a size of a second text while magnifying the text.

6. The method of claim 1, further comprising:

shrinking a text displayed on the display device in response to determining that the user has moved closer to the display device.

7. The method of claim 1, wherein the data captured by the capture device indicates a position of a second user, and further comprising:

determining the perspective of the virtual scene displayed on a display device based on a combination of a position of the user, and the position of the second user.

8. A system for changing a perspective of a virtual scene displayed on a display device, comprising:

a processor; and

a memory communicatively coupled to the processor when the system is operational, the memory bearing processor-executable instructions that, when executed on the processor, cause the system at least to;

receive data captured by a capture device, the capture device capturing movement or position of at least part of a user or an object controlled by the user;

analyze the data to determine that the user or the object moved in a direction; and

in response to determining that the user or the object moved in the direction, modify the perspective of the virtual scene displayed on the display device by moving the perspective of the virtual scene in the direction that the user or the object moved.

9. The system of claim 8, wherein the data captured by the capture device indicates a position of a second user, and the memory further bears processor-executable instructions that, when executed on the processor, cause the system at least to:

determine the perspective of the virtual scene displayed on a display device based on a combination of a position of the user, and the position of the second user.

10. The system of claim 9, wherein the instructions that, when executed on the processor, cause the system at least to determine the perspective of the virtual scene displayed on a display device based on the combination of the position of the user, and the position of the second user further cause the system at least to:

determine the perspective of the virtual scene displayed on the display device based on a midpoint between the position of the user and the position of the second user.

11. The system of claim 9, wherein the instructions that, when executed on the processor, cause the system at least to determine the perspective of the virtual scene displayed on a display device based on the combination of the position of the user, and the position of the second user further cause the system at least to:

display a perspective based on the position of the user overlaid with a perspective based on the position of the second user.

12. The system of claim 11, wherein the perspective based on the position of the user and the perspective based on the position of the second user are each tinted with a unique color.

13. The system of claim 11, wherein one of the perspective based on the position of the user and the perspective based on the position of the second user are each tinted comprises an infrared image and the other comprises a color image.

14. The system of claim 8, wherein the data captured by the capture device indicates a position of a second user, and the memory further bears processor-executable instructions that, when executed on the processor, cause the system at least to:

magnify a text displayed on the display device in response to determining that the user has moved away from the display device.

15. A computer-readable storage device for changing a perspective of a virtual scene displayed on a display device, bearing computer-executable instructions that, when executed on the computer, cause the computer to perform operations comprising:

receiving data captured by a capture device, the capture device capturing movement or position of at least part of a user or an object controlled by the user;

analyzing the data to determine that the user or the object moved in a direction; and

in response to determining that the user or the object moved in the direction, modifying the perspective of the virtual scene displayed on the display device by moving the perspective of the virtual scene in the direction that the user or the object moved.

16. The computer-readable storage device of claim 15, wherein analyzing the data to determine that the user or the object moved in the direction comprises determining that the user or the object moved to the user'"'"'s left;

and

wherein modifying the perspective of the virtual comprises moving the perspective of the virtual scene to the user'"'"'s left.

17. The computer-readable storage device of claim 15, further bearing computer-executable instructions that, when executed on the computer, cause the computer to perform operations comprising:

shrinking a text displayed on the display device in response to determining that the user has moved closer to the display device..

18. The computer-readable storage device of claim 17, further bearing computer-executable instructions that, when executed on the computer, cause the computer to perform operations comprising:

maintaining a size of at least a portion of the virtual scene while shrinking the text.

19. The computer-readable storage device of claim 17, further bearing computer-executable instructions that, when executed on the computer, cause the computer to perform operations comprising:

maintaining a size of a second text while shrinking the text.

20. The computer-readable storage device of claim 15, wherein the data captured by the capture device indicates a position of a second user, and further bearing computer-executable instructions that, when executed on the computer, cause the computer to perform operations comprising:

determining the perspective of the virtual scene displayed on a display device based on a combination of a position of the user, and the position of the second user.