Method to control perspective for a camera-controlled computer

• US 9,910,509 B2
• Filed: 11/15/2016
• Issued: 03/06/2018
• Est. Priority Date: 05/01/2009
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Markovic, Relja, Snook, Gregory N., Latta, Stephen, Geisner, Kevin, Lee, Johnny, Langridge, Adam Jethro
• Primary Examiner(s): Gilliard, Delomia L
• Application Number:
  US15/352,080
• Publication Number:
  US 20170123505A1
• Time in Patent Office: 476 Days
• Field of Search: None
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 3/20 Linear translation of whole images or parts thereof, e.g. panning
• CPC Class Codes: G06T 3/40 Scaling of whole images or parts thereof, e.g. expanding or contracting

Abstract

Systems, methods and computer readable media are disclosed for controlling perspective of a camera-controlled computer. A capture device captures user gestures and sends corresponding data to a recognizer engine. The recognizer engine analyzes the data with a plurality of filters, each filter corresponding to a gesture. Based on the output of those filters, a perspective control is determined, and a display device displays a new perspective corresponding to the perspective control.

Claims

1. A method for changing a perspective of a virtual scene displayed on a display device, comprising:

receiving data captured by a capture device, the capture device capturing movement or position of at least part of a first user relative to a display device and movement or position of at least part of an object controlled by the first user relative to the display device;

analyzing the data to determine that the at least part of the first user or the object moved in a direction relative to the display device and to determine a location formed based at least upon a combination of a position of the first user relative to the display device and a position of the object relative to the display device; and

based at least upon determining that the at least part of the first user or the object moved in the direction relative to the display device and determining the location formed based at least upon the combination of the position of the first user relative to the display device and the position of the object relative to the display device, modifying the perspective of the virtual scene displayed on the display device by moving the perspective of the virtual scene to the location formed based at least upon the combination of the position of the first user relative to the display device and the position of the object relative to the display device and in the direction that the at least part of the first user or the object moved.

2. The method of claim 1, wherein analyzing the data to determine that the at least part of the first user or the object moved in the direction relative to the display device comprises determining that the at least part of the first user or the object moved to the first user'"'"'s left;

and

wherein modifying the perspective of the virtual scene comprises moving the perspective of the virtual scene to the first user'"'"'s left.

3. The method of claim 1, further comprising:

magnifying a text displayed on the display device in response to determining that the at least part of the first user has moved away from the display device.

4. The method of claim 3, further comprising:

maintaining a size of at least a portion of the virtual scene while magnifying the text.

5. The method of claim 3, further comprising:

maintaining a size of a second text while magnifying the text.

6. The method of claim 1, further comprising:

shrinking a text displayed on the display device in response to determining that the at least part of the first user has moved closer to the display device.

7. The method of claim 1, wherein determining the location formed based at least upon a combination of the position of the first user relative to the display device and the position of the object relative to the display device comprises determining a mid-point between the position of the first user relative to the display device and the position of the second user relative to the display device.

8. A system for changing a perspective of a virtual scene displayed on a display device, comprising:

a processor; and

a memory communicatively coupled to the processor when the system is operational, the memory bearing processor-executable instructions that, based at least on the processor, cause the system at least to;

receive data captured by a capture device, the capture device capturing movement or position of at least part of a first user relative to a display device and movement or position of at least part of an object controlled by the first user relative to the display device;

analyze the data to determine that the at least part of the first user or the object moved in a direction relative to the display device and to determine a location formed based at least upon a combination of a position of the first user relative to the display device and a position of the object relative to the display device; and

based at least upon determining that the at least part of the first user or the object moved in the direction relative to the display device and determining the location formed based at least upon the combination of the position of the first user relative to the display device and the position of the object relative to the display device, modify the perspective of the virtual scene displayed on the display device by moving the perspective of the virtual scene to the location formed based at least upon the combination of the position of the first user relative to the display device and the position of the object relative to the display device and in the direction that the at least part of the user or the object moved.

9. The system of claim 8, wherein determining the location formed based at least upon the combination of the position of the first user relative to the display device and the position of the object relative to the display device comprises determining an average location based at least upon the position of the first user relative to the display device and the position of the object relative to the display device.

10. The system of claim 8, wherein determining the location formed based at least upon the combination of the position of the first user relative to the display device and the position of the object relative to the display device comprises determining a mid-point between the position of the first user relative to the display device and the position of the object relative to the display device.

11. The system of claim 9, wherein the instructions that, when executed on the processor, cause the system at least to determine a location formed based at least upon a combination of a position of the first user relative to the display device and a position of the object relative to the display device further cause the system at least to:

display a perspective based on the position of the at least part of the first user overlaid with a perspective based on the position of the object.

12. The system of claim 11, wherein the perspective based on the position of the at least part of the first user and the perspective based on the position of the object are each tinted with a unique color.

13. The system of claim 11, wherein one of the perspective based on the position of the at least part of the first user and the perspective based on the position of the object are each tinted comprises an infrared image and the other comprises a color image.

14. The system of claim 8, wherein the data captured by the capture device indicates a position of a second user, and the memory further bears processor-executable instructions that, when executed on the processor, cause the system at least to:

magnify a text displayed on the display device in response to determining that the at least part of the first user has moved away from the display device.

15. A computer-readable storage device that is not a propagating signal, the computer-readable storage device bearing computer-executable instructions that, when executed on the computer, cause the computer to perform operations comprising:

receiving data captured by a capture device, the capture device capturing movement or position of at least part of a first user or an object controlled by the first user relative to a display device and movement or position of at least part of an object controlled by the first user relative to the display device;

analyzing the data to determine that the at least part of the user or the object moved in a direction relative to the display device and to determine a location formed based at least upon a combination of a position of the first user relative to the display device and a position of the object relative to the display device; and

based at least upon determining that the at least part of the user or the object moved in the direction relative to the display device and determining the location formed based at least upon the combination of the position of the first user relative to the display device and the position of the object relative to the display device, modifying the perspective of a virtual scene displayed on a display device by moving the perspective of the virtual scene to the location formed based at least upon the combination of the position of the first user relative to the display device and the position of the object relative to the display device and in the direction that the at least part of the user or the object moved.

16. The computer-readable storage device of claim 15,

wherein analyzing the data to determine that the at least part of the first user or the object moved in the direction relative to the display device comprises determining that the at least part of the first user or the object moved to the first user'"'"'s left;

and

wherein modifying the perspective of the virtual comprises moving the perspective of the virtual scene to the first user'"'"'s left.

17. The computer-readable storage device of claim 15, further bearing computer-executable instructions that, when executed on the computer, cause the computer to perform operations comprising:

shrinking a text displayed on the display device in response to determining that the at least part of the first user has moved closer to the display device.

18. The computer-readable storage device of claim 17, further bearing computer-executable instructions that, when executed on the computer, cause the computer to perform operations comprising:

maintaining a size of at least a portion of the virtual scene while shrinking the text.

19. The computer-readable storage device of claim 17, further bearing computer-executable instructions that, when executed on the computer, cause the computer to perform operations comprising:

maintaining a size of a second text while shrinking the text.

20. The computer-readable storage device of claim 15, wherein determining the location formed based at least upon a combination of the position of the first user relative to the display device and the position of the object relative to the display device comprises determining a mid-point between the position of the first user relative to the display device and the position of the object relative to the display device.