Camera navigation for presentations

• US 9,244,533 B2
• Filed: 12/17/2009
• Issued: 01/26/2016
• Est. Priority Date: 12/17/2009
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Friend, Joseph F., Pratley, Christopher Hugh, Kuppusamy, Ashok, Bathiche, Steven, Dietz, Robert Scott
• Primary Examiner(s): Chow, Doon
• Assistant Examiner(s): CHOI, DAVID E
• Application Number:
  US12/640,731
• Publication Number:
  US 20110154266A1
• Time in Patent Office: 2,231 Days
• Field of Search: 715/863, 715/860, 715/848, 715/835, 715/830, 715/788, 715/762, 715/738, 715/234, 715/202, 382/103, 345/650, 345/473, 345/440, 345/173, 345/158, 345/156
• US Class Current: 1/1
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 13/812 Ball games, e.g. soccer or baseball
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands
• CPC Class Codes: A63F 2300/8011 Ball
• CPC Class Codes: G06F 2203/011 Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G09B 19/00 Teaching not covered by other main groups of this subclass teaching or practice apparatus for gun-aiming or gun-laying F41G3/26
• CPC Class Codes: G09B 21/00 Teaching, or communicating with, the blind, deaf or mute audible presentation of material to be studied G09B5/04; devices or methods for replacing direct visual or auditory perception by another kind of perception A61F9/08, A61F11/04; audible indication of meter readings or of colour G01D7/12; watches for blind persons G04B25/02; speech analysis, speech recognition G10L; sound-recording or reproducing, per se G11B
• CPC Class Codes: G09B 21/009 Teaching or communicating with deaf persons G09B21/04 takes precedence; deaf and dumb persons G09B21/00
• CPC Class Codes: G09B 5/02 with visual presentation of the material to be studied, e.g. using film strip
• CPC Class Codes: G09B 5/06 with both visual and audible presentation of the material to be studied
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality
• CPC Class Codes: H04L 67/30 Profiles
• CPC Class Codes: H04L 67/75 Indicating network or usage conditions on the user display

Abstract

Techniques for managing a presentation of information in a gesture-based system, where gestures are derived from a user'"'"'s body position or motion in the physical space, may enable a user to use gestures to control the manner in which the information is presented or to otherwise interact with the gesture-based system. A user may present information to an audience to an audience using gestures that control aspects of the system, or multiple users may work together using gestures to control aspects of the system. Thus, in an example embodiment, a single user can control the presentation of information to the audience via gestures. In another example embodiment, multiple participants can share control of the presentation via gestures captured by a capture device or otherwise interact with the system to control aspects of the presentation.

Claims

1. A method for rendering a visual representation in a shared presentation experience, the method comprising:

rendering a presentation of information;

capturing data of a physical space, the captured data being representative of a plurality of users in the physical space;

analyzing the plurality of users in the physical space represented in the captured data to recognize a specific identity of a first user of the plurality of users based at least in part on a body or facial feature of the first user, each user of the plurality of users in the physical space being unique;

accessing, based on the recognized, specific identity of the first user, a stored user profile for the first user that indicates whether the first user has access to present the presentation of information, access to the stored user profile being restricted based on the recognized, specific identity of the first user;

determining that the first user has access to present the presentation of information based on the stored user profile;

determining that the first user is able to control the rendered presentation of information based on determining that the first user has access to present the presentation; and

rendering at least one visual representation that corresponds to each of the plurality of users, the at least one visual representation being adapted to interact with the rendered presentation of information.

2. The method of claim 1, wherein the at least one visual representation is adapted to interact with the rendered presentation of information via an animation that interacts with a portion of the presentation.

3. The method of claim 2, wherein the animation of the at least one visual representation corresponds to a gesture of at least one of the plurality of users.

4. The method of claim 2, further comprising applying the animation from an avatar library to the at least one visual representation.

5. The method of claim 1, wherein each of the plurality of users corresponds to a distinct visual representation.

6. The method of claim 1, wherein each of the plurality of users corresponds to a same visual representation.

7. The method of claim 1, wherein the at least one visual representation corresponds to a feature of a user detected by a capture device.

8. The method of claim 1, wherein a control of the presentation to at least one of the plurality of users may be indicated by a feature of the visual representation that corresponds to the at least one of the plurality of users.

9. The method of claim 1, further comprising:

capturing additional data of the physical space;

determining an identity of a second user of the plurality of users based on the additional captured data;

determining that the second user has performed a motion or pose indicative of a request to receive the presentation of information based on the additional captured data;

determining an email address of the second user based on the second user'"'"'s identity; and

emailing the second user the presentation of information based on the second user'"'"'s motion or pose.

10. The method of claim 1, further comprising:

capturing additional data of the physical space;

processing the additional data to determine a motion or pose of the second user;

processing the motion or pose of the second user to determine that it is indicative of a mental state of being inattentive or un-alert; and

notifying the first user of the second user'"'"'s inattentiveness or un-alertness.

11. The method of claim 1, further comprising:

capturing additional data of the physical space;

determining that a second user of the plurality of users is inattentive or un-alert when a current portion of the presentation of information contains a large amount of text; and

notifying the user that an upcoming portion of the presentation of information contains a large amount of text.

12. The method of claim 1, further comprising:

determining that a second user of the plurality of users lacks rights to interact with the rendered presentation of information; and

wherein rendering at least one visual representation that corresponds to each of the plurality of users comprises;

rendering the second user with an indication that the second user lacks rights to interact with the rendered presentation of information.

13. The method of claim 1, further comprising:

determining a level of access for a second user of the plurality of users to interact with the rendered presentation of information based on a location of the second user in the captured data of the physical space.

14. The method of claim 1, further comprising:

capturing additional data of the physical space;

determining that the first user has made an introduction with a second user of the plurality of users based on the additional data of the physical space;

determining a contact information of the first user based on the first user'"'"'s identity; and

transmitting the first user'"'"'s contact information to the second user based on the introduction between the first and second users.

15. The method of claim 1, further comprising:

capturing additional data of the physical space;

determining from the additional data that a second user of the plurality of users has not gestured for a period of time; and

wherein rendering at least one visual representation that corresponds to each of the plurality of users comprises;

rendering the second user with an indication that the second user is idle.

16. The method of claim 1, further comprising:

capturing additional data of the physical space;

determining from the additional data that a second user of the plurality of users has requested control to interact with the rendered presentation of information; and

granting the second user control to interact with the rendered presentation of information in response to the request.

17. A system, comprising:

a processor; and

a memory bearing processor-executable instructions that, when executed on the processor, cause the system at least to;

render a presentation of information;

capture data of a physical space, the captured data being representative of a plurality of users in the physical space;

analyze the plurality of users in the physical space represented in the captured data to recognize a specific identity of a first user of the plurality of users based at least in part on a body or facial feature of the first user, each user of the plurality of users in the physical space being unique;

access, based on the recognized, specific identity of the first user, a stored user profile for the first user that indicates whether the first user has access to present the presentation of information, access to the stored user profile being restricted based on the recognized, specific identity of the first user;

determine that the first user has access to present the presentation of information based on the stored user profile;

determine that the first user is able to control the rendered presentation of information based on determining that the first user has access to present the presentation; and

render at least one visual representation that corresponds to each of the plurality of users, wherein the at least one visual representation is adapted to interact with the rendered presentation of information.

18. The system of claim 17, said memory further bearing computer-readable instructions that, when executed on the processor, cause the processor to perform operations comprising:

capturing additional data of the physical space;

processing the additional data to determine a motion or pose of the second user;

processing the motion or pose of the second user to determine that it is indicative of a mental state of being inattentive or un-alert; and

notifying the first user of the second user'"'"'s inattentiveness or un-alertness.

19. The system of claim 17, said memory further bearing computer-readable instructions that, when executed on the processor, cause the processor to perform operations comprising:

capturing additional data of the physical space;

determining that a second user of the plurality of users is inattentive or un-alert when a current portion of the presentation of information contains a large amount of text; and

notifying the user that an upcoming portion of the presentation of information contains a large amount of text.

20. The system of claim 17, said memory further bearing computer-readable instructions that, when executed on the processor, cause the processor to perform operations comprising:

capturing additional data of the physical space;

determining an identity of a second user of the plurality of users based on the additional captured data;

determining that the second user has performed a motion or pose indicative of a request to receive the presentation of information based on the additional captured data;

determining an email address of the second user based on the second user'"'"'s identity; and

emailing the second user the presentation of information based on the second user'"'"'s motion or pose.