Volumetric tracking for orthogonal displays in an electronic collaboration setting

• US 10,514,769 B2
• Filed: 10/16/2016
• Issued: 12/24/2019
• Est. Priority Date: 10/16/2016
• Status: Active Grant

• Current Assignee: Dell Products LP (Dell Technologies Inc.)
• Original Assignee: Dell Products LP (Dell Technologies Inc.)
• Inventors: Aurongzeb, Deeder M., Knoppert, Michiel Sebastiaan Emanuel Petrus
• Primary Examiner(s): Shiau, Shen
• Application Number:
  US15/294,734
• Publication Number:
  US 20180107341A1
• Time in Patent Office: 1,164 Days
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Abstract

Systems and methods for providing volumetric tracing for orthogonal displays in an electronic collaboration setting. In some embodiments, an Information Handling System (IHS) may include a processor and a memory coupled to the processor, the memory including program instructions stored thereon that, upon execution by the processor, cause the IHS to: identify a first characteristic associated with a given one of a plurality of participants of an electronic collaboration session, at least in part, using an image sensing device; identify a second characteristic associated with the given participant, at least in part, using a proximity sensing device; identify a volumetric space for the given participant based upon a combination of the first and second characteristics; and provide a user interface to the given participant. The user interface may have a set or one or more features selected, at least in part, based upon a characteristic of the volumetric space.

Claims

1. An Information Handling System (IHS), comprising:

one or more processors; and

a memory coupled to the one or more processors, the memory including program instructions stored thereon that, upon execution by the one or more processors, cause the IHS to;

identify a first characteristic associated with a given one of a plurality of participants of an electronic collaboration session, at least in part, using an image sensing device;

identify a second characteristic associated with the given participant, at least in part, using a proximity sensing device;

identify a volumetric space for the given participant based upon a combination of the first and second characteristics, wherein the volumetric space comprises a three-dimensional area around the given participant from within which gesture or voice commands issued by the given participant are recognizable by the IHS, and outside of which gesture or voice commands issued by the given participant are not recognizable by the IHS;

provide a user interface to the given participant, wherein the user interface has a set of one or more features selected, at least in part, based upon a characteristic of the volumetric space;

identify another volumetric space for another participant and

in response to the other participant being disposed behind the participant with respect to the image capture device, provide another user interface to the other participant, wherein the other user interface has a second set of features accessible to the other participant to the exclusion of the given participant.

2. The IHS of claim 1, wherein the first characteristic comprises at least one of:

a position of the given participant in three-dimensional space, an identity of the given participant, a size or reach of the given participant, a role of the given participant in the electronic collaboration session, a gesture made by the given participant, or an intent of the given participant, wherein the second characteristic comprises a position of the given participant relative to another participant, and wherein the user interface comprises at least one of;

a Graphical User Interface (GUI), a speech recognition interface, or a gesture recognition interface.

3. The IHS of claim 1, wherein the characteristic of the volumetric space comprises at least one of:

a size, a position, or a shape of the volumetric space.

4. The IHS of claim 1, wherein to identify the volumetric space, the program instructions, upon execution, further cause the IHS to:

determine that the other participant moved closer to the volumetric space; and

reduce the volumetric space to disable one or more gestures available to the participant prior the other participant having moved.

5. The IHS of claim 1, wherein to identify the volumetric space, the program instructions, upon execution, further cause the IHS to:

determine that the other participant moved farther from the volumetric space; and

increase the volumetric space to enable one or more gestures unavailable to the participant prior the other participant having moved.

6. The IHS of claim 1, wherein the program instructions, upon execution, further cause the IHS to:

receive two or more commands; and

determine that a given command was issued by the given participant based upon it having been detected as originated from the volumetric space and that another command was issued by the other participant based upon it having been detected as originated from the other volumetric space, at least in part, using the proximity sensing device.

7. The IHS of claim 1, wherein the first set or one or more features accessible to the given participant to the exclusion of the other participant comprises a GUI, and wherein the second set of features accessible to the other participant to the exclusion of the given participant comprises a voice or gesture recognition interface.

8. The IHS of claim 1, wherein the first set or one or more features accessible to the given participant to the exclusion of the other participant comprises a gesture recognition interface, and wherein the second set of features accessible to the other participant to the exclusion of the given participant comprises a voice recognition interface.

9. The IHS of claim 1, wherein the first set or one or more features accessible to the given participant to the exclusion of the other participant comprises a touch interface, and wherein the second set of features accessible to the other participant to the exclusion of the given participant comprises a gesture recognition interface.

10. The IHS of claim 1, wherein the program instructions, upon execution, further cause the IHS to:

identify a different volumetric space for the given participant based upon a change in at least one of the first or second characteristics during the electronic collaboration session; and

provide another user interface having another set of one or more features selected, at least in part, based upon a characteristic of the different volumetric space.

11. The IHS of claim 10, wherein in response to the characteristic of the different volumetric space indicating that the given participant'"'"'s role in the electronic collaboration session has increased, the set of features is larger than the other set of features, and wherein in response to the characteristic of the different volumetric space indicating that the given participant'"'"'s role in the electronic collaboration session has decreased, the set of features is smaller than the other set of features.

12. The IHS of claim 10, wherein in response to the characteristic of the different volumetric space indicating that the given participant has moved closer to a display, the set of features is larger than the other set of features, and wherein in response to the characteristic of the different volumetric space indicating that the given participant has moved farther from the display, the set of features is smaller than the other set of features.

13. The IHS of claim 1, wherein the electronic collaboration session uses a first screen part of a horizontal display device and a second screen part of a vertical display device.

14. The IHS of claim 13, wherein the user interface is dynamically distributed between the first and second displays based upon the characteristic of the volumetric space.

15. The IHS of claim 1, wherein the image sensing device comprises a three-dimensional (3D) camera, and wherein the proximity sensing device comprises a millimeter Radio Frequency (RF) wave antenna array.

16. A hardware memory device having program instructions stored thereon that, upon execution by an Information Handling System (IHS), cause the IHS to:

identify a first characteristic associated with a given one of a plurality of participants of an electronic collaboration session, at least in part, using an image sensing device;

identify a second characteristic associated with the given participant, at least in part, using a proximity sensing device;

identify a volumetric space for the given participant based upon a combination of the first and second characteristics, wherein the volumetric space comprises a three-dimensional area around the given participant from within which gesture or voice commands issued by the given participant are recognizable by the IHS, and outside of which gesture or voice commands issued by the given participant are not recognizable by the IHS;

provide a user interface to the given participant, wherein the user interface has a set of one or more features selected, at least in part, based upon a characteristic of the volumetric space;

identify another volumetric space for another participant; and

in response to the other participant being disposed behind the participant with respect to the image capture device, provide another user interface to the other participant, wherein the other user interface has a second set of features accessible to the other participant to the exclusion of the given participant.

17. A method, comprising:

identifying a first characteristic associated with a given one of a plurality of participants of an electronic collaboration session, at least in part, using an image sensing device;

identifying a second characteristic associated with the given participant, at least in part, using a proximity sensing device;

identifying a volumetric space for the given participant based upon a combination of the first and second characteristics, wherein the volumetric space comprises a three-dimensional area around the given participant from within which gesture or voice commands issued by the given participant are recognizable by the IHS, and outside of which gesture or voice commands issued by the given participant are not recognizable by the IHS;

providing a user interface to the given participant, wherein the user interface has a set of one or more features selected, at least in part, based upon a characteristic of the volumetric space;

identifying another volumetric space for another participant; and

in response to the other participant being disposed behind the participant with respect to the image capture device, providing another user interface to the other participant, wherein the other user interface has a second set of features accessible to the other participant to the exclusion of the given participant.