GESTURE PROCESSING FRAMEWORK

• US 20130106686A1
• Filed: 06/30/2012
• Published: 05/02/2013
• Est. Priority Date: 10/31/2011
• Status: Abandoned Application

• Current Assignee: Avago Technologies General IP PTE Limited (Broadcom, Inc.)
• Original Assignee: Broadcom Corporation (Broadcom, Inc.)
• Inventors: Bennett, James D.
• Application Number:
  US13/539,320
• Publication Number:
  US 20130106686A1
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

A gesture processing framework enables interaction between various devices, infrastructures, services, applications, and the like by mapping gesture input signals to control signals. Gesture input signals from various gesture input interfaces can be mapped to control various parts of a media environment by association with various control signals. The gesture processing framework can support a device interacting with one or more various media environments to map various gesture input signals, gesture maps, and the like with various control signals associated with the various media environments. Gesture inputs can be processed to identify one or more gesture input signals, and control signals associated with the gesture input signals can be sent in response to the identification. Identification of gesture input signals can include determining correlation within various levels of confidence. Interactions involving various entities can be managed to ensure proper processing of various input signals.

Claims

1. An image-based gesture processing system supporting a first user device of a first user and a media device, the media device being controllable via a media control standard, the system comprising:

a storage element operable to store personalized gesture data of the first user, the personalized gesture data of the first user including a plurality of gesture inputs and a plurality of commands, each of the plurality of gesture inputs is associated with at least one of the plurality of commands;

a sensing element operable to capture image data associated with a visual gesture motion of the first user as gesture information;

an analysis element operable to process the gesture information to identify at least one visual gesture;

a recognition element operable to process the at least one visual gesture, using the personalized gesture data of the first user, to recognize a first gesture input of the plurality of gesture inputs;

a command element operable to process the first gesture input to identify a first command of the plurality of commands, the first command is associated with the first gesture input; and

an output element operable to send the first command to the media device via the media control standard.

2. The image-based gesture processing system of claim 1, comprising:

the storage element operable to store personalized gesture data of a second user, the personalized gesture data of the second user including a second plurality of gesture inputs and a second plurality of commands, the personalized gesture data of the second user is separate from the personalized gesture data of the first user;

the analysis element operable to process the gesture information to identify at least one visual gesture, the at least one visual gesture is associated with the second user;

the recognition element operable to respond to an identification of an association of the at least one visual gesture with the second user by processing the at least one visual gesture, using the personalized gesture data of the second user, to recognize a first gesture input of the second plurality of gesture inputs; and

the command element operable to process the first gesture input of the second plurality of gesture inputs to identify a first command of the second plurality of commands, the first command of the second plurality of commands is associated with the first gesture input of the second plurality of gesture inputs.

3. The image-based gesture processing system of claim 1 comprising a mapping element operable to support creation of personalized gesture data of the first user by:

establishing a personalized sequence of visual gestures as at least one gesture input; and

associating the at least one gesture input with a personalized sequence of at least one command.

4. A device that supports interactions with a first user and a plurality of communications devices, the plurality of communications devices including a local device and a foreign device, the device comprising:

an interface that communicatively couples with at least the plurality of communication devices;

a memory that stores a first personalized gesture data including an association of a first gesture input with a local command associated with a local function of the local device; and

processing circuitry interoperable with the interface and the memory to;

access a foreign command associated with a foreign function of the foreign device, and

respond to a determination that the foreign function correlates with the local function by establishing a second personalized gesture data including an association between at least the first gesture input and the foreign command.

5. The device of claim 4, the processing circuitry interoperable with the interface and the memory to respond to identification of image data captured by at least one sensing element as at least the first gesture input by sending a command associated with both the first gesture input and a detected device.

6. The device of claim 4, the processing circuitry interoperable with the interface and the memory to provide at least the second personalized gesture data to a support device to process image data captured by at least one sensing element to identify the first gesture input.

7. The device of claim 6, the device comprising a sensing element that captures visual gesture motions as image data, the processing circuitry interoperable with the sensing element, interface and the memory to send the image data to the support device to process the identify the image data as the first gesture input.

8. The device of claim 5, wherein:

the support device is a remote processing system to which the device is communicatively coupled;

the processing circuitry interoperable with the interface and the memory to;

provide image data captured by at least one sensing element to the remote processing system to be identified as the first gesture input, and

in response to the providing, access the first gesture input from the remote processing system.

9. The device of claim 5, the processing circuitry interoperable with the interface and the memory to interact with the sensing element to characterize a property of the image data.

10. The device of claim 5, identifying at least the first gesture input includes determining that the image data correlates with a stored instance of the first gesture input.

11. The device of claim 10, wherein:

identifying at least the first gesture input further includes determining that the image data correlates with the stored instance of the first gesture input to within a certain level of confidence; and

the processing circuitry interoperable with the interface to respond to determining that the image data fails to correlate with the stored instance of the first gesture input to within a certain level of confidence by requesting input to identify the first gesture input.

12. The device of claim 4, the local command is different than the foreign command.

13. A visual gesture processing system supporting interactions involving a local media environment and a foreign device, the local media environment including a plurality of controllable media devices, the system comprising:

a first system operable to support accessing personalized gesture data from the foreign device, the personalized gesture data including a first personalized association of an input set of at least one gesture input with a first command set of at least one foreign command, the input set corresponds to the first command set; and

the first system operable to support responding to a determination that the foreign command correlates to at least one distinct local command associated with at least one media device of the plurality of media devices by mapping the personalized gesture data to the at least one media device to establish a second personalized association of the input set to a second command set with the at least one distinct local command.

14. The visual gesture processing system of claim 13, the first system operable to support responding to identifying visual gesture motion information captured by a sensing element as the at least one gesture input by delivering the distinct local command to the at least one media device.

15. The visual gesture processing system of claim 14, the identifying involving comparing the visual gesture motion information with personalized gesture data associated with the sensing element.

16. The visual gesture processing system of claim 13, comprising:

the first system operable to support accessing a plurality of individual visual gesture motion information captured by a plurality of sensing elements, each of the plurality of individual visual gesture motion information is associated with one of a plurality of users; and

the first system operable to support processing each individual visual gesture motion information to identify at least one gesture input based on an associated personalized gesture data.

17. The visual gesture processing system of claim 13, the first system operable to support creation of personalized gesture data associated with one of a plurality of users by:

establishing a personalized sequence of gesture inputs as at least one input set; and

associating the at least one gesture input with a personalized sequence of at least one command.

18. The visual gesture processing system of claim 17, each of the personalized sequence of gesture inputs and the personalized sequence of at least one command are selected, at least in part, via input from the one of the plurality of users.

19. The visual gesture processing system of claim 14, identifying the at least one gesture input includes determining that the visual gesture motion information correlates with a stored instance of the at least one gesture input.

20. The visual gesture processing system of claim 19, wherein:

identifying the at least one gesture input further includes determining that the visual gesture motion information correlates with the stored instance of the at least one gesture input to within a predefined level of confidence; and

the first system operable to support responds to a determination that the visual gesture motion information fails to correlate with the stored instance of the at least one gesture input to within a certain level of confidence by requesting input to identify the at least one gesture input.