SYSTEMS AND METHODS FOR GESTURE-BASED CREATION OF INTERACTIVE HOTSPOTS IN A REAL WORLD ENVIRONMENT

• US 20130024819A1
• Filed: 07/18/2011
• Published: 01/24/2013
• Est. Priority Date: 07/18/2011
• Status: Abandoned Application

• Current Assignee: Fuji Xerox Company Limited (Fujifilm Holdings Corporation)
• Original Assignee: Fuji Xerox Company Limited (Fujifilm Holdings Corporation)
• Inventors: Kimber, Donald, Liao, Chunyuan, Liu, Qiong, Rieffel, Eleanor
• Application Number:
  US13/185,414
• Publication Number:
  US 20130024819A1
• Time in Patent Office: Days
• US Class Current: 715/848
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

Systems and methods provide for gesture-based creation of interactive hotspots in a real world environment. A gesture made by a user in a three-dimensional space in the real world environment is detected by a motion capture device such as a camera, and the gesture is then identified and interpreted to create a “hotspot,” which is a region in three-dimensional space through which a user interacts with a computer system. The gesture may indicate that the hotspot is anchored to the real world environment or anchored to an object in the real world environment. The functionality of the hotspot is defined in order to identify the type of gesture which will initiate the hotspot and associate the activation of the hotspot with an activity in the system, such as control of an application on a computer or an electronic device connected with the system.

Claims

1. A method for creating a hotspot in a real world environment, comprising:

detecting a gesture of a user in a three-dimensional (3D) space of the real world environment using a motion tracking device;

identifying and interpreting the gesture using a processor and a memory;

creating a hotspot in the 3D space based on the identified and interpreted gesture; and

associating the hotspot with at least one activity,

wherein the gesture further comprises a hotspot-creating mode gesture which identifies that the gesture is intended to create the hotspot.

2. The method of claim 1, further comprising providing feedback to the user when capturing the gesture and creating the hotspot.

3. The method of claim 1, wherein the gesture is a 3D gesture that includes movement of a user in three different dimensions.

5. The method of claim 1, wherein creating the hotspot further comprises defining an interaction with the hotspot to initiate the associated activity.

6. The method of claim 5, wherein the identified gesture defines the interaction which will initiate the hotspot.

7. The method of claim 1, comprising interpreting the gesture to anchor the hotspot to the real world environment.

8. The method of claim 1, comprising interpreting the gesture to anchor the hotspot to a movable object in the real world environment.

9. The method of claim 8, further comprising calibrating the motion tracking device with the real world environment prior to detecting a gesture.

10. The method of claim 2, wherein the feedback provided to the user provides a display of a virtual environment which matches the real world environment and illustrates a location and a size of the hotspot.

11. The method of claim 1, wherein the hotspot is a three-dimensional region in a space within the real world environment through which the user interacts with a system.

24. The method of claim 1, wherein the hotpot-creating mode gesture comprises a raised hand, which indicates that the gesture is intended to create the hotspot.

25. The method of claim 1, wherein a hotspot-creating mode is entered and exited through pushing a button on a graphical user interface or showing a quick response (QR) code.

26. The method of claim 2, wherein the feedback to the user occurs through at least one of haptic, a head-mounted display, and a holographic 3D display.

27. The method of claim 2, wherein the feedback to the user is provided through a beep or a lightning of an indicator light.

4. (canceled)

12. A system for creating a hotspot in a real world environment, comprising:

a motion capture unit which captures a gesture of a user in a three-dimensional (3D) space of the real world environment;

a gesture processing unit which identifies and interprets the gesture using a processor and a memory and creates a hotspot in the 3D space based on the identified and interpreted gesture; and

a gesture association unit which associates the hotspot with at least one activity

wherein the gesture further comprises a hotspot-creating mode gesture which identifies that the gesture is intended to create the hotspot.

13. The system of claim 12, further comprising a feedback unit which provides feedback to the user when capturing the gesture and creating the hotspot.

14. The system of claim 13, wherein the gesture is a 3D gesture that includes movement of a user in three different dimensions.

16. The system of claim 12, wherein the gesture processing unit defines an interaction with the hotspot to initiate the associated activity.

17. The system of claim 16, wherein the identified gesture defines the interaction which will initiate the hotspot.

18. The system of claim 12, wherein the gesture is interpreted to anchor the hotspot to the real world environment.

19. The system of claim 12, wherein the gesture is interpreted to anchor the hotspot to a movable object in the real world environment.

20. The system of claim 19, further comprising a calibration unit which calibrates the motion capture unit with the real world environment.

21. The system of claim 13, wherein the feedback unit provides a display of a virtual environment which matches the real world environment and illustrates a location and a size of the hotspot.

22. The system of claim 12, wherein the hotspot is a three-dimensional region in a space within the real world environment through which the user interacts with a system.

15. (canceled)

23. A computer program product for creating a hotspot in a real world environment, the computer program product embodied on a computer-readable medium and when executed by a computer, performs the method comprising:

detecting a gesture of a user in a three-dimensional (3D) space of the real world environment using a motion tracking device;

identifying and interpreting the gesture;

creating a hotspot in the 3D space based on the identified and interpreted gesture; and

associating the hotspot with at least one activity,

wherein the gesture further comprises a hotspot-creating mode gesture which identifies that the gesture is intended to create the hotspot.