RECOGNIZING INTERACTIONS WITH HOT ZONES

• US 20150002419A1
• Filed: 06/17/2014
• Published: 01/01/2015
• Est. Priority Date: 06/26/2013
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: White, Chris, Haynie, Scott W., Kaplan, Jesse, McQueen, John
• Application Number:
  US14/307,339
• Publication Number:
  US 20150002419A1
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: A63F 13/49 Saving the game status; Pausing or ending the game
• CPC Class Codes: A63F 13/56 Computing the motion of game characters with respect to other game characters, game objects or elements of the game scene, e.g. for simulating the behaviour of a group of virtual soldiers or for path finding
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition
• CPC Class Codes: G06V 40/23 Recognition of whole body movements, e.g. for sport training
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113

Abstract

A system and method for defining a three dimensional (3D) zone which, upon entrance or exit of an element as detected by a depth capture system, raises a digital event. The zone comprises a region of space in an environment the interaction with which occurs by activation of pixels in the zone. The event can be provided to an application to perform programmatic tasks based on the event. Generation of the event may be limited to the entrance or exit of a specific person, body part, or object, or a combination of these. Using the digital event, interaction with real world objects may be tied to digital events.

Claims

1. A computer implemented method of rendering a digital event, comprising:

defining one or more three-dimensional hot zones in a real world environment, each hot zone comprising a volume of space;

monitoring the real world environment to receive depth data, the depth data including the one or more three-dimensional hot zones in the real world environment.

detecting an interaction between a second real-world object and at least one of the one or more hot zones by analysis of the depth data, the interaction occurring when a threshold number of active pixels in the hot zone have a change in depth distance based on the presence of the second real-world object; and

responsive to the detecting, outputting a signal responsive to the interaction between the second real-world object and the one or more hot zones to at least one application on a processing device.

2. The computer implemented method of claim 1 wherein the depth data may be referenced by a three dimensional coordinate system referencing the real world environment, the three dimensional coordinates defined relative to a position of a depth capture device, each hot zone defined by coordinates in the coordinate system.

3. The computer implemented method of claim 1 wherein the depth data may be referenced by a three dimensional coordinate system referencing the real world environment, the three dimensional coordinates defined relative to a position of a fiduciary object in a field of view of the capture device, each hot zone defined by coordinates in the coordinate system.

4. The computer implemented method of claim 3 further including determining that a change in continually active pixels within the bounding region has occurred, and modifying the hot zone.

5. The computer implemented method of claim 4 wherein said modifying comprises filtering continually active pixels from the hot zone.

6. The computer implemented method of claim 4 wherein said modifying comprises changing one or more of the dimensional coordinates defining the hot zone to thereby move the hot zone.

7. The computer implemented method of claim 1 wherein the detecting includes the interaction occurring when a threshold number of active pixels in the hot zone have a change in depth distance for at least a threshold period of time.

8. The computer implemented method of claim 1 wherein the three dimensional coordinates are referenced relative to a depth data capture device, and further including determining whether a camera re-alignment resulting from a change in active pixels in the hot zone is needed and if so, aligning the camera using a camera alignment algorithm.

9. An apparatus generating an indication of an interaction with a real would object, the interaction being output to an application to create a digital event, the apparatus comprising:

a capture device having a field of view of a scene, the capture device outputting depth data of the field of view relative to a coordinate system; and

a processing device, coupled to the capture device, receiving the depth data and responsive to code instructing the processing device to;

receive a definition of one or more hot zones in the scene, each hot zone comprising a volume of physical space associated with a first real world object defined by a plurality of pixels in a coordinate system having a reference point;

detect an interaction between a second real-world object and one or more hot zones by detecting an interaction comprising an activation of a threshold number of pixels by changing the depth within the plurality of pixels in the one or more hot zones for a threshold period of time; and

output a signal responsive to the interaction between the second real-world object and the one or more hot zones, the signal output to an application configured to use the signal to generate an event in the application.

10. The apparatus of claim 9 wherein the coordinate system is an X, Y and Depth coordinate system, with X and Y coordinates comprising a minimum and maximum pixel count relative to an X and Y axis measured from a capture device, and a Z coordinate defined as a distance from the capture device, the definition including a minimum number of active pixels for activation.

11. The apparatus of claim 9 including instructing the processing device to further including determine whether a camera re-alignment resulting from a change in active pixels in the hot zone is needed and if so, aligning the camera using a camera alignment algorithm.

12. The apparatus of claim 10 wherein receiving a definition comprises receiving an data file having specified therein for each hot zone X and Y coordinates comprising a minimum and maximum pixel count relative to an X and Y axis measured from a reference point, and a Z coordinate defined as a distance from the reference point, the definition including a minimum number of active pixels for activation.

13. The apparatus of claim 9 further including code instructing the processor to determine that a change in continually active pixels within the bounding region has occurred, and modifying the hot zone.

14. The apparatus of claim 13 wherein the apparatus is configured to modify said hot zone by filtering continually active pixels from the hot zone.

15. The apparatus of claim 13 wherein the apparatus is configured to modify said hot zone by changing one or more of the coordinates defining the hot zone to move the zone.

16. A computer storage medium, the computer storage medium including code instructing a processor with access to the storage medium to perform a processor implemented method, comprising:

receiving one or more hot zone definitions within a real world scene, each hot zone comprising a volume of physical space associated with a first real world object defined by a three-dimensional set of pixels determined relative to a reference point in the environment, which may be referenced by the processor;

determining an interaction within the scene, the interaction comprising determining a change in depth data within a volume of said one or more hot zones within the scene for a threshold period of time;

responsive to determining an interaction, outputting a signal indicating that an interaction has occurred to an application configured to use the interaction to generate a digital event;

determining an adjustment to a definition of the hot zone; and

automatically modifying the hot-zone when determining an adjustment specifies an adjustment is needed.

17. The computer storage medium of claim 16 wherein the reference point comprises a fiduciary point in a field of view of the capture device and the method further includes adjusting the coordinate space subsequent to a movement of the capture device relative to the position to a new position.

18. The computer storage medium of claim 16 wherein the reference point is the capture device method further includes a determining that a capture device providing said depth data has changed position relative to the hot zone and aligning the capture device.

19. The computer storage medium of claim 16 wherein the method further includes determining that a change in continually active pixels within the hot zone has occurred, and filtering continually active pixels within hot zone from the hot zone definition.

20. The computer storage medium of claim 16 wherein the method further includes determining that a change in continually active pixels within the hot zone has occurred, and changing at least one of coordinates defining a position of the zone.