RECOGNIZING INTERACTIVE MEDIA INPUT

• US 20110157012A1
• Filed: 12/31/2009
• Published: 06/30/2011
• Est. Priority Date: 12/31/2009
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Huo, Qiang, Ma, Lei
• Granted Patent: US 9,207,765 B2
• Time in Patent Office: Days
• US Class Current: 345/157
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/22 Setup operations, e.g. calibration, key configuration or button assignment
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 13/573 using trajectories of game objects, e.g. of a golf ball according to the point of impact
• CPC Class Codes: A63F 13/798 for assessing skills or for ranking players, e.g. for generating a hall of fame computing the game score A63F13/46
• CPC Class Codes: A63F 2300/1093 using visible light
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0236 using selection techniques to select from displayed items
• CPC Class Codes: G06F 3/0237 using prediction or retrieval techniques
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/4753 for user identification, e.g. by entering a PIN or password cryptographic authentication protocols H04L9/32; networks authentication protocols H04L63/08
• CPC Class Codes: H04N 21/482 End-user interface for program selection broadcast systems using EPGs H04H60/72

Abstract

Techniques and systems for inputting data to interactive media devices are disclosed herein. In some aspects, a sensing device senses an object as it moves in a trajectory indicative of a desired input to an interactive media device. Recognition software may be used to translate the trajectory into various suggested characters or navigational commands. The suggested characters may be ranked based on a likelihood of being an intended input. The suggested characters may be displayed on a user interface at least in part based on the rank and made available for selection as the intended input.

Claims

1. A method of inputting data to an interactive media device, the method comprising:

calibrating an interactive media device to identify and visually track an object;

recording a trajectory of a movement of the object extracted from a multi-frame video sequence, the trajectory indicative of a desired input to the interactive media device;

displaying the trajectory on a display device;

translating the trajectory into one or more suggested characters;

displaying the one or more suggested characters on the display device; and

receiving a selection information indicating which of the one or more suggested characters represents the desired input.

2. The method as recited in claim 1, wherein the calibrating the interactive media device comprises:

receiving a calibration trigger event;

displaying a calibration zone on the display device in response to the receipt of the calibration trigger event; and

locking-in on the object when the object is substantially placed inside of the calibration zone.

3. The method as recited in claim 1, wherein the translating the trajectory into one or more suggested characters includes at least a static recognition element, a dynamic recognition element, and a combiner of multiple recognition elements.

4. The method as recited in claim 1, wherein the displaying comprises displaying a highest ranked suggested character closest to an end point of the trajectory on the display device.

5. The method as recited in claim 1, further comprising:

recording a gesture performed via the object, the gesture indicative of a navigational command;

translating the gesture into a navigational input; and

communicating the navigational input to control a navigational feature of the interactive media device.

6. The method as recited in claim 1, wherein the interactive media device is at least one of a gaming device or an interactive television device.

7. One or more computer-readable media comprising processor-executable instructions that, when executed, direct a device to perform actions comprising:

receiving an input mode directive to designate object tracking as one of a handwriting mode or a navigation mode;

receiving a start input signal to start recording a trajectory of an object;

receiving a stop input signal to stop the recording of the trajectory;

translating the trajectory into a command input recognizable by an interactive media device; and

communicating the command input to control an interactive feature of the interactive media device.

8. The one or more computer-readable media of claim 7, wherein when the input mode directive is the handwriting mode, the translating the trajectory into the command input comprises:

translating the trajectory into one or more suggested characters;

displaying the one or more suggested characters on a display device; and

receiving a selection information indicating which one of the one or more suggested characters is the command input.

9. The one or more computer-readable media of claim 8, further comprising ranking the one or more suggested characters based on a likelihood of being an intended input such that a display area of a highest ranked suggested character is larger than a display area of a non-highest ranked suggested character on the display device.

10. The one or more computer-readable media of claim 7, wherein when the input mode directive is the handwriting mode, and wherein the communicating the command inputs inserts the desired input into an input box of the interactive media device.

11. The one or more computer-readable media of claim 7, wherein when the input mode directive is the navigation mode, and wherein the communicating the command input controls a navigational feature of the interactive media device.

12. The one or more computer-readable media of claim 7, wherein a camera records a movement of the object as a multi-frame video sequence from which the trajectory is extracted.

13. The one or more computer-readable media of claim 7, wherein an inertial sensor of the object records a movement of the object as a sequence of inertial sensor signals from which the trajectory is extracted.

14. The one or more computer-readable media of claim 7, further comprising displaying a real-time image of the trajectory on the display device.

15. A method comprising:

recording a trajectory of a movement of an object extracted from a multi-frame video sequence via a camera;

displaying the trajectory on a display device;

translating the trajectory into a plurality of suggested inputs;

displaying the plurality of suggested inputs on a display device;

receiving a selection of a desired input, the desired input being one of the plurality of suggested inputs; and

controlling an interactive media device via the desired input.

16. The method as recited in claim 15, wherein the receiving the selection of the desired input further comprising recording an acceptance gesture performed via the object, wherein, on the plurality of suggested inputs, the desired input is positioned closest to an end point of the acceptance gesture on the display device.

17. The method as recited in claim 15, further comprising ranking the plurality of suggested inputs such that the displaying the plurality of suggested inputs displays a top ranked suggested input closest to an end point of the trajectory on the display device.

18. The method as recited in claim 15, wherein the desired input is a character such that the controlling the interactive media device enters the desired input into an input box of the interactive media device.

19. The method as recited in claim 15, wherein the desired input is a navigational input such that the controlling the interactive media device controls a navigational feature of the interactive media device.

20. The method as recited in claim 18, wherein the desired input is an East Asian character in a traditional form.