Video motion capture for wireless gaming

• US 10,350,486 B1
• Filed: 05/30/2013
• Issued: 07/16/2019
• Est. Priority Date: 11/12/2008
• Status: Active Grant

• Current Assignee: Andrew S. Filo, David G. Capper
• Original Assignee: Andrew S. Filo, David G. Capper
• Inventors: Capper, David G., Filo, Andrew S.
• Primary Examiner(s): Harper, Tramar Y
• Assistant Examiner(s): Wong, Jeffrey K
• Application Number:
  US13/906,249
• Time in Patent Office: 2,238 Days
• CPC Class Codes: A46B 15/0002 Arrangements for enhancing monitoring or controlling the brushing process
• CPC Class Codes: A46B 15/0006 with a controlling brush technique device, e.g. stroke movement measuring device
• CPC Class Codes: A46B 15/0085 Brushes provided with an identification, marking device or design
• CPC Class Codes: A46B 9/04 Arranged like in or for toothbrushes
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/245 specially adapted to a particular type of game, e.g. steering wheels
• CPC Class Codes: A63F 13/426 involving on-screen location information, e.g. screen coordinates of an area at which the player is aiming with a light gun
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1632 External expansion units, e.g. docking stations
• CPC Class Codes: G06F 1/1686 the I/O peripheral being an integrated camera
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06V 20/653 by matching three-dimensional models, e.g. conformal mapping of Riemann surfaces
• CPC Class Codes: G06V 2201/121 using special illumination
• CPC Class Codes: G06V 40/23 Recognition of whole body movements, e.g. for sport training

Abstract

Embodiments of the present invention embody motion detection via a camera for mobile platform video gaming and exercise, in either integrated or separately attachable components. The system includes an oral care device. The oral care device, such as a toothbrush, includes one or more targets. Each target designates a specific area of the toothbrush, such as back side, a front side, a brush head or a brush end. A target can be a color or a tag, and can be removably coupled or integrally formed with the toothbrush. The system also includes an application configured to detect the targets, to determine that a property of any of the targets has changed. Based on at least the determination, the application is configured to monitor progress of brushing and to control an element in the application.

Claims

1. A non-transitory computer-readable medium storing instructions that, when executed by a computing device, cause the computing device to perform a method comprising:

presenting on a display interface a view captured by a camera;

using the camera to automatically recognize an identity of a particular object from among a plurality of identified objects and in the view presented on the display interface;

using the identity of the particular object to automatically access a video game application that is associated with the identity the particular object;

presenting on the display interface a game environment associated with the video game application, wherein the object is embedded in the game environment;

starting a game play for the video game application, wherein the video game application involves a task to be fulfilled during the game play;

using the camera to lock onto the object during the game play, thereby tracking the object as at least one characteristic of the object is being changed in a view of the camera;

determining whether a characteristic of the object satisfies at least a portion of the task; and

based on the determination, designating the portion of the task as being completed.

2. The non-transitory computer-readable medium of claim 1, wherein the computing device includes at least one of the display interface and the camera.

3. The non-transitory computer-readable medium of claim 1, wherein the task includes an educational problem.

4. The non-transitory computer-readable medium of claim 1, wherein the task includes a “

fill-in-the-blank”

problem.

5. The non-transitory computer-readable medium of claim 1, wherein the task includes a “

matching”

problem.

6. The non-transitory computer-readable medium of claim 1, wherein the task includes a “

name-the-object”

problem.

7. The non-transitory computer-readable medium of claim 1, wherein the task includes a skills training routine.

8. The non-transitory computer-readable medium of claim 1, wherein the method further comprises keeping an accuracy meter of the game play.

9. The non-transitory computer-readable medium of claim 1, wherein the method further comprises repeating the tracking step, the determining step and the designating step until all portions of the task are completed.

10. The non-transitory computer-readable medium of claim 1, wherein the tracking an object comprises using a detection algorithm.

11. The non-transitory computer-readable medium of claim 10, wherein the detection algorithm is configured to determine at least one physical attribute of the object.

12. The non-transitory computer-readable medium of claim 10, wherein the detection algorithm is configured to determine a pattern in which the object moves.

13. The non-transitory computer-readable medium of claim 12, wherein the pattern indicates which portions of the task have been completed.

14. The non-transitory computer-readable medium of claim 1, wherein the detection algorithm is configured to track the object using one or more targets coupled with the object.

15. The non-transitory computer-readable medium of claim 14, wherein the one or more targets comprise a retroreflector, a tag, a color, or any combination thereof.

16. The non-transitory computer-readable medium of claim 1, further comprising tracking a user'"'"'s eyes, facial features, or both to determine which portions of the task have been completed.

17. A non-transitory computer-readable medium storing instructions that, when executed by a computing device, cause the computing device to perform a method comprising:

presenting on a display interface a view captured by a camera;

using the camera to automatically recognize an identity of a particular object from among a plurality of identified objects and in the view presented on the display interface;

using the identity of the particular object to automatically access a video game application that is associated with the identity of the particular object;

presenting on the display interface a game environment associated with the video game application, wherein the object is embedded in the game environment;

starting a game play for the video game application;

using the camera to lock onto the object during the game play; and

controlling at least one element in the video game application based on a location of the locked object in the game play.

18. The non-transitory computer-readable medium of claim 17, wherein the object is locked even when external visible lighting conditions change during the game play.

19. The non-transitory computer-readable medium of claim 18, wherein locking the object comprises continuously performing calibration according to the changing external lighting conditions, wherein continuously performing calibration comprises capturing known color references in the view of the camera, wherein the known color references are subject to the same lighting conditions in which the object is in.

20. A non-transitory computer-readable medium storing instructions that, when executed by a computing device, cause the computing device to perform a method comprising:

presenting on a display interface a field of view captured by a camera;

detecting a particular object in the field of view presented on the display interface;

using the camera to identify the particular object that is detected from among a plurality of identified objects;

using the identification of the particular object to automatically access a video game application that corresponds with the identification;

presenting on the display interface a game environment associated with the video game application, wherein the object is embedded in the game environment;

starting a game play for the video game application;

ensuring that the object is continuously locked onto by the camera during the entirety of the game play; and

controlling at least one element in the video game application based on a location of the locked object in the game play.

21. A non-transitory computer-readable medium storing instructions that, when executed by a computing device, cause the computing device to perform a method comprising:

presenting on a display interface a view captured by a camera;

using the camera to automatically recognize an identity of a particular object from among a plurality of identified objects and in the view presented on the display interface;

using the identification of the particular object to automatically access a video game application that corresponds with the identification;

replacing the view presented on the display interface with a game environment associated with the video game application, wherein the object is embedded in the game environment;

starting a game play for the video game application;

ensuring that the object is continuously locked onto by the camera during the entirety of the game play, thereby tracking the object; and

controlling at least one element in the video game application based on the tracking of the object.