Camera based interaction and instruction

• US 8,878,949 B2
• Filed: 08/07/2013
• Issued: 11/04/2014
• Est. Priority Date: 05/11/1999
• Status: Expired due to Fees

• Current Assignee: Gesture Technology Partners, LLC
• Original Assignee: Gesture Technology Partners, LLC
• Inventors: Pryor, Timothy R.
• Primary Examiner(s): HO, TUAN V
• Application Number:
  US13/961,452
• Publication Number:
  US 20140028855A1
• Time in Patent Office: 454 Days
• Field of Search: 348/211.4, 348/211.5, 348/211.8, 348/211.9, 348/222.1, 348/239
• US Class Current: 348/211.99
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0386 for light pen
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/69 Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
• CPC Class Codes: H04N 5/222 Studio circuitry; Studio devices; Studio equipment cameras or camera modules comprising electronic image sensors, or control thereof H04N23/00

Abstract

Disclosed are methods and apparatus for instructing persons using computer based programs and/or remote instructors. One or more video cameras obtain images of the student or other participant. In addition images are analyzed by a computer to determine the locations or motions of one or more points on the student. This location data is fed to computer program which compares the motions to known desired movements, or alternatively provides such movement data to an instructor, typically located remotely, who can aid in analyzing student performance. The invention preferably is used with a substantially life-size display, such as a projection display can provide, in order to make the information displayed a realistic partner or instructor for the student. In addition, other applications are disclosed to sports training, dance, and remote dating.

Claims

1. A portable device comprising:

a device housing including a forward facing portion, the forward facing portion of the device housing encompassing an electro-optical sensor having a field of view and including a digital camera separate from the electro-optical sensor; and

a processing unit within the device housing and operatively coupled to an output of the electro-optical sensor, wherein the processing unit is adapted to;

determine a gesture has been performed in the electro-optical sensor field of view based on the electro-optical sensor output, and

control the digital camera in response to the gesture performed in the electro-optical sensor field of view, wherein the gesture corresponds to an image capture command, and wherein the image capture command causes the digital camera to store an image to memory.

2. The portable device of claim 1 wherein the determined gesture includes a hand motion.

3. The portable device of claim 1 wherein the determined gesture includes a pose.

4. The portable device of claim 1 wherein the electro-optical sensor is fixed in relation to the digital camera.

5. The portable device of claim 1 further including a forward facing light source.

6. The portable device of claim 1 wherein the electro-optical sensor defines a resolution less than a resolution defined by the digital camera.

7. The portable device of claim 1 wherein the electro-optical sensor includes at least one of a CCD detector and a CMOS detector.

8. A computer implemented method comprising:

providing a portable device including a forward facing portion encompassing a digital camera and an electro-optical sensor, the electro-optical sensor having an output and defining a field of view;

determining, using a processing unit, a gesture has been performed in the electro-optical sensor field of view based on the electro-optical sensor output, wherein the determined gesture corresponds to an image capture command; and

capturing an image to the digital camera in response to the determined gesture corresponding to the image capture command.

9. The method according to claim 8 wherein the determined gesture includes a hand motion.

10. The method according to claim 8 wherein the determined gesture includes a pose.

11. The method according to claim 8 wherein the electro-optical sensor includes first and second sensors in fixed relation relative to the digital camera.

12. The method according to claim 8 wherein the electro-optical sensor defines a resolution less than a resolution defined by the digital camera.

13. An image capture device comprising:

a device housing including a forward facing portion, the forwarding facing portion encompassing a digital camera adapted to capture an image and having a field of view and encompassing a sensor adapted to detect a gesture in the digital camera field of view; and

a processing unit operatively coupled to the sensor and to the digital camera, wherein the processing unit is adapted to;

detect a gesture has been performed in the electro-optical sensor field of view based on an output of the electro-optical sensor, and

correlate the gesture detected by the sensor with an image capture function and subsequently capture an image using the digital camera, wherein the detected gesture is identified by the processing unit apart from a plurality of gestures.

14. The image capture device of claim 13 wherein the detected gesture includes a hand motion.

15. The image capture device of claim 13 wherein the detected gesture includes a pose.

16. The image capture device of claim 13 further including a forward facing light source.

17. The image capture device of claim 13 wherein the sensor defines a resolution less than a resolution defined by the digital camera.

18. The image capture device of claim 13 wherein the sensor is fixed in relation to the digital camera.