Camera based interaction and instruction

• US 8,654,198 B2
• Filed: 04/30/2012
• Issued: 02/18/2014
• Est. Priority Date: 05/11/1999
• Status: Expired due to Fees

• Current Assignee: Gesture Technology Partners, LLC
• Original Assignee: Gesture Technology Partners, LLC
• Inventors: Pryor, Timothy R.
• Primary Examiner(s): HO, TUAN V
• Application Number:
  US13/459,670
• Publication Number:
  US 20120212630A1
• Time in Patent Office: 659 Days
• Field of Search: 348/207.1, 348/239, 348/42, 348/153, 348/154, 348/155, 345/8, 345/9, 345/156
• US Class Current: 348/207.1
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0386 for light pen
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/69 Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
• CPC Class Codes: H04N 5/222 Studio circuitry; Studio devices; Studio equipment cameras or camera modules comprising electronic image sensors, or control thereof H04N23/00

Abstract

Disclosed are methods and apparatus for instructing persons using computer based programs and/or remote instructors. One or more video cameras obtain images of the student or other participant. In addition images are analyzed by a computer to determine the locations or motions of one or more points on the student. This location data is fed to computer program which compares the motions to known desired movements, or alternatively provides such movement data to an instructor, typically located remotely, who can aid in analyzing student performance. The invention preferably is used with a substantially life-size display, such as a projection display can provide, in order to make the information displayed a realistic partner or instructor for the student. In addition, other applications are disclosed to sports training, dance, and remote dating.

Claims

1. An apparatus to control a display, the apparatus comprising:

a housing;

first and second sensors each being supported by the housing and having an output, the first and second sensors including a field of view to encompass at least a portion of each of a plurality of persons;

a digital color camera supported by the housing and adapted to obtain images of the plurality of persons in the field of view; and

a computer within the housing and coupled to each sensor output to determine three-dimensional movement or location information concerning each of the plurality of persons, wherein the computer includes an output to a processor to control the display based on the determined three-dimensional movement or location information.

2. The apparatus of claim 1 wherein the processor is a video display processor.

3. The apparatus of claim 1 wherein the display controlled by the computer is a video display.

4. The apparatus of claim 1 wherein the display is supported within the housing.

5. The apparatus of claim 1 wherein the location information includes the location of an edge of each of the plurality of persons.

6. The apparatus of claim 1 wherein the first and second sensors are a stereo camera pair.

7. The apparatus of claim 1 further including a diode laser.

8. The apparatus of claim 1 further including a speaker coupled to the computer.

9. The apparatus of claim 1 further including a microphone coupled to the computer, wherein the computer includes a voice recognition program set in computer readable memory.

10. The apparatus of claim 1 wherein the determined three-dimensional location information is used to control the digital color camera focus.

11. The apparatus of claim 1 wherein the determined three-dimensional location information is used to control the digital color camera exposure.

12. An apparatus to control a display, the apparatus comprising:

a housing;

first and second sensors supported by the housing and each including an output, the first and second sensors each including field of view encompassing at least a person;

a digital color camera supported by the housing and adapted to obtain images of the person; and

a computer within the housing and coupled to each sensor output to determine three-dimensional location information concerning a plurality of portions of the person, wherein the computer includes an output to a processor to control the display based on the determined three-dimensional location information.

13. The apparatus of claim 12 wherein the processor is a video display processor.

14. The apparatus of claim 12 wherein the display controlled by the computer is a video display.

15. The apparatus of claim 12 wherein the display is supported within the housing.

16. The apparatus of claim 12 wherein the location information includes the location of an edge of each of the plurality of portions of the person.

17. The apparatus of claim 12 wherein the first and second sensors are a stereo camera pair.

18. The apparatus of claim 12 further including a diode laser.

19. The apparatus of claim 12 further including a speaker coupled to the computer.

20. The apparatus of claim 12 further including a microphone coupled to the computer, wherein the computer includes a voice recognition program set in computer readable memory.

21. The apparatus of claim 12 wherein the determined three-dimensional location information is used to control the digital color camera focus.

22. The apparatus of claim 12 wherein the determined three-dimensional location information is used to control the digital color camera exposure.