ELECTRONIC APPARATUS, PROCESSING SYSTEM, AND COMPUTER READABLE STORAGE MEDIUM

• US 20140067204A1
• Filed: 02/09/2012
• Published: 03/06/2014
• Est. Priority Date: 03/04/2011
• Status: Abandoned Application

• Current Assignee: Nikon Corporation
• Original Assignee: Nikon Corporation
• Inventors: Takahashi, Kazuhiro, Muratani, Mami, Yamada, Naoto, Muraki, Shinjiro, Sekiguchi, Masakazu, Adachi, Yuya
• Application Number:
  US13/983,923
• Publication Number:
  US 20140067204A1
• Time in Patent Office: Days
• US Class Current: 701/36
• CPC Class Codes: B60H 1/00742 by detection of the vehicle occupants' presence; by detection of conditions relating to the body of occupants, e.g. using radiant heat detectors
• CPC Class Codes: B60H 1/00757 by the input of sound, e.g. by using a voice synthesizer
• CPC Class Codes: B60Q 5/005 automatically actuated
• CPC Class Codes: B61D 27/0018 Air-conditioning means, i.e. combining at least two of the following ways of treating or supplying air, namely heating, cooling or ventilating air-conditioning in general F24F
• CPC Class Codes: B61K 13/04 Passenger-warning devices attached to vehicles; Safety devices for preventing accidents to passengers when entering or leaving vehicles for preventing passengers from being injured by movements of doors B61D19/026
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06V 40/10 Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• CPC Class Codes: G06V 40/11 Hand-related biometrics; Hand pose recognition
• CPC Class Codes: G06V 40/113 Recognition of static hand signs
• CPC Class Codes: G06V 40/117 Biometrics derived from hands
• CPC Class Codes: G06V 40/174 Facial expression recognition
• CPC Class Codes: G06V 40/176 Dynamic expression
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113
• CPC Class Codes: G06V 40/70 Multimodal biometrics, e.g. combining information from different biometric modalities

Abstract

Provided is an electronic apparatus that perform an appropriate process according to a gesture of a subject person, the electronic apparatus including: a first input unit that inputs a detection result of a biosensor detecting a change in biological information of a person; a second input unit that inputs a recognition result of a recognition device recognizing an action of the person; and a processor that performs a process according to the action of the person based on input results of the first and second input units.

Claims

1. An electronic apparatus comprising:

a first input unit that inputs a detection result of a biosensor detecting a change in biological information of a subject person;

a second input unit that inputs a recognition result of a recognition device recognizing an action of the person; and

a processor that performs a process according to the action of the person based on input results of the first and second input units.

2. The electronic apparatus according to claim 1, wherein

the recognition device includes different sensors, and

the processor performs the process according to the action of the person based on recognition results of the sensors that are input to the second input unit even when the change in biological information is not input to the first input unit.

3. The electronic apparatus according to claim 1, wherein

the sensors include an image capture device and a contact-type sensor, further comprising:

a controller that captures an image by the image capture device when the contact-type sensor recognizes an action of a person.

4. The electronic apparatus according to claim 3, wherein

the image capture device is located higher than the contact-type sensor.

5. The electronic apparatus according to claim 1, wherein

at least a part of the recognition device is located near the biosensor.

6. The electronic apparatus according to claim 1, wherein

the processor performs a process to emit a sound by a loudspeaker emitting a sound to the person.

7. The electronic apparatus according to claim 6, wherein

the loudspeaker is a directional loudspeaker emitting the sound to a limited direction.

8. The electronic apparatus according to claim 1, wherein

the processor receives a sound emitted from the person from a sound input device that inputs a sound.

9. The electronic apparatus according to claim 8, further comprising:

a sound recognition unit that recognizes a sound received from the sound input device.

10. The electronic apparatus according to claim 1, further comprising:

a timer that measures a time during which biological information of the person is changing and a time during which the action of the person is being recognized, wherein

the processor performs a process according to the input results and a time measurement result of the timer.

11. The electronic apparatus according to claim 1, wherein

the processor performs, when the person is present in moving equipment that is movable, the process taking a detection result of a detection device that detects a movement of the moving equipment into consideration.

12. The electronic apparatus according to claim 1, wherein

the first input unit inputs the change in biological information by human body communication.

13. A processing system comprising:

a biosensor that detects a change in biological information of a person;

a recognition device that recognizes an action of the person; and

the electronic apparatus according to claim 1.

14. The processing system according to claim 13, wherein

the biosensor detects the change in biological information from at least one of a hand and buttocks of the person.

15. An electronic apparatus comprising:

a first input unit that inputs a detection result of a first sensor that detects a movement of a first part of a body;

a second input unit that inputs a detection result of a second sensor that differs from the first sensor and detects a movement of a second part of the body different from the first part; and

a determination unit that determines whether the first part and the second part belong to a same person.

16. The electronic apparatus according to claim 15, further comprising:

processor that performs a process according to detection results input from the first and second input units when the determination unit determines that the first part and the second part belong to the same person.

17. The electronic apparatus according to claim 15, wherein

the determination unit determines whether the first part and the second part belong to the same person based on positional information of the first sensor that has detected the movement of the first part and positional information of the second sensor that has detected the movement of the second part.

18. The electronic apparatus according to claim 15, wherein

the first sensor is a contact-type sensor that contacts the first part to detect the movement of the first part, and

the second sensor is a contact-type sensor that contacts the second part to detect the movement of the second part.

19. The electronic apparatus according to claim 15, wherein

one of the first sensor and the second sensor is a hand detection sensor that detects a movement of a hand, and

the other of the first sensor and the second sensor is a foot detection sensor that detects a movement of a foot.

20. The electronic apparatus according to claim 15, wherein

the first sensor is a contact-type sensor that contacts the first part to detect the movement of the first part, and

the second sensor is a non-contact sensor that detects the movement of the second part without contacting the second part.

21. The electronic apparatus according to claim 15, wherein

the second sensor is a head detection sensor that detects a movement of a head.

22. The electronic apparatus according to claim 15, further comprising:

a third input unit that inputs a detection result of a third sensor that detects a movement of a third part of the body different from the first and second parts.

23. The electronic apparatus according to claim 15, further comprising:

a fourth input unit that inputs a detection result of a biosensor that detects a change in biological information of the body.

30. A processing system comprising:

a first sensor that detects a movement of a first part of a body;

a second sensor that detects a movement of a second part of the body different from the first part; and

the electronic apparatus according to claim 15.

24. An electronic apparatus comprising:

a first input unit that inputs a detection result of a non-contact sensor that detects a movement of a head without physical contact;

a second input unit that inputs a detection result of a contact sensor that contacts a part of a body other than the head and detects a movement of the part; and

a processor that performs a process according to detection results input from the first and second input units.

25. The electronic apparatus according to claim 24, further comprising:

controller that performs detection by the non-contact sensor when the contact sensor detects the movement.

26. The electronic apparatus according to claim 24, further comprising:

a determination unit that determines whether a head of which a movement is detected by the non-contact sensor and the part of the body of which a movement is detected by the contact sensor belong to a same person.

27. The electronic apparatus according to claim 26, wherein

the processor performs a process according to detection results input from the first and second input units when a determination result by the determination unit shows that the head of which the movement is detected by the non-contact sensor and the part of the body of which the movement is detected by the contact sensor belong to the same person.

28. The electronic apparatus according to claim 24, wherein

the contact sensor includes a first sensor that detects a movement of a first part of the body and a second sensor that detects a movement of a second part different from the first part.

29. The electronic apparatus according to claim 24, further comprising:

a biological information input unit that inputs a detection result of a biosensor that detects a change in biological information of a body.

31. A processing system comprising:

a non-contact sensor that detects a movement of a head without physical contact;

a contact sensor that contacts a part of a body other than the head to detect a movement of the part; and

the electronic apparatus according to claim 24.

32. A computer readable storage medium storing a program causing a computer to perform a process, the process comprising:

a first input step that inputs a detection result of a biosensor detecting a change in biological information of a person;

a second input step that inputs a recognition result of a recognition device recognizing an action of the person; and

a processing step that performs a process according to the action of the person based on input results at the first and second steps.

33. A computer readable storage medium storing a program causing a computer to perform a process, the process comprising:

a first input step that inputs a detection result of a first sensor that detects a movement of a first part of a body;

a second input step that inputs a detection result of a second sensor that differs from the first sensor and detects a second part of the body different from the first part; and

a determination step that determines whether the first part and the second part belong to a same person.

34. A computer readable storage medium storing a program causing a computer to perform a process, the process comprising:

a first input step that inputs a detection result of a non-contact sensor that detects a movement of a head without physical contact;

a second input step that inputs a detection result of a contact sensor that contacts a part of a body other than the head and detects a movement of the part; and

a processing step that performs a process according to detection results input from the first and second input units.