INFORMATION PROCESSING APPARATUS, DISPLAY APPARATUS, INFORMATION PROCESSING METHOD, AND PROGRAM

• US 20170161957A1
• Filed: 11/15/2016
• Published: 06/08/2017
• Est. Priority Date: 12/03/2015
• Status: Active Grant

• Current Assignee: Seiko Epson Corporation (Seiko Group)
• Original Assignee: Seiko Epson Corporation (Seiko Group)
• Inventors: MORI, Yuichi, YAJIMA, Kenro
• Granted Patent: US 10,102,676 B2
• Time in Patent Office: Days
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 27/0179 Display position adjusting means not related to the information to be displayed
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06T 2215/16 Using real world measurements to influence rendering
• CPC Class Codes: G06T 7/11 Region-based segmentation
• CPC Class Codes: G06T 7/50 Depth or shape recovery
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 40/10 Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113

Abstract

An information processing apparatus including an imaging section that performs imaging over a range including at least part of a user'"'"'s field of view and a control section that detects the user'"'"'s operation based on an image captured by the imaging section and estimates a target object from objects contained in the captured image in accordance with the detected operation.

Claims

1. An information processing apparatus comprising:

an imaging section that performs imaging over a range including at least part of a user'"'"'s field of view; and

a control section that detects the user'"'"'s operation based on an image captured by the imaging section and estimates a target object from objects contained in the captured image in accordance with the detected operation.

2. The information processing apparatus according to claim 1,

wherein the control section detects an image of the user'"'"'s body contained in the captured image to detect the user'"'"'s operation.

3. The information processing apparatus according to claim 2,

wherein a region containing part of the captured image and a condition under which an image of the user'"'"'s body is detected in the region are set, and

the control section evaluates whether or not an object contained in the captured image is an image of the user'"'"'s body in accordance with the condition set in the region containing the object to detect the user'"'"'s body.

4. The information processing apparatus according to claim 3,

wherein priority is set in the region in accordance with a position of the region in the captured image, and whether the object contained in the region is an image of the user'"'"'s body is evaluated in accordance with the priority, and

the control section evaluates whether or not the object is an image of the user'"'"'s body in accordance with the priority set in the region containing the object.

5. The information processing apparatus according to claim 4,

wherein the region is formed of a plurality of regions, and in each of the regions is set priority according to the position of the region in the captured image.

6. The information processing apparatus according to claim 4,

wherein in the region located on a side facing a bottom side of the captured image is set higher priority than in the region shifted from the bottom-side region to a top side of the captured image.

7. The information processing apparatus according to claim 2,

wherein the control section detects the object that overlaps with an edge of the captured image as an image of the user'"'"'s body.

8. The information processing apparatus according to claim 2,

the control section detects an image of a person'"'"'s hand contained in the captured image and evaluates whether the detected hand image is an image of the user'"'"'s body based on whether the hand image is a right hand image or a left hand image and a position of the hand image in the captured image.

9. The information processing apparatus according to claim 8,

wherein in a case where the image of a person'"'"'s hand detected in the captured image contains an edge of the captured image, the control section determines the hand image as an image of the user'"'"'s body.

10. The information processing apparatus according to claim 2,

further comprising a distance detection section that detects a distance to a measurement target object,

wherein the control section detects, among the objects contained in the captured image, the object located in a position separate by a distance that is detected by the distance detection section and is smaller than or equal to a predetermined value as an image of the user'"'"'s body.

11. The information processing apparatus according to claim 2,

wherein the control section detects an image of a person'"'"'s hand contained in the captured image, and in a case where the distance detected by the distance detection section to the measurement target object corresponding to the hand image contains a plurality of distances set in advance, the control section determines the hand image as an image of the user'"'"'s body.

12. The information processing apparatus according to claim 1,

wherein the control section estimates, among the objects contained in the captured image, the object separate from the user'"'"'s body by a predetermined distance or smaller as the target object.

13. The information processing apparatus according to claim 12,

wherein the control section detects an image of a shadow of the user'"'"'s body in the captured image, and

the control section estimates, among the objects contained in the captured image, the object located in a position separate from the image of the shadow of the body by a predetermined distance or smaller as the target object.

14. The information processing apparatus according to claim 1,

further comprising an acquisition section that acquires a state or a result of detection performed by a body mounted detection apparatus mounted on the user'"'"'s body,

wherein the control section estimates the target object based on the detection result acquired by the acquisition section.

15. A display apparatus comprising:

a display section mounted on a user'"'"'s head;

an imaging section that performs imaging over a range including at least part of the user'"'"'s field of view; and

a control section that detects the user'"'"'s operation based on an image captured by the imaging section and estimates a target object from objects contained in the captured image in accordance with the detected operation.

16. The display apparatus according to claim 15,

wherein the control section detects the objects contained in the captured image and an image of the user'"'"'s body contained in the captured image and causes the display section to display a GUI image in accordance with a position and a shape of the object other than the user'"'"'s body.

17. The display apparatus according to claim 16,

further comprising a distance detection section that detects a distance to a measurement target object,

wherein the control section causes the display section to display the GUI image based on a distance to the measurement target object corresponding to the object other than the user'"'"'s body.

18. An information processing method comprising:

performing imaging over a range including at least part of a user'"'"'s field of view; and

detecting the user'"'"'s operation based on a captured image and estimating any of a plurality of objects contained in the captured image as a target object in accordance with the detected operation.

19. A program executable by a computer that controls an information processing apparatus, the computer carrying out the process of detecting the user'"'"'s operation based on an image captured over a range including at least part of a user'"'"'s field of view and estimating any of a plurality of objects contained in the captured image as a target object in accordance with the detected operation.