Head-mounted device

• US 10,587,862 B2
• Filed: 02/09/2017
• Issued: 03/10/2020
• Est. Priority Date: 03/23/2016
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Inventors: Watari, Yasuhiro, Ishida, Takayuki, Suzuki, Akira
• Primary Examiner(s): Tran, Thai Q
• Assistant Examiner(s): Mesa, Jose M
• Application Number:
  US16/083,208
• Publication Number:
  US 20190089946A1
• Time in Patent Office: 1,125 Days
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06T 2207/10021 Stereoscopic video; Stereoscopic image sequence
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 7/285 using a sequence of stereo image pairs
• CPC Class Codes: G06T 7/593 from stereo images
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06V 10/25 Determination of region of interest [ROI] or a volume of interest [VOI]
• CPC Class Codes: G06V 40/107 Static hand or arm
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/271 wherein the generated image signals comprise depth maps or disparity maps
• CPC Class Codes: H04N 13/30 Image reproducers optical systems for producing stereoscopic or other three-dimensional effects G02B30/00
• CPC Class Codes: H04N 13/344 with head-mounted left-right displays
• CPC Class Codes: H04N 2013/0081 Depth or disparity estimation from stereoscopic image signals
• CPC Class Codes: H04N 2013/0085 Motion estimation from stereoscopic image signals
• CPC Class Codes: H04N 23/57 Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet

Abstract

Provided is a head-mounted device that includes a housing, first imaging means, and second imaging means. The housing is to be mounted on the head of a user. The first and second imaging means are mounted on the housing to capture images from different angles of view. The head-mounted device receives an image captured by the first imaging means, detects an image portion corresponding to a body portion of the user from the received image, and estimates, based on information indicative of the detected image portion, a possible existence range of a predetermined part of the body of the user within an image captured by the second imaging means.

Claims

1. A head-mounted device comprising:

a housing that is to be mounted on the head of a user;

first imaging means and second imaging means that are mounted on the housing to capture images from different angles of view;

detection means for receiving an image captured by the first imaging means and detecting an image portion corresponding to a body portion of the user from the received image; and

estimation means for estimating, based on information indicative of the detected image portion, a possible existence range of a predetermined part of the body of the user within an image captured by the second imaging means,

wherein an image portion corresponding to the predetermined part of the body of the user is detected from the estimated possible existence range within the image captured by the second imaging means.

2. The head-mounted device according to claim 1, wherein a detection method adopted by the detection means to detect the predetermined part is different from a detection method adopted to detect the predetermined part from the image captured by the second imaging means.

3. A head-mounted device comprising:

a housing that is to be mounted on the head of a user;

first imaging means and second imaging means that are mounted on the housing to capture images from different angles of view;

detection means for receiving an image captured by the first imaging means and detecting temporal changes in an image portion corresponding to a body portion of the user from the received image; and

estimation means for estimating, based on information indicative of the temporal changes in the image portion, a possible existence range of a predetermined part of the body of the user within an image captured by the second imaging means,

wherein an image portion corresponding to the predetermined part of the body of the user is detected from the estimated possible existence range within the image captured by the second imaging means.

4. The head-mounted device according to claim 3, wherein a detection method adopted by the detection means to detect the predetermined part is different from a detection method adopted to detect the predetermined part from the image captured by the second imaging means.

5. A non-transitory computer-readable information storage medium for storing a program for a head-mounted device that is connected to a computer and includes a housing, first imaging means, and second imaging means, the housing being to be mounted on the head of a user, the first and second imaging means being mounted on the housing to capture images from different angles of view, the program for the computer, including:

by detection means, receiving an image captured by the first imaging means and detecting an image portion corresponding to a body portion of the user from the received image; and

by estimation means, estimating, based on the detected image portion, a possible existence range of a predetermined part of the body of the user within an image captured by the second imaging means.