Multi-image interactive gaming device

• US 9,724,597 B2
• Filed: 03/15/2013
• Issued: 08/08/2017
• Est. Priority Date: 06/04/2012
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Inventors: Marks, Richard, Mikhailov, Anton, Larsen, Eric
• Primary Examiner(s): Mercedes, Dismery
• Application Number:
  US13/842,573
• Publication Number:
  US 20130324243A1
• Time in Patent Office: 1,607 Days
• Field of Search: None
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/22 Setup operations, e.g. calibration, key configuration or button assignment
• CPC Class Codes: A63F 13/235 using a wireless connection, e.g. infrared or piconet
• CPC Class Codes: A63F 13/24 Constructional details thereof, e.g. game controllers with detachable joystick handles
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 13/424 involving acoustic input signals, e.g. by using the results of pitch or rhythm extraction or voice recognition
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: A63F 13/5252 using two or more virtual cameras concurrently or sequentially, e.g. automatically switching between fixed virtual cameras when a character changes room or displaying a rear-mirror view in a car-driving game
• CPC Class Codes: A63F 13/843 involving concurrently two or more players on the same game device, e.g. requiring the use of a plurality of controllers or of a specific view of game data for each player
• CPC Class Codes: A63F 2300/1093 using visible light
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands
• CPC Class Codes: A63F 2300/6072 of an input signal, e.g. pitch and rhythm extraction, voice recognition
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06T 2207/10152 Varying illumination
• CPC Class Codes: G06T 5/90 Dynamic range modification of images or parts thereof

Abstract

An image capture device includes: a housing; a first camera defined along a front surface of the housing; a first camera controller configured to control the first camera to capture images of an interactive environment during user interactivity at a first exposure setting; a second camera defined along the front surface of the housing; a second camera controller configured to control the second camera to capture images of the interactive environment during the user interactivity at a second exposure setting lower than the first exposure setting, the captured images from the second camera being analyzed to identify and track an illuminated object in the interactive environment.

Claims

1. An image capture device for providing input to an interactive application, comprising:

a housing;

a first camera defined along a front surface of the housing;

a first camera controller configured to control the first camera to capture images of an interactive environment during user interactivity at a first exposure setting, the captured images from the first camera being analyzed to detect a dynamic range of the interactive environment and to track a user;

a second camera defined along the front surface of the housing;

a second camera controller configured to control the second camera to capture images of the interactive environment during the user interactivity at a second exposure setting lower than the first exposure setting, the captured images from the second camera being analyzed to track an illuminated object in the interactive environment;

wherein a light intensity of the illuminated object is adjusted using the detected dynamic range of the interactive environment so as to be among the brighter objects in the interactive environment.

2. The image capture device of claim 1, wherein tracking the user includes tracking a face of the user.

3. The image capture device of claim 1, wherein the first camera and the second camera are horizontally aligned along the front surface of the housing.

4. The image capture device of claim 1, further comprising a microphone array for capturing sound from the interactive environment.

5. The image capture device of claim 1, wherein the first camera controller is configured to control the first camera to capture images of the interactive environment prior to the user interactivity, the images captured prior to the user interactivity being analyzed to determine the first exposure setting.

6. The image capture device of claim 1, wherein the second camera controller is configured to control the second camera to capture images of the interactive environment prior to the user interactivity, the images captured prior to the user interactivity being analyzed to determine the second exposure setting.

7. A system for facilitating interactivity with an interactive application, comprising:

a controller device having an illuminated object;

an image capture device, the image capture device including a first camera, a second camera, a first camera controller configured to control the first camera to capture images of an interactive environment during user interactivity at a first exposure setting, and a second camera controller configured to control the second camera to capture images of the interactive environment during the user interactivity at a second exposure setting lower than the first exposure setting;

a computing device connected t the image capture device, the computing device configured to execute the interactive application, the computing device configured to analyze the captured images from the first camera to track a user in the interactive environment, wherein the captured images from the first camera are not analyzed to track the illuminated object, the computing device configured to analyze the captured images from the second camera to track the illuminated objects in the interactive environment, wherein the captured images from the second camera are not analyzed to track the user,

wherein the computing device is configured to adjust a light intensify of the illuminated object in response to a detected dynamic range of the interactive environment so as to be among the brighter objects in the interactive environment.

8. The system of claim 7, wherein tracking the user includes tracking a face of the user.

9. The system of claim 7, wherein the first camera and the second camera are horizontally aligned along the front surface of the housing.

10. The system of claim 7, further comprising a microphone array for capturing sound from the interactive environment.

11. The system of claim 7, wherein the first camera controller is configured to control the first camera to capture images of the interactive environment prior to the user interactivity, the images captured prior to the user interactivity being analyzed to determine the first exposure setting.

12. The system of claim 7, wherein the second camera controller is configured to control the second camera to capture images of the interactive environment prior to the user interactivity, the images captured prior to the user interactivity being analyzed to determine the second exposure setting.

13. A method for interactivity with an interactive application, comprising:

capturing images from an interactive environment during user interactivity at a first exposure setting;

analyzing the images captured at the first exposure setting to track a user;

simultaneous with the capturing images at the first exposure setting, capturing images from the interactive environment during the user interactivity at a second exposure setting lower than the first exposure setting;

analyzing the images captured at the second exposure setting to track an illuminated object in the interactive environment, wherein the images captured at the second exposure setting are not analyzed to track the user;

adjusting a light intensity of the illuminated object in response to a detected dynamic range of the interactive environment so as to be among the brighter objects in the interactive environment.

14. The method of claim 13, wherein tracking the user includes tracking a face of the user.

15. The method of claim 13, further comprising, analyzing the images captured at the first exposure setting to identify and track an AR tag.

16. The method of claim 13, further comprising, capturing sound from the interactive environment.

17. The method of claim 13, further comprising,

capturing images of the interactive environment prior to the user interactivity;

and

analyzing the images captured prior to the user interactivity to determine one or more of the first exposure setting or the second exposure setting.