Display with built in 3D sensing

• US 8,259,163 B2
• Filed: 03/09/2009
• Issued: 09/04/2012
• Est. Priority Date: 03/07/2008
• Status: Active Grant

• Current Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Original Assignee: Intellectual Ventures Holding 67 LLC (Intellectual Ventures LLC)
• Inventors: Bell, Matthew
• Primary Examiner(s): Neurauter, George C
• Assistant Examiner(s): JOSHI, SURAJ M
• Application Number:
  US12/400,772
• Publication Number:
  US 20100060722A1
• Time in Patent Office: 1,275 Days
• Field of Search: None
• US Class Current: 348/51
• CPC Class Codes: A63F 13/00 Video games, i.e. games using an electronically generated display having two or more dimensions gaming systems which provide a financial reward G07F17/32
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06T 13/40 of characters, e.g. humans, animals or virtual beings
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/254 in combination with electromagnetic radiation sources for illuminating objects
• CPC Class Codes: H04N 13/366 using viewer tracking

Abstract

Information from execution of a vision processing module may be used to control a 3D vision system.

Claims

1. A system comprising:

an illuminator configured to emit a predetermined pattern of light into an interactive space;

a camera configured to detect at least a portion of the predetermined pattern of light within the interactive space; and

a game device configured to

generate interest data for an object located within the interactive space based on the detected at least a portion of the predetermined pattern of light, wherein the interest data indicates the object'"'"'s level of interest in a game, wherein the game device is configured to adjust a difficulty level of the game in response to the object'"'"'s level of interest.

2. The system of claim 1, wherein the object'"'"'s level of interest in the game is based on at least determined emotion of the object or a determined level of attention of the object to the game.

3. The system of claim 1, wherein the object'"'"'s level of interest in the game is based on one or more of a position of the object, a movement of the object, a posture of the object, or a facial expression of the object.

4. The system of claim 1, wherein the game device is configured to determine whether the object is inattentive to the game and, in response to determining that the object is inattentive to the game, pause the game.

5. The system of claim 1, wherein the game device is configured to increase a difficulty level of the game upon determining that the interest data indicates the object is frustrated.

6. The system of claim 1, wherein the game device is further operative to determine one or more gestures of the object, wherein the determined one or more gestures comprises a control signal for control of a function of the game device.

7. The system of claim 6, wherein the control signal comprises a signal to change one or more of a volume, a channel, an input, or a display setting.

8. The system of claim 6, wherein the camera detecting a thumb of the object initiates a display power off control signal when the object'"'"'s thumb is pointed down.

9. The system of claim 6, wherein the camera detecting a thumb of the object initiates a display power on control signal when the thumb is pointed up.

10. A method comprising:

emitting a predetermined pattern of light into an interactive space;

detecting at least a portion of the predetermined pattern of light within the interactive space;

generating, by a computing system having one or more computer processors, interest data for an object located within the interactive space based on the detected at least a portion of the predetermined pattern of light, wherein the interest data indicates the object'"'"'s level of interest in a game; and

adjusting, by the computing system, a difficulty level of the game in response to the object'"'"'s level of interest in the game.

11. The method of claim 10, wherein the object'"'"'s level of interest in the game is based on at least a determined emotion of the object or a determined level of attention of the object to the game.

12. The method of claim 10, wherein the object'"'"'s level of interest in the game is based on one or more of a position of the object, a movement of the object, a posture of the object, or a facial expression of the object.

13. The method of claim 10, further comprising:

determining whether the object is inattentive to the game and, in response to determining that the object is inattentive to the game, pausing the game.

14. The method of claim 10, further comprising:

increasing a difficulty level of the game upon determining that the interest data indicates the object is frustrated.

15. A tangible computer readable medium having software modules including executable instructions stored thereon, wherein the software modules are configured for execution by a computing system having one or more hardware processors, the software modules including at least:

an illumination module configured to initiate emission of a predetermined pattern of light into an interactive space;

a detection module configured to analyze image data of the interactive space in order to detect at least a portion of the predetermined pattern of light within the interactive space; and

a game module configured to

generate interest data for an object located within the interactive space based on the detected at least a portion of the predetermined pattern of light, wherein the interest data indicates the object'"'"'s level of interest in a game, and

adjust a difficulty level of the game in response to the object'"'"'s level of interest in the game.

16. The tangible computer readable medium of claim 15, wherein the object'"'"'s level of interest in the game is based on at least a determined emotion of the object or a determined level of attention of the object to the game.

17. The tangible computer readable medium of claim 15, wherein the object'"'"'s level of interest in the game is based on one or more of a position of the object, a movement of the object, a posture of the object, or a facial expression of the object.

18. The tangible computer readable medium of claim 15, wherein the game module is further configured to determine whether the object is inattentive to the game and, in response to determining that the object is inattentive to the game, pause the game.

19. The tangible computer readable medium of claim 15, wherein the game module is further configured to increase a difficulty level of the game upon determining that the interest data indicates the object is frustrated.