Systems and methods for determining functionality of a display device based on position, orientation or motion

• US 10,076,703 B2
• Filed: 11/30/2016
• Issued: 09/18/2018
• Est. Priority Date: 02/05/2010
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Inventors: Mao, Xiaodong, Rimon, Noam
• Primary Examiner(s): Laneau, Ronald
• Application Number:
  US15/365,622
• Publication Number:
  US 20170080341A1
• Time in Patent Office: 657 Days
• Field of Search: None
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/214 for locating contacts on a surface, e.g. floor mats or touch pads
• CPC Class Codes: A63F 13/215 comprising means for detecting acoustic signals, e.g. using a microphone
• CPC Class Codes: A63F 13/218 using pressure sensors, e.g. generating a signal proportional to the pressure applied by the player
• CPC Class Codes: A63F 13/25 Output arrangements for video game devices
• CPC Class Codes: A63F 13/285 Generating tactile feedback signals via the game input device, e.g. force feedback
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: A63F 13/843 involving concurrently two or more players on the same game device, e.g. requiring the use of a plurality of controllers or of a specific view of game data for each player
• CPC Class Codes: A63F 2300/538 for performing operations on behalf of the game client, e.g. rendering
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0317 in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors

Abstract

A system for interfacing with an interactive program is provided, including: a computing device for executing the interactive program, the interactive program being stored on a memory, the computing device enabling user control and input; a display device for rendering image content associated with an interactive program, the display device being configured to be attached to the user; wherein the computing device is configured to receive data from an image capture device to determine and track a position of the display device; wherein the computing device is configured to define at least two interactive zones, each interactive zone being defined by a spatial region configured to change a function of the display device when the display device is moved between the at least two interactive zones; and wherein the computing device is configured to set the function of the display device.

Claims

1. A system for interfacing with an interactive program, comprising:

a computing device for executing the interactive program, the interactive program being stored on a memory, the computing device enabling user control and input;

a display device for rendering image content associated with an interactive program, the display device being configured to be attached to the user;

wherein the computing device is configured to receive data from an image capture device to determine and track a position of the display device;

wherein the computing device is configured to define at least two interactive zones, each interactive zone being defined by a spatial region configured to change a function of the display device when the display device is moved between the at least two interactive zones; and

wherein the computing device is configured to set the function of the display device.

2. The system of claim 1,

wherein one of the interactive zones is a designated zone for the display device;

wherein when the display device is determined to have moved outside of the designated zone, then the computing device is configured to render an indicator via the display device.

3. The system of claim 2, wherein the indicator is a warning or visual indicator presented on the display device.

4. The system of claim 2, wherein the indicator is an audio signal rendered via the display device.

5. The system of claim 1, wherein the display device includes a harness for attaching the display device to the user.

6. The system of claim 1, wherein the interactive zones are dynamically determined according to a state of the interactive program.

7. The system of claim 1,

wherein the image capture device is integrated with the display device and configured to capture images of an interactive environment;

and

wherein determining the position of the display device is based on a perspective distortion in the captured images.

8. A display device for enabling user control and providing input to an interactive program, the interactive program being stored on a memory, the interactive program being executed by a computing device, the display device comprising:

a harness for attaching the display device to the user;

a communications module for communications with the computing device;

at least one sensor for detecting position or motion of the display device;

a display screen;

wherein the display device is configured to be operated within at least two interactive zones, each interactive zone being defined by a spatial region configured to change a function of the display device when the display device is moved between the at least two interactive zones.

9. The display device of claim 8,

wherein one of the interactive zones is a designated zone for the display device;

wherein when the display device is determined to have moved outside of the designated zone, then the computing device is configured to render an indicator via the display device.

10. The display device of claim 9, wherein the indicator is a warning or visual indicator presented on the display device.

11. The display device of claim 9, wherein the indicator is an audio signal rendered via the display device.

12. The display device of claim 8, wherein the interactive zones are dynamically determined according to a state of the interactive program.

13. The display device of claim 8, wherein each specified function is operable for causing an action or selecting an option within the interactive program.

14. The display device of claim 8, wherein the function of the display device is an input received from the user of the display device and communicated from the display device to the interactive program.

15. The display device of claim 8, further comprising:

an image capture device configured to capture images of an interactive environment; and

wherein the position of the display device is determined based on a perspective distortion in the captured images.

16. The display device of claim 8, wherein the at least one sensor includes at least one inertial sensor for detecting position or motion of the display device.

17. A system for interfacing with an interactive program, comprising:

a computing device for executing the interactive program, the interactive program being stored on a memory;

a display device for rendering image content associated with an interactive program;

a controller device enabling user control and input for the interactive program;

wherein the computing device is configured to receive data from an image capture device to determine and track a position of the controller device;

wherein the computing device is configured to define at least two interactive zones, each interactive zone being defined by a spatial region, wherein one of the interactive zones is a designated zone for the display device;

wherein when the controller device is determined to have moved outside of the designated zone, then the computing device is configured to render an indicator via the display device.

18. The system of claim 17, wherein the indicator is a warning or visual indicator presented on the display device.

19. The system of claim 17, wherein the indicator is an audio signal rendered via the display device.

20. The system of claim 17, wherein the display device includes a harness for attaching the display device to the user.