Interactive objects for immersive environment

• US 10,067,557 B2
• Filed: 10/04/2013
• Issued: 09/04/2018
• Est. Priority Date: 10/04/2012
• Status: Active Grant

• Current Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Original Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Inventors: Schlumberger, Gabriel, Garlington, Joseph O., Leung, Theodore Wei-Yun
• Primary Examiner(s): Yen, Jason
• Application Number:
  US14/433,643
• Publication Number:
  US 20150268717A1
• Time in Patent Office: 1,796 Days
• Field of Search: None
• CPC Class Codes: A63F 13/00 Video games, i.e. games using an electronically generated display having two or more dimensions gaming systems which provide a financial reward G07F17/32
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/215 comprising means for detecting acoustic signals, e.g. using a microphone
• CPC Class Codes: A63F 13/216 using geographical information, e.g. location of the game device or player using GPS
• CPC Class Codes: A63F 13/24 Constructional details thereof, e.g. game controllers with detachable joystick handles
• CPC Class Codes: A63F 13/53 involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game
• CPC Class Codes: A63F 2300/6027 using adaptive systems learning from user actions, e.g. for skill level adjustment
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]

Abstract

Embodiments provide a system that includes a first interactive device and control logic configured to perform an operation. The operation includes receiving historical data describing historical interactions between a user and one or more interactive devices. Additionally, the operation includes configuring the first interactive device with one or more interactive events. Each interactive event includes a respective (i) stimulus event and (ii) an action to perform responsive to an occurrence of the stimulus event, and at least one of the one or more interactive events is based on the received historical data. Responsive to detecting an occurrence of a first one of the one or more stimulus events, the operation includes causing the first interactive device to perform the corresponding action. The operation also includes updating the first interactive device with a second one or more interactive events.

Claims

1. A system to implement interactive devices, the system comprising:

one or more computer processors of a first interactive device; and

control logic executable by the one or more computer processors to perform an operation, comprising;

generating historical data based on monitoring historical interactions between a user and one or more interactive devices including the first interactive device;

configuring the first interactive device with one or more interactive events, wherein each interactive event comprises (i) a respective stimulus event and (ii) a corresponding physical action to perform responsive to an occurrence of the respective stimulus event, the corresponding physical action being specific to the first interactive device, wherein at least one of the one or more interactive events is based on the historical data;

responsive to detecting an occurrence of the stimulus events of a first of the one or more interactive events, the stimulus event occurring within at least one of a virtual world and an augmented reality space, causing the first interactive device to perform the corresponding physical action and further causing a second interactive device to perform a corresponding physical action specific to the second interactive device, wherein the corresponding physical actions of the first and second interactive devices are distinct; and

subsequent to the corresponding physical action being performed by the first interactive device, updating the first interactive device with one or more additional interactive events.

2. The system of claim 1, wherein the stimulus event of the first interactive event comprises environmental audio data matching a predefined signature, wherein causing the first interactive device to perform the corresponding physical action further comprises:

collecting environmental audio data using one or more microphone device in at least one of the one or more interactive devices; and

upon determining that the environmental audio data matches the predefined signature, causing the first interactive device to perform the corresponding physical action.

3. The system of claim 1, wherein the stimulus event of the first interactive event comprises an action performed within a physical environment of the first interactive device, wherein causing the first interactive device to perform the corresponding physical action further comprises:

monitoring the physical environment of the first interactive device to detect an occurrence of the performed action.

4. The system of claim 1, wherein the historical data characterizes previous interactions between the user and the one or more interactive devices, wherein configuring a first interactive device with one or more interactive events further comprises:

determining the one or more interactive events, based on the historical data characterizing the previous interactions between the user and the one or more interactive devices.

5. The system of claim 1, wherein the stimulus event of the first interactive event comprises a defined user action, wherein causing the first interactive device to perform the corresponding physical action further comprises:

monitoring behavior of the user to detect when the user performs the defined user action; and

in response, causing the first interactive device to perform the corresponding physical action.

6. The system of claim 1, wherein the stimulus event of the first interactive event comprises the user reaching a defined location, wherein causing the first interactive device to perform the corresponding physical action further comprises:

monitoring a position of the user within a physical environment; and

upon detecting the position of the user matches the defined location, causing the first interactive device to perform the corresponding physical action.

7. The system of claim 1, wherein the stimulus event of the first interactive event comprises the interactive device coming within a predefined distance of the user, wherein causing the first interactive device to perform the corresponding physical action further comprises:

monitoring a distance between the user and the first interactive device; and

upon determining the first interactive device has come within the predefined distance of the user, causing the first interactive device to perform the corresponding physical action.

8. The system of claim 1, wherein the stimulus event of the first interactive event comprises the first interactive device reaching a defined location, wherein causing the first interactive device to perform the corresponding physical action further comprises:

monitoring a position of the first interactive device within a physical environment; and

upon detecting the position of the first interactive device matches the defined location, causing the first interactive device to perform the corresponding physical action.

9. The system of claim 1, wherein the one or more interactive events are dynamically determined based upon at least one of a time of day, a day of the week, a date, and a calendar entry.

10. The system of claim 1, wherein the at least one of the interactive events is dynamically determined based on a pattern of behavior within the historical data.

11. The system of claim 1, wherein the corresponding physical action for one of the one or more interactive events comprises at least one of:

a movement of the first interactive device, outputting a sound effect at the first interactive device, outputting dialogue at the first interactive device, and performing a visual effect at the first interactive device.

12. The system of claim 1, wherein the corresponding physical actions of the first and second interactive devices are performed in the real world, wherein the first and second interactive devices are of distinct interactive device types, wherein the operation further comprises causing a third interactive device to perform a corresponding physical action specific to the third interactive device, wherein the corresponding physical actions of the first, second, and third interactive devices are distinct.

13. The system of claim 12, wherein of the first, second, and third interactive devices, only the first interactive device serves as a controller that maintains data specifying which interactive devices are capable of reacting to each of a plurality of distinct stimulus events, wherein only the controller determines which interactive devices, capable of reacting to the stimulus event of the first interactive event, actually reacts to the stimulus event of the first interactive event, wherein the determining is based on a priority value of each reaction that each interactive device is capable of.

14. The system of claim 13, wherein the controller causes each of the first, second, and third interactive device to performing the corresponding physical action of the respective interactive device while only permitting a single one of the first, second, and third interactive device to output a corresponding audio reaction of the single interactive device, in order to preclude unintelligibility of concurrent output of corresponding audio reactions from multiple interactive devices.

15. The system of claim 14, wherein the stimulus event of the first interactive event comprises, in respective instances, (i) environmental audio data matching a predefined signature, (ii) an action performed within a physical environment of the first interactive device, (iii) a defined user action, (iv) the user reaching a defined location, (v) the first interactive device coming within a predefined distance of the user, (vi) the first interactive device reaching a defined location, and (vii) the second interactive device performing a stimulus action.

16. The system of claim 15, wherein causing the first interactive device to perform the corresponding physical action further comprises, in respective instances:

(i) collecting environmental audio data using one or more microphone device in at least one of the one or more interactive devices, wherein the environmental audio data corresponds to user speech; and

upon determining that the environmental audio data matches the predefined signature, causing the first interactive device to perform the corresponding physical action, wherein the predefined signature corresponds to one or more spoken words;

(ii) monitoring the physical environment of the first interactive device to detect an occurrence of the performed action; and

(iii) monitoring behavior of the user to detect when the user performs the defined user action; and

in response, causing the first interactive device to perform the corresponding physical action, wherein the behavior of the user is monitored based on data received from a camera device, a microphone device, and an accelerometer in each of the one or more interactive devices.

17. The system of claim 16, wherein causing the first interactive device to perform the corresponding physical action further comprises, in respective instances:

(iv) monitoring a position of the user within a physical environment; and

upon detecting the position of the user matches the defined location, causing the first interactive device to perform the corresponding physical action, wherein the position of the user within the physical environment is monitored based on data received from each of a camera device, a global positioning system (GPS) device, a distance measuring device, a distance determination algorithm, and a microphone;

(v) monitoring a distance between the user and the first interactive device; and

upon determining the first interactive device has come within the predefined distance of the user, causing the first interactive device to perform the corresponding physical action;

(vi) monitoring a position of the first interactive device within a physical environment; and

upon detecting the position of the first interactive device matches the defined location, causing the first interactive device to perform the corresponding physical action, wherein the position of the first interactive device within the physical environment is monitored based on data received from each of the camera device, the GPS device, the distance measuring device, the distance determination algorithm, and the microphone; and

(vii) upon determining the second interactive device has performed the stimulus action, causing the first interactive device to perform the corresponding physical action.

18. The system of claim 17, wherein the historical data characterizes previous interactions between the user and the one or more interactive devices, wherein configuring a first interactive device with one or more interactive events further comprises:

determining the one or more interactive events, based on the historical data characterizing the previous interactions between the user and the one or more interactive devices, wherein the action of one of the one or more interactive events is dynamically determined based on the historical data and based further on each of a time of day, a day of the week, a date, and a calendar entry, wherein the at least one of the interactive events is dynamically determined based on a pattern of behavior within the historical data;

wherein the corresponding physical action for one of the one or more interactive events comprises each of;

a movement of the first interactive device, outputting a sound effect at the first interactive device, outputting dialogue at the first interactive device, and performing a visual effect at the first interactive device.

19. A computer-implemented method to implement interactive devices, the computer-implemented method comprising:

generating historical data based on monitoring historical interactions between a user and one or more interactive devices including a first interactive device;

configuring the first interactive device with one or more interactive events, wherein each interactive event comprises (i) a respective stimulus event and (ii) a corresponding physical action to perform responsive to an occurrence of the respective stimulus event, the corresponding physical action being specific to the first interactive device, wherein at least one of the one or more interactive events are based on the historical data;

responsive to detecting an occurrence of the stimulus event of a first of the one or more interactive events, the stimulus event occurring within at least one of a virtual world and an augmented reality space, causing, by operation of one or more computer processors, the first interactive device to perform the corresponding physical action and further causing a second interactive device to perform a corresponding physical action specific to the second interactive device, wherein the corresponding physical actions of the first and second interactive devices are distinct; and

subsequent to the corresponding physical action being performed by the first interactive device, updating the first interactive device with one or more additional interactive events.

20. A non-transitory computer-readable medium containing a program that, when executed, performs an operation to implement interactive devices, the operation comprising:

generating historical data based on monitoring historical interactions between a user and one or more interactive devices including a first interactive device;

configuring the first interactive device with one or more interactive events, wherein each interactive event comprises (i) a respective stimulus event and (ii) a corresponding physical action to perform responsive to an occurrence of the respective stimulus event, the corresponding physical action being specific to the first interactive device, wherein at least one of the one or more interactive events are based on the historical data;

responsive to detecting an occurrence of the stimulus event of a first of the one or more interactive events, the stimulus event occurring within at least one of a virtual world and an augmented reality space, causing, by operation of one or more computer processors when executing the program, the first interactive device to perform the corresponding physical action and further causing a second interactive device to perform a corresponding physical action specific to the second interactive device, wherein the corresponding physical actions of the first and second interactive devices are distinct; and

subsequent to the corresponding physical action being performed by the first interactive device, updating the first interactive device with one or more additional interactive events.