Storytelling environment: mapping virtual settings to physical locations

• US 10,369,487 B2
• Filed: 02/11/2016
• Issued: 08/06/2019
• Est. Priority Date: 02/11/2016
• Status: Active Grant

• Current Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Original Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Inventors: Goslin, Michael P., Bassett, Katherine M., Haseltine, Eric C., Olson, Joseph Logan
• Primary Examiner(s): Fernstrom, Kurt
• Application Number:
  US15/041,615
• Publication Number:
  US 20170232358A1
• Time in Patent Office: 1,272 Days
• Field of Search: 434 1, 434 2, 434 4, 434308, 434309, 446297, 446484, 463 1, 463 9, 463 30, 463 36, 463 39, 463 40
• CPC Class Codes: A63H 17/32 Acoustical or optical signalling devices
• CPC Class Codes: A63H 17/34 Arrangements for imitating the noise of motors
• CPC Class Codes: A63H 2200/00 Computerized interactive toys, e.g. dolls
• CPC Class Codes: A63H 3/28 Arrangements of sound-producing means in dolls; Means in dolls for producing sounds
• CPC Class Codes: A63H 33/26 Magnetic or electric toys electric drives A63H29/22 ; indoor games played with small balls using magnetic power A63F7/0088, A63F7/068
• CPC Class Codes: A63H 33/42 Toy models or toy scenery not otherwise covered models or scenery for general purposes G09B
• CPC Class Codes: G09B 5/06 with both visual and audible presentation of the material to be studied

Abstract

A method, computer-readable medium, and system are disclosed for an interactive storytelling environment. The method comprises identifying a plurality of storytelling devices available to participate in a storytelling experience, at least one of the plurality of the storytelling devices comprising a first beacon device. The method further comprises beginning playback of a first story of the storytelling experience, the first story comprising a first plurality of predetermined actions associated with a predetermined first virtual setting, the first virtual setting mapped to the first beacon device. The method further comprises determining a location of a user using the first beacon device, and during playback of the first story and using at least one of the plurality of storytelling devices, producing one or more of the at least one audiovisual effect corresponding to the first virtual setting based on the determined location of the user.

Claims

1. A method, comprising:

identifying a plurality of storytelling devices in a plurality of distinct physical locations available to participate in a storytelling experience, wherein the storytelling experience comprises two or more predetermined virtual settings assigned to each of the plurality of distinct locations, each of the plurality of storytelling devices comprising an electronic device configured to perform at least one audiovisual effect, at least one of the plurality of storytelling devices comprising a first beacon device in a first distinct physical location and a second beacon device in a second distinct physical location;

beginning playback of a first story of the storytelling experience, the first story comprising a first plurality of predetermined actions associated with a predetermined first virtual setting of the two or more predetermined virtual settings and a second plurality of predetermined actions associated with a predetermined second virtual setting of the two or more predetermined virtual settings, wherein the first plurality of predetermined actions and the second plurality of predetermined actions comprise one or more overlapping actions associated with the predetermined first virtual setting and the predetermined second virtual setting of the first story, wherein the predetermined first virtual setting is associated with the first beacon device, wherein each of the first plurality of predetermined actions is mapped to a corresponding one of the plurality of storytelling devices, wherein the predetermined second virtual setting is associated with the second beacon device, wherein each of the second plurality of predetermined actions is mapped to a corresponding one of the plurality of storytelling devices;

determining, using the first beacon device, a first local location of a user within the first distinct physical location;

during playback of the first story and using at least one of the plurality of storytelling devices, producing one or more of the at least one audiovisual effect corresponding to the first plurality of predetermined actions and the overlapping actions of the first virtual setting based on the first local location of the user;

determining, using the second beacon device, a second local location of the user within the second distinct physical location; and

during playback of the first story and using at least one of the plurality of storytelling devices, producing at least one of the one or more of the at least one audiovisual effect corresponding to the second plurality of predetermined actions and overlapping actions of the second virtual setting based on the second local location of the user.

2. The method of claim 1, wherein the plurality of storytelling devices comprises a display device, wherein producing one or more audiovisual effects corresponding to the first story setting comprises displaying one or more predetermined visual elements associated with the first story setting using the display device.

3. The method of claim 1, wherein the plurality of storytelling devices comprises an audio output device, wherein producing one or more audiovisual effects corresponding to the first story setting comprises producing one or more predetermined audio elements associated with the first story setting using the audio output device.

4. The method of claim 3, wherein determining the location of the user comprises determining an initial location and a subsequent location of the user, the method further comprising at least one of:

increasing a volume of the produced one or more predetermined audio elements when the subsequent location indicates that the user is approaching the first beacon device, and

decreasing the volume of the produced one or more predetermined audio elements when the subsequent location indicates that the user is leaving the first beacon device.

5. The method of claim 1,

wherein producing the one or more audiovisual effects corresponding to the first virtual setting comprises:

selecting, based on the determined location of the user, the first virtual setting during playback of the story upon determining that the user is closer to the first local location than the second local location.

6. The method of claim 1, wherein the plurality of storytelling devices comprises a device that is body-worn or carried by the user, wherein the location of the user is determined based on a signal received from the body-worn or carried device.

7. The method of claim 6, wherein determining the location of the user comprises one of measuring a signal strength of a received signal from the body-worn or carried device, and performing optical range detection based on a reflected signal from the body-worn or carried device.

8. A non-transitory computer-readable medium comprising computer program code that, when executed by operation of one or more computer processors, performs an operation comprising:

identifying a plurality of storytelling devices in a plurality of distinct locations available to participate in a storytelling experience, wherein the storytelling experience comprises two or more predetermined virtual settings, where at least one predetermined virtual setting is assigned to each of the plurality of distinct locations, each of the plurality of storytelling devices comprising an electronic device configured to perform at least one audiovisual effect, at least one of the plurality of storytelling devices comprising a first beacon device in a first distinct physical location and a second beacon device in a second distinct physical location;

beginning playback of a first story of the storytelling experience, the first story comprising a first plurality of predetermined actions associated with a predetermined first virtual setting of the two or more predetermined virtual settings and a second plurality of predetermined actions associated with a predetermined second virtual setting of the two or more predetermined virtual settings, wherein the first plurality of predetermined actions and the second plurality of predetermined actions comprise one or more overlapping actions associated with the predetermined first virtual setting and the predetermined second virtual setting of the first story, wherein the predetermined first virtual setting is associated with the first beacon device, wherein each of the first plurality of predetermined actions is mapped to a corresponding one of the plurality of storytelling devices, wherein the predetermined second virtual setting is associated with the second beacon device, wherein each of the second plurality of predetermined actions is mapped to a corresponding one of the plurality of storytelling devices;

determining, using the first beacon device, a first local location of a user within the first distinct physical location;

during playback of the first story and using at least one of the plurality of storytelling devices, producing one or more of the at least one audiovisual effect corresponding to the first plurality of predetermined actions and the overlapping actions of the first virtual setting based on the first local location of the user;

determining, using the second beacon device, a second local location of the user within the second distinct physical location; and

during playback of the first story and using at least one of the plurality of storytelling devices, producing at least one of the one or more of the at least one audiovisual effect corresponding to the second plurality of predetermined actions and overlapping actions of the second virtual setting based on the second local location of the user.

9. The computer-readable medium of claim 8, wherein the plurality of storytelling devices comprises a display device, wherein producing one or more audiovisual effects corresponding to the first story setting comprises displaying one or more predetermined visual elements associated with the first story setting using the display device.

10. The computer-readable medium of claim 8, wherein the plurality of storytelling devices comprises an audio output device, wherein producing one or more audiovisual effects corresponding to the first story setting comprises producing one or more predetermined audio elements associated with the first story setting using the audio output device.

11. The computer-readable medium of claim 10, wherein determining the location of the user comprises determining an initial location and a subsequent location of the user, the operation further comprising at least one of:

increasing a volume of the produced one or more predetermined audio elements when the subsequent location indicates that the user is approaching the first beacon device, and

decreasing the volume of the produced one or more predetermined audio elements when the subsequent location indicates that the user is leaving the first beacon device.

12. The computer-readable medium of claim 8,

wherein producing the one or more audiovisual effects corresponding to the first virtual setting comprises:

selecting, based on the determined location of the user, the first virtual setting during playback of the story upon determining that the user is closer to the first local location than the second local location.

13. The computer-readable medium of claim 8, wherein the plurality of storytelling devices comprises a device that is body-worn or carried by the user, wherein the location of the user is determined based on a signal received from the body-worn or carried device.

14. The computer-readable medium of claim 13, wherein determining the location of the user comprises one of measuring a signal strength of a received signal from the body-worn or carried device, and performing optical range detection based on a reflected signal from the body-worn or carried device.

15. A system, comprising:

a plurality of storytelling devices in a plurality of distinct locations, each of the plurality of storytelling devices comprising an electronic device configured to perform at least one audiovisual effect, at least one of the plurality of the storytelling devices comprising a first beacon device; and

control logic configured to perform an operation comprising;

identifying a plurality of storytelling devices in a plurality of locations available to participate in a storytelling experience, wherein the storytelling experience comprises two or more predetermined virtual settings, where at least one predetermined virtual setting is assigned to each of the plurality of distinct locations, each of the plurality of storytelling devices comprising an electronic device configured to perform at least one audiovisual effect, at least one of the plurality of storytelling devices comprising a first beacon device in a first distinct physical location and a second beacon device in a second distinct physical location;

beginning playback of a first story of the storytelling experience, the first story comprising a first plurality of predetermined actions associated with a predetermined first virtual setting of the one or more predetermined virtual settings and a second plurality of predetermined actions associated with a predetermined second virtual setting of the two or more predetermined virtual settings, wherein the first plurality of predetermined actions and the second plurality of predetermined actions comprise one or more overlapping actions associated with the first virtual setting and the second virtual setting of the first story, wherein the predetermined first virtual setting is associated with the first beacon device, wherein each of the first plurality of predetermined actions is mapped to a corresponding one of the plurality of storytelling devices, wherein the predetermined second virtual setting is associated with the second beacon device, wherein each of the second plurality of predetermined actions is mapped to a corresponding one of the plurality of storytelling devices;

determining, using the first beacon device, a first local location of a user within the first distinct physical location;

during playback of the first story and using at least one of the plurality of storytelling devices, producing one or more of the at least one audiovisual effect corresponding to the first plurality of predetermined actions and the overlapping actions of the first virtual setting based on the first local location of the user;

determining, using the second beacon device, a second local location of the user within the second distinct physical location; and

during playback of the first story and using at least one of the plurality of storytelling devices, producing at least one of the one or more of the at least one audiovisual effect corresponding to the second plurality of predetermined actions and overlapping actions of the second virtual setting based on the second local location of the user.

16. The system of claim 15, wherein the plurality of storytelling devices comprises a display device, wherein producing one or more audiovisual effects corresponding to the first story setting comprises displaying one or more predetermined visual elements associated with the first story setting using the display device.

17. The system of claim 15, wherein the plurality of storytelling devices comprises an audio output device, wherein producing one or more audiovisual effects corresponding to the first story setting comprises producing one or more predetermined audio elements associated with the first story setting using the audio output device.

18. The system of claim 17, wherein determining the location of the user comprises determining an initial location and a subsequent location of the user, the operation further comprising at least one of:

increasing a volume of the produced one or more predetermined audio elements when the subsequent location indicates that the user is approaching the first beacon device, and

decreasing the volume of the produced one or more predetermined audio elements when the subsequent location indicates that the user is leaving the first beacon device.

19. The system of claim 15,

wherein producing the one or more audiovisual effects corresponding to the first virtual setting comprises:

selecting, based on the determined location of the user, the first virtual setting during playback of the story upon determining that the user is closer to the first local location than the second local location.

20. The system of claim 15, wherein the plurality of storytelling devices comprises a device that is body-worn or carried by the user, wherein the location of the user is determined based on a signal received from the body-worn or carried device.