Augmented ride system and method

• US 10,528,123 B2
• Filed: 03/01/2018
• Issued: 01/07/2020
• Est. Priority Date: 03/06/2017
• Status: Active Grant

• Current Assignee: Universal City Studios LLC (Comcast Corporation)
• Original Assignee: Universal City Studios LLC (Comcast Corporation)
• Inventors: McCracken, Sean David, Schwartz, Justin Michael, Geraghty, Thomas Martin
• Primary Examiner(s): Nguyen, Vu
• Application Number:
  US15/909,694
• Publication Number:
  US 20180253141A1
• Time in Patent Office: 677 Days
• Field of Search: None
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/245 specially adapted to a particular type of game, e.g. steering wheels
• CPC Class Codes: A63F 13/25 Output arrangements for video game devices
• CPC Class Codes: A63F 13/26 having at least one additional display device, e.g. on the game controller or outside a game booth
• CPC Class Codes: A63F 13/30 Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
• CPC Class Codes: A63F 13/355 Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
• CPC Class Codes: A63F 13/5255 according to dedicated instructions from a player, e.g. using a secondary joystick to rotate the camera around a player's character
• CPC Class Codes: A63F 13/837 Shooting of targets
• CPC Class Codes: A63F 13/843 involving concurrently two or more players on the same game device, e.g. requiring the use of a plurality of controllers or of a specific view of game data for each player
• CPC Class Codes: A63F 2300/6653 for altering the visibility of an object, e.g. preventing the occlusion of an object, partially hiding an object
• CPC Class Codes: A63G 27/00 Russian swings; Great wheels, e.g. Ferris wheels
• CPC Class Codes: A63G 31/00 Amusement arrangements hoop exercising apparatus driven by the user A63B19/00
• CPC Class Codes: A63G 31/16 creating illusions of travel
• CPC Class Codes: A63G 7/00 Up-and-down hill tracks; Switchbacks
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 2027/0145 creating an intermediate image
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/0101 : characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: G02B 27/017 : Head mounted
• CPC Class Codes: G02B 27/0172 : characterised by optical features
• CPC Class Codes: G06F 1/163 : Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 2203/04806 : Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/011 : Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 : Head tracking input arrangements
• CPC Class Codes: G06F 3/04815 : Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04845 : for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06T 19/006 : Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2219/024 : Multi-user, collaborative environment
• CPC Class Codes: H04N 13/344 : with head-mounted left-right displays

Abstract

A ride system includes a ride vehicle configured to accommodate a passenger and travel along a ride path during a ride in an amusement park, a head mounted display connected to the ride vehicle and configured to be worn by the passenger, and a ride and game control system integrated with the ride vehicle and configured to coordinate a ride experience of the passenger with events occurring during the ride using at least the head mounted display and the ride vehicle. The ride and game control system includes a user interface, a ride controller, and a monitoring system. The ride and game control system also includes a computer graphics generation system communicatively coupled to the head mounted display and configured to selectively generate AR features for display on the head mounted display based on data received from the ride controller, the monitoring system, the user interface, or any combination thereof.

Claims

1. A ride system, comprising:

a ride vehicle configured to accommodate a passenger and to travel along a ride path during a ride in an amusement park;

a head mounted display connected to the ride vehicle and configured to be worn by the passenger; and

a tide and game control system integrated with the ride vehicle and configured to coordinate a ride experience of the passenger with events occurring during the ride using at least the head mounted display and the ride vehicle, wherein the ride and game control system comprises;

a user interface configured to receive inputs from the passenger;

a ride controller configured to control physical operation of the ride vehicle based at least on data relating to operational parameters of the ride vehicle and the inputs from the passenger;

a monitoring system configured to monitor at least a position and an orientation of the head mounted display, a position and an orientation of the ride vehicle, or a combination thereof; and

a computer graphics generation system communicatively coupled to the head mounted display and configured to selectively generate augmented reality (AR) features for display on the head mounted display based on data received from the ride controller, the monitoring system, the user interface, or any combination thereof, and to provide a specific AR experience associated with a particular real-world feature to the passenger in response to a determination that more than a threshold number of additional passengers in the tide vehicle are gazing at the particular real-world feature.

2. The ride system of claim 1, wherein the computer graphics generation system is configured to selectively generate the AR features based at least on data indicative of the position, a yaw, and a velocity of the ride vehicle received from the monitoring system.

3. The ride system of claim 1, wherein the monitoring system comprises one or more orientation and position sensors, one or more motion tracking sensors, one or more inertial measurement units, one or more presence sensors, or a combination thereof.

4. The ride system of claim 1, wherein the computer graphics generation system is configured to perform perspective adjustments to the AR features in response to determining that the passenger has an obstructed field of view.

5. The ride system of claim 4, wherein the computer graphics generation system is configured to perform perspective adjustments to the AR features so that the passenger has an unobstructed view of the AR features.

6. The ride system of claim 1, wherein the ride and game control system is configured to provide a unique AR experience to the passenger that corresponds to identifying information relating to the passenger.

7. The ride system of claim 1, wherein the computer graphics generation system is configured to generate the AR features based on simulations of one or more physics models and a digital three-dimensional model of an environment surrounding the ride vehicle.

8. The ride system of claim 1, comprising a show effect system communicatively coupled to the ride and game control system, wherein the show effect system comprises a display device and a lighting system disposed along the ride path.

9. The ride system of claim 8, wherein the show effect system is configured to change operation of the display device, operation of the lighting system, or both, based on data from the ride controller, the monitoring system, the user interface, or a combination thereof.

10. A method, comprising:

receiving and analyzing data via a ride and game control system integrated with a ride vehicle configured to accommodate one or more passengers, wherein the ride vehicle is configured to travel along a ride path during a ride in an amusement park, and wherein the data relates to the one or more passengers, the ride vehicle, or both;

determining, via the ride and game control system, whether a first real-world object in an environment surrounding the ride vehicle is at least partially occluded to a respective passenger of the one or more passengers by a second real-world object in the environment based on the data;

generating, via a computer graphics generation system of the ride and game control system, gaming effects based on the data, wherein the gaming effects comprise augmented reality (AR) graphics of the first real-world object generated in response to identification that the first real-world object is at least partially occluded to the respective passenger; and

transmitting, via the computer graphics generation system, the AR graphics of the first real-world object for display on a head mounted display configured to be worn by the respective passenger in the tide vehicle to perform a perspective adjustment for the respective passenger by overlaying the AR graphics of the first real-world object onto a field of view of the respective passenger such that the AR graphics of the first real-world object are overlaid onto the second real-world object, the environment or both.

11. The method of claim 10, wherein receiving the data comprises receiving real-time data collected via one or more orientation and position sensors, one or more motion tracking sensors, one or more inertial measurement units, one or more presence sensors, or any combination thereof.

12. The method of claim 10, comprising displaying, via the head mounted display, the AR graphics on one or more displays of the head mounted display, wherein the head mounted display is physically coupled to the ride vehicle.

13. The method of claim 10, wherein generating the gaming effects comprises generating the AR graphics based on simulations of one or more physics models and a digital three-dimensional model of the environment surrounding the ride vehicle.

14. The method of claim 10, comprising displaying visualization graphics on one or more displays disposed along the ride path, changing operation of one or more lighting systems disposed along the ride path, or both, based on the data, using a show effect system in communication with the ride and game control system, wherein the show effect system is separate from the ride vehicle.

15. A ride and game control system physically integrated with a ride vehicle configured to carry a passenger along a ride path, the ride and game control system comprising:

a ride controller configured to receive real-time data related to an input control state from at least a user interface and to receive data related to operational parameters of the ride vehicle;

a game controller communicatively coupled to the ride controller and configured to push updates relating to the input control state and at least one of the operational parameters to features of the ride vehicle; and

a computer graphics generation system communicatively coupled to the game controller and to a head mounted display configured to be worn by the passenger, wherein the computer graphics generation system is configured to selectively render augmented reality (AR) graphics for display on the head mounted display based at least on the updates from the game controller, and wherein the game controller is configured to adjust a lighting system disposed along the ride path based on the AR graphics and a gaze direction of the passenger to accentuate the AR graphics as overlaid onto a field of view of the passenger by the head mounted display.

16. The ride and game control system of claim 15, wherein the ride vehicle is configured to carry multiple passengers along the ride path, and wherein the ride and game control system comprises multiple computer graphics generation systems that are each configured to receive the updates from the game controller to render corresponding AR graphics that are unique to a perspective of each passenger of the multiple passengers for display on respective head mounted displays of the multiple passengers.

17. The ride and game control system of claim 16, wherein the game controller is configured to:

provide a summed game state of the ride vehicle to a server located off-board of the ride vehicle; and

provide scene-specific gaming events to a projection game computer or a show effect system, or both, located off-board of the ride vehicle.

18. The ride and game control system of claim 15, comprising a monitoring system having one or more orientation and position sensors, one or more motion tracking sensors, one or more inertial measurement units, one or more presence sensors, or a combination thereof, wherein the monitoring system is configured to provide feedback to the game controller, the feedback indicative of the gaze direction of the passenger.