Virtual hotel room entertainment where rooms can be chosen based upon VR entertainment

• US 10,304,249 B2
• Filed: 02/21/2017
• Issued: 05/28/2019
• Est. Priority Date: 02/21/2017
• Status: Expired due to Fees

• Current Assignee: Panasonic Intellectual Property Management Co., Ltd. (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Intellectual Property Management Co., Ltd. (Panasonic Holdings Corporation)
• Inventors: Cronin, John, D'Andrea, Michael Glynn, Kunz, Justin, Morisaki, Kota
• Primary Examiner(s): Poon, King Y
• Assistant Examiner(s): Peren, Vincent
• Application Number:
  US15/438,050
• Publication Number:
  US 20180240274A1
• Time in Patent Office: 826 Days
• Field of Search: 345419
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06Q 10/02 Reservations, e.g. for tickets, services or events
• CPC Class Codes: G06Q 50/12 Hotels or restaurants
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: H04N 9/3179 Video signal processing therefor
• CPC Class Codes: H04N 9/3194 including sensor feedback

Abstract

Various methods, systems and media for enhancing a resort hotel service using virtual reality are provided. A reservation for a hotel room with a designated room theme is acquired, and the hotel room reservation with the designated room theme is stored in a first database. Data relating to objects in the reserved hotel room and dimensions of the objects are extracted from a second database. Theme projection information corresponding to the designated room theme is extracted from a third database. A projection is displayed in the reserved hotel room using a projector and a three-dimensional modeling tool, based on the extracted data relating to the objects in the reserved hotel room, the dimensions of the objects, and the extracted theme projection information.

Claims

1. A system for enhancing a service using virtual reality, the system comprising:

a projector disposed in an area;

a database that stores theme projection information for each of a plurality of designated themes for enhancing the service using the virtual reality;

a processor;

a memory storing instructions that, when executed by the processor, cause the processor to perform operations including;

identifying the area of the service to be enhanced using the virtual reality and one of the plurality of designated themes;

identifying at least one object in the area, the at least one object to be enhanced using the virtual reality;

acquiring a position and dimensions of the at least one object in the area;

extracting, from the database, the theme projection information corresponding to the one of the plurality of designated themes; and

projecting, with the projector, the virtual reality on the at least one object using a three-dimensional modeling tool based on the position and the dimensions of the at least one object and the theme projection information corresponding to the one of the plurality of designated themes; and

a position sensor disposed on the at least one object,

wherein the acquiring of the position and the dimensions of the at least one object includes determining at least one of the position and the dimensions of the at least one object in real-time, and

the processor determines at least the position of the at least one object in real-time using the position sensor.

2. A system for enhancing a service using virtual reality, the system comprising:

a projector disposed in an area;

a pressure sensor disposed in the area;

a database that stores theme projection information for each of a plurality of designated themes for enhancing the service using the virtual reality;

a processor; and

a memory storing instructions that, when executed by the processor, cause the processor to perform operations including;

identifying the area of the service to be enhanced using the virtual reality and one of the plurality of designated themes;

identifying at least one object in the area, the at least one object to be enhanced using the virtual reality;

acquiring a position and dimensions of the at least one object in the area;

extracting, from the database, the theme projection information corresponding to the one of the plurality of designated themes; and

projecting, with the projector, the virtual reality on the at least one object using a three-dimensional modeling tool based on the position and the dimensions of the at least one object and the theme projection information corresponding to the one of the plurality of designated themes,

wherein the acquiring of the position and the dimensions of the at least one object includes determining at least one of the position and the dimensions of the at least one object in real-time, and

the processor determines at least the position of the at least one object in real-time using the pressure sensor.

3. A system for enhancing a service using virtual reality, the system comprising:

a projector disposed in an area;

an optical sensor disposed in the area;

a database that stores theme projection information for each of a plurality of designated themes for enhancing the service using the virtual reality;

a processor; and

a memory storing instructions that, when executed by the processor, cause the processor to perform operations including;

identifying the area of the service to be enhanced using the virtual reality and one of the plurality of designated themes;

identifying at least one object in the area, the at least one object to be enhanced using the virtual reality;

acquiring a position and dimensions of the at least one object in the area;

extracting, from the database, the theme projection information corresponding to the one of the plurality of designated themes; and

projecting, with the projector, the virtual reality on the at least one object using a three-dimensional modeling tool based on the position and the dimensions of the at least one object and the theme projection information corresponding to the one of the plurality of designated themes,

wherein the acquiring of the position and the dimensions of the at least one object includes determining at least one of the position and the dimensions of the at least one object in real-time, and

the processor determines at least the position of the at least one object in real-time using the optical sensor.

4. A system for enhancing a service using virtual reality, the system comprising:

a projector disposed in an area;

an infrared camera disposed in the area;

a database that stores theme projection information for each of a plurality of designated themes for enhancing the service using the virtual reality;

a processor; and

a memory storing instructions that, when executed by the processor, cause the processor to perform operations including;

identifying the area of the service to be enhanced using the virtual reality and one of the plurality of designated themes;

identifying at least one object in the area, the at least one object to be enhanced using the virtual reality;

acquiring a position and dimensions of the at least one object in the area;

extracting, from the database, the theme projection information corresponding to the one of the plurality of designated themes;

projecting, with the projector, the virtual reality on the at least one object using a three-dimensional modeling tool based on the position and the dimensions of the at least one object and the theme projection information corresponding to the one of the plurality of designated themes;

detecting, using the infrared camera, a predetermined relationship between a guest in the area and the virtual reality projected on the at least one object; and

modifying the virtual reality projected on the at least one object in response to the detecting of the predetermined relationship.

5. A system for enhancing a service using virtual reality, the system comprising:

a projector disposed in an area;

a database that stores theme projection information for each of a plurality of designated themes for enhancing the service using the virtual reality;

a processor;

a memory storing instructions that, when executed by the processor, cause the processor to perform operations including;

identifying the area of the service to be enhanced using the virtual reality and one of the plurality of designated themes;

identifying at least one object in the area, the at least one object to be enhanced using the virtual reality;

acquiring a position and dimensions of the at least one object in the area;

extracting, from the database, the theme projection information corresponding to the one of the plurality of designated themes; and

projecting, with the projector, the virtual reality on the at least one object using a three-dimensional modeling tool based on the position and the dimensions of the at least one object and the theme projection information corresponding to the one of the plurality of designated themes; and

a humidifier disposed in the area in a predetermined relationship with the at least one object, the humidifier configured to release water vapor in the area,

wherein the projector projects the virtual reality on the water vapor.

6. A system for enhancing a service using virtual reality, the system comprising:

a projector disposed in an area;

a thermostat disposed in the area;

a database that stores theme projection information for each of a plurality of designated themes for enhancing the service using the virtual reality;

a processor; and

a memory storing instructions that, when executed by the processor, cause the processor to perform operations including;

identifying the area of the service to be enhanced using the virtual reality and one of the plurality of designated themes;

identifying at least one object in the area, the at least one object to be enhanced using the virtual reality;

acquiring a position and dimensions of the at least one object in the area;

extracting, from the database, the theme projection information corresponding to the one of the plurality of designated themes;

projecting, with the projector, the virtual reality on the at least one object using a three-dimensional modeling tool based on the position and the dimensions of the at least one object and the theme projection information corresponding to the one of the plurality of designated themes; and

controlling a setting of the thermostat in accordance with the one of the plurality of designated themes.

7. A system for enhancing a service using virtual reality, the system comprising:

a projector disposed in an area;

a database that stores theme projection information for each of a plurality of designated themes for enhancing the service using the virtual reality;

a processor; and

a memory storing instructions that, when executed by the processor, cause the processor to perform operations including;

identifying the area of the service to be enhanced using the virtual reality and one of the plurality of designated themes;

identifying at least one object in the area, the at least one object to be enhanced using the virtual reality;

acquiring a position and dimensions of the at least one object in the area;

extracting, from the database, the theme projection information corresponding to the one of the plurality of designated themes; and

projecting, with the projector, the virtual reality on the at least one object using a three-dimensional modeling tool based on the position and the dimensions of the at least one object and the theme projection information corresponding to the one of the plurality of designated themes,

wherein the processor identifies the area of the service to be enhanced based on an order being placed through a meal delivery system, and

the processor identifies the one of the plurality of designated themes based on the order.

8. A system for enhancing a service using virtual reality, the system comprising:

a projector disposed in an area;

a second projector disposed in a second area different than the area in which the projector is disposed, the second area including an attraction;

a proximity sensor disposed in the area, the proximity sensor configured to detect a presence of a guest in the area;

a second proximity sensor disposed in the second area, the second proximity sensor configured to detect the presence of the guest in the second area;

a database that stores theme projection information for each of a plurality of designated themes for enhancing the service using the virtual reality;

a processor; and

a memory storing instructions that, when executed by the processor, cause the processor to perform operations including;

identifying the area of the service to be enhanced using the virtual reality and one of the plurality of designated themes;

identifying at least one object in the area, the at least one object to be enhanced using the virtual reality;

acquiring a position and dimensions of the at least one object in the area;

extracting, from the database, the theme projection information corresponding to the one of the plurality of designated themes; and

projecting, with the projector, the virtual reality on the at least one object using a three-dimensional modeling tool based on the position and the dimensions of the at least one object and the theme projection information corresponding to the one of the plurality of designated themes;

controlling the projecting of the virtual reality on the at least one object based on a detection of the presence of the guest in the area by the proximity sensor; and

controlling a theme of the attraction in accordance with the one of the plurality of designated themes based on a detection of the presence of the guest in the second area by the second proximity sensor.

9. A system for enhancing a service using virtual reality, the system comprising:

a projector disposed in an area;

a database that stores theme projection information for each of a plurality of designated themes for enhancing the service using the virtual reality;

a processor; and

a memory storing instructions that, when executed by the processor, cause the processor to perform operations including;

identifying the area of the service to be enhanced using the virtual reality and one of the plurality of designated themes;

identifying at least one object in the area, the at least one object to be enhanced using the virtual reality;

acquiring a position and dimensions of the at least one object in the area;

extracting, from the database, the theme projection information corresponding to the one of the plurality of designated themes; and

projecting, with the projector, the virtual reality on the at least one object using a three-dimensional modeling tool based on the position and the dimensions of the at least one object and the theme projection information corresponding to the one of the plurality of designated themes,

wherein the virtual reality projected on the at least one object is configured to be viewed by a guest using a headset.

10. A system for enhancing a service using virtual reality, the system comprising:

a projector disposed in an area;

a fragrance emitter disposed in the area;

a database that stores theme projection information for each of a plurality of designated themes for enhancing the service using the virtual reality;

a processor; and

a memory storing instructions that, when executed by the processor, cause the processor to perform operations including;

identifying the area of the service to be enhanced using the virtual reality and one of the plurality of designated themes;

identifying at least one object in the area, the at least one object to be enhanced using the virtual reality;

acquiring a position and dimensions of the at least one object in the area;

extracting, from the database, the theme projection information corresponding to the one of the plurality of designated themes;

projecting, with the projector, the virtual reality on the at least one object using a three-dimensional modeling tool based on the position and the dimensions of the at least one object and the theme projection information corresponding to the one of the plurality of designated themes; and

controlling the fragrance emitter to emit a fragrance in accordance with the one of the plurality of designated themes.

11. A system for enhancing a service using virtual reality, the system comprising:

a projector disposed in an area;

a faucet disposed in the area;

a database that stores theme projection information for each of a plurality of designated themes for enhancing the service using the virtual reality;

a processor; and

a memory storing instructions that, when executed by the processor, cause the processor to perform operations including;

identifying the area of the service to be enhanced using the virtual reality and one of the plurality of designated themes;

identifying at least one object in the area, the at least one object to be enhanced using the virtual reality;

acquiring a position and dimensions of the at least one object in the area;

extracting, from the database, the theme projection information corresponding to the one of the plurality of designated themes;

projecting, with the projector, the virtual reality on the at least one object using a three-dimensional modeling tool based on the position and the dimensions of the at least one object and the theme projection information corresponding to the one of the plurality of designated themes; and

controlling the faucet to change at least one of a color of light emitted by the faucet, a spray pattern of the faucet, or a water pressure of the faucet in accordance with the one of the plurality of designated themes.

12. A system for enhancing a service using virtual reality, the system comprising:

a projector disposed in an area;

a database that stores theme projection information for each of a plurality of designated themes for enhancing the service using the virtual reality;

a processor; and

a memory storing instructions that, when executed by the processor, cause the processor to perform operations including;

identifying the area of the service to be enhanced using the virtual reality and one of the plurality of designated themes;

identifying at least one object in the area, the at least one object to be enhanced using the virtual reality;

acquiring a position and dimensions of the at least one object in the area;

extracting, from the database, the theme projection information corresponding to the one of the plurality of designated themes; and

projecting, with the projector, the virtual reality on the at least one object using a three-dimensional modeling tool based on the position and the dimensions of the at least one object and the theme projection information corresponding to the one of the plurality of designated themes,

wherein the projector projects, with the projector, the virtual reality when detecting that a door of a room within which the projector is disposed is unlocked.