OVERLAID VIRTUAL PLAYGROUND AND OVERLAID VIRTUAL INFORMATION DELIVERY PLATFORM FOR RESTAURANTS, CATERING BUSINESSES AND OTHER BUSINESSES USING MENU CARDS, PIZZA BOXES, SALT AND PEPPER SHAKERS, AND OTHER OBJECTS

• US 20130222367A1
• Filed: 02/20/2013
• Published: 08/29/2013
• Est. Priority Date: 02/21/2012
• Status: Active Grant

• Current Assignee: Mahesh Babu Mariappan
• Original Assignee: Mahesh Babu Mariappan
• Inventors: MARIAPPAN, MAHESH BABU
• Granted Patent: US 9,928,651 B2
• Time in Patent Office: Days
• US Class Current: 345/419
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

The present invention obviates the need for restaurants to install expensive physical hardware such as swings, slides, etc that consume valuable property real-estate, to provide playing entertainment to customers, by constructing a virtual playground out of objects typically found in restaurants such as salt and pepper shakers, napkin dispensers, spoons, forks, plates, glasses, menu cards, pizza-boxes, etc. The present invention virtualizes these real-world objects and uses the virtualized characters to populate a virtual playground that is overlaid on top of real-world objects. This virtual playground allows users to manipulate virtual characters facilitating gameplay and entertainment.

The present invention also transforms conventional printed restaurant menu cards into a platform for rich multimedia information delivery/consumption by superimposing/overlaying real-world printed menu cards with virtual multimedia contents such as video, audio, graphics, graphical characters in 2-dimension or 3-dimension, animation, etc that can be interacted with, providing a rich infotainment experience for customers.

Claims

1. An invention that provides a rich multimedia infotainment platform for restaurants, catering businesses, service businesses, entertainment businesses, infotainment businesses, etc, the invention comprising:

tables or other containing objects;

real-world objects typically found in, but not limited to, restaurants such as menu cards, pizza boxes, etc;

real-world objects typically found in, but not limited to, restaurants such plates, glasses, salt shakers, pepper shakers, napkin dispensers, spoons, forks, brochures, newspapers, magazines, flyers, wall-hangings, etc;

computing devices with video and other sensory data processing units, where the computing devices are typically, but not limited to, mobile devices, cellphones, smartphones, tablet computers, portable computers, handheld computing devices, standalone computing devices, wearable computing devices, etc;

cameras or other mechanisms of data capture such as sensors connected to the computing devices;

mechanisms to recognize real-world objects, events, etc from the captured data;

remote servers with processing and storage capabilities, containing multimedia contents such as video, audio, graphics, graphical characters in 2-dimension or 3-dimension, animation, text, hyperlinks, etc, connected to the computing devices over a network, from where virtual contents are retrieved, depending on the context;

local storage devices connected to the computing devices for storing data;

display mechanisms connected to the computing devices for displaying the retrieved virtual multimedia contents;

2. The invention of claim 1 that transforms restaurant tables or other containing objects into a virtual playground for infotainment with real-world objects on the restaurant tables such as menu cards, salt shakers, pepper shakers, napkin dispensers, spoons, forks, brochures, newspapers, magazines, etc, virtualized and overlaid with other virtual multimedia content such as video, audio, graphics, graphical characters in 2-dimension or 3-dimension, animation, text, hyperlinks, etc that can be interacted with for the purposes of playing a game or for information consumption, where the multimedia contents are retrieved over the network from remote servers or local storage connected to scanning devices, where the scanning devices are typically, but not limited to, mobile devices, cellphones, smartphones, tablet computers, portable computers, handheld computing devices, standalone computing devices, wearable computing devices, etc, equipped with cameras or other mechanisms of data capture

wherein the restaurant can be, but not limited to, a dine-in restaurant, coffee shop, icecream parlor, snacks stall, bakery, any catering business, etc;

wherein the table is either the table that customers dine on, or any other table or other containing objects allocated by the restaurant or other business for deploying the invention;

wherein the real-world objects that are scanned, virtualized and multimedia content overlaid, can be located anywhere, not necessarily on a restaurant table or other containing object, perhaps in a different setting, perhaps held in hand, inside or outside a restaurant depending on the usecase and deployment scenario;

wherein the invention deployment scenario depends on the usecase, including, but not limited to, spas, service businesses, entertainment businesses, infotainment businesses, etc.

3. The invention of claim 2 that overlays a restaurant'"'"'s real-world printed or handwritten menu card, in cases of dine-in restaurants, catering businesses, service businesses, etc, or overlays a real-world pizza box or any other printed or handwritten or hand-drawn material or other real-world object used by the pizza delivery business or any other phone order delivery business, as the platform for deploying the invention, with virtual multimedia content such as video, audio, graphics, graphical characters in 2-dimension or 3-dimension, animation, text, hyperlinks, etc that can be interacted with for the purposes of playing a game or for information consumption, where the overlaid contents that are retrieved over the network from remote servers or local storage, pertain to dish nutrition information, user reviews, user ratings, diet tips, customer food consumption history/pattern, health suggestions, new offerings, health and nutrition games, other games, cookery videos, tips, information, or any other content of interest to the users or the entities deploying the invention for the benefit of the users

wherein the invention also gives the users the ability to personalize and save such multimedia contents, progress on the games, or consumption patterns on remote storage, cloud storage, or the like;

wherein the invention also gives the users the ability to share such contents through the network or other means among other users/customers of the infotainment platform;

wherein the invention also gives the users the ability to play with/against, or consume content together with, other users/customers of the infotainment platform at the same time;

wherein the invention also gives the invention deploying entities, such as the dine-in restaurants, catering businesses, service businesses, etc, the ability to activate a location lock capability using Global Positioning System or other locating mechanisms, if the deploying entities so desire, to control and regulate the locations the users/customers of the infotainment platform can use the infotainment platform, thereby incentivizing users/customers to return to the restaurant or the deploying entities'"'"' premises to continue using the infotainment platform, besides deterring users/customers from stealing the restaurant'"'"'s menu card or other objects belonging to the restaurant for the sake of using the infotainment platform;

wherein the invention also gives the invention deploying entities, such as the pizza delivery business or any other phone order delivery business, the ability to control and regulate the number of times or the duration of use of the infotainment platform by the users/customers for each order they place, thereby incentivizing users/customers of the phone-order and delivery businesses to place more orders with the deploying entities/businesses to increase their service volume;

wherein the invention also rewards customers/users for their loyalty to the infotainment platform and the entities deploying the infotainment platform invention, by tying user usage behavior/performance on the infotainment platform to reward points that can be redeemed towards free food/food discounts or coupons or other items of interest to the users of the infotainment platform or the entities deploying the infotainment platform invention.

4. The invention of claim 3 that transforms real-world materials/objects such as newspapers, magazines, books, flyers, brochures, documents, event invitation cards, receipts, tickets, calendars, photo albums, wall hangings, etc, containing printed or handwritten or embedded or such typically inanimate text, photographs, images, photographs, pictures, drawings, abstract patterns, alphanumeric codes, etc into a virtual information delivery platform by overlaying virtual multimedia content such as video, audio, graphics, graphical characters in 2-dimension or 3-dimension, animation, text, hyperlinks, etc that can be interacted with for the purposes of playing a game or for information consumption, where the overlaid contents that are retrieved over the network from remote servers or local storage, pertain to, but not limited to, current events/happenings, news bulletin, editorials, stories, documentaries, press coverages, subject matter details, lectures, speeches, seminars, discussions, debates, information snippets, updates, games, sports, movies, health, entertainment, personal information, personal messages, greetings, etc or any other content of interest to the users/customers consuming the multimedia content or the entities deploying the invention for the benefit of the users

wherein the invention also gives the users the ability to personalize and save such multimedia contents, progress on the games, or consumption patterns on remote storage, cloud storage, or the like;

wherein the invention also gives the users the ability to share such contents through the network or other means among other users/customers of the infotainment platform;

wherein the invention also gives the users the ability to play with/against, or consume content together with, other users/customers of the infotainment platform at the same time;

wherein the invention gives the users the ability to use the infotainment platform for purposes of gaming, entertainment, and information consumption, anywhere and at anytime;

wherein the invention also rewards customers/users for their loyalty to the infotainment platform and the entities deploying the infotainment platform invention, by tying user usage behavior/performance on the infotainment platform to reward points that can be redeemed towards free food/food discounts or coupons or other items of interest to the users of the infotainment platform or the entities deploying the infotainment platform invention.

5. A method for providing a rich multimedia infotainment platform for restaurants, catering businesses, service businesses, entertainment businesses, infotainment businesses, etc, where the method comprises:

using tables or other containing objects;

using real-world objects typically found in, but not limited to, restaurants such as menu cards, pizza boxes, etc;

using real-world objects typically found in, but not limited to, restaurants such plates, glasses, salt shakers, pepper shakers, napkin dispensers, spoons, forks, brochures, newspapers, magazines, flyers, wall-hangings, etc;

using computing devices with video and other sensory data processing units, where the computing devices are typically, but not limited to, mobile devices, cellphones, smartphones, tablet computers, portable computers, handheld computing devices, standalone computing devices, wearable computing devices, etc;

capturing data through cameras or other mechanisms of data capture such as sensors connected to the computing devices;

recognizing real-world objects, events, etc from the captured data, where the recognition computation takes place either locally on the computing devices, or remotely on servers with processing and storage capabilities over the network;

retrieving multimedia contents such as video, audio, graphics, graphical characters in 2-dimension or 3-dimension, animation, text, hyperlinks, etc, from remote servers with processing and storage capabilities, connected to the computing devices through a network, depending on the context;

storing retrieved multimedia contents on local storage devices connected to the computing devices;

displaying the retrieved virtual multimedia contents using display mechanisms connected to the computing devices;

6. The method of claim 5 that transforms restaurant tables or other containing objects into a virtual playground for infotainment with real-world objects on the restaurant tables such as menu cards, salt shakers, pepper shakers, napkin dispensers, spoons, forks, brochures, newspapers, magazines, etc, virtualized and overlaid with other virtual multimedia content such as video, audio, graphics, graphical characters in 2-dimension or 3-dimension, animation, text, hyperlinks, etc that can be interacted with for the purposes of playing a game or for information consumption, where the multimedia contents are retrieved over the network from remote servers or local storage connected to scanning devices, where the scanning devices are typically, but not limited to, mobile devices, cellphones, smartphones, tablet computers, portable computers, handheld computing devices, standalone computing devices, wearable computing devices, etc, equipped with cameras or other mechanisms of data capture

wherein the restaurant can be, but not limited to, a dine-in restaurant, coffee shop, icecream parlor, snacks stall, bakery, any catering business, etc;

wherein the table is either the table that customers dine on, or any other table or other containing objects allocated by the restaurant or other business for deploying the method;

wherein the real-world objects that are scanned, virtualized and multimedia content overlaid, can be located anywhere, not necessarily on a restaurant table or other containing object, perhaps in a different setting, perhaps held in hand, inside or outside a restaurant depending on the usecase and deployment scenario;

wherein the method deployment scenario depends on the usecase, including, but not limited to, spas, service businesses, entertainment businesses, infotainment businesses, etc.

7. The method of claim 6 that overlays a restaurant'"'"'s real-world printed or handwritten menu card, in cases of dine-in restaurants, catering businesses, service businesses, etc, or overlays a real-world pizza box or any other printed or handwritten or hand-drawn material or other real-world object used by the pizza delivery business or any other phone order delivery business, as the platform for deploying the method, with virtual multimedia content such as video, audio, graphics, graphical characters in 2-dimension or 3-dimension, animation, text, hyperlinks, etc that can be interacted with for the purposes of playing a game or for information consumption, where the overlaid contents that are retrieved over the network from remote servers or local storage, pertain to dish nutrition information, user reviews, user ratings, diet tips, customer food consumption history/pattern, health suggestions, new offerings, health and nutrition games, other games, cookery videos, tips, information, or any other content of interest to the users or the entities deploying the method for the benefit of the users

wherein the method also gives the users the ability to personalize and save such multimedia contents, progress on the games, or consumption patterns on remote storage, cloud storage, or the like;

wherein the method also gives the users the ability to share such contents through the network or other means among other users/customers of the infotainment platform;

wherein the method also gives the users the ability to play with/against, or consume content together with, other users/customers of the infotainment platform at the same time;

wherein the method also gives the method deploying entities, such as the dine-in restaurants, catering businesses, service businesses, etc, the ability to activate a location lock capability using Global Positioning System or other locating mechanisms, if the deploying entities so desire, to control and regulate the locations the users/customers of the infotainment platform can use the infotainment platform, thereby incentivizing users/customers to return to the restaurant or the deploying entities'"'"' premises to continue using the infotainment platform, besides deterring users/customers from stealing the restaurant'"'"'s menu card or other objects belonging to the restaurant for the sake of using the infotainment platform;

wherein the method also gives the method deploying entities, such as the pizza delivery business or any other phone order delivery business, the ability to control and regulate the number of times or the duration of use of the infotainment platform by the users/customers for each order they place, thereby incentivizing users/customers of the phone-order and delivery businesses to place more orders with the deploying entities/businesses to increase their service volume;

wherein the method also rewards customers/users for their loyalty to the infotainment platform and the entities deploying the infotainment platform method, by tying user usage behavior/performance on the infotainment platform to reward points that can be redeemed towards free food/food discounts or coupons or other items of interest to the users of the infotainment platform or the entities deploying the infotainment platform method.

8. The method of claim 7 that transforms real-world materials/objects such as newspapers, magazines, books, flyers, brochures, documents, event invitation cards, receipts, tickets, calendars, photo albums, wall hangings, etc, containing printed or handwritten or embedded or such typically inanimate text, photographs, images, photographs, pictures, drawings, abstract patterns, alphanumeric codes, etc into a virtual information delivery platform by overlaying virtual multimedia content such as video, audio, graphics, graphical characters in 2-dimension or 3-dimension, animation, text, hyperlinks, etc that can be interacted with for the purposes of playing a game or for information consumption, where the overlaid contents that are retrieved over the network from remote servers or local storage, pertain to, but not limited to, current events/happenings, news bulletin, editorials, stories, documentaries, press coverages, subject matter details, lectures, speeches, seminars, discussions, debates, information snippets, updates, games, sports, movies, health, entertainment, personal information, personal messages, greetings, etc or any other content of interest to the users/customers consuming the multimedia content or the entities deploying the method for the benefit of the users

wherein the method also gives the users the ability to personalize and save such multimedia contents, progress on the games, or consumption patterns on remote storage, cloud storage, or the like;

wherein the method also gives the users the ability to share such contents through the network or other means among other users/customers of the infotainment platform;

wherein the method also gives the users the ability to play with/against, or consume content together with, other users/customers of the infotainment platform at the same time;

wherein the method gives the users the ability to use the infotainment platform for purposes of gaming, entertainment, and information consumption, anywhere and at anytime;

wherein the method also rewards customers/users for their loyalty to the infotainment platform and the entities deploying the infotainment platform method, by tying user usage behavior/performance on the infotainment platform to reward points that can be redeemed towards free food/food discounts or coupons or other items of interest to the users of the infotainment platform or the entities deploying the infotainment platform method.