Overlaid virtual playground and overlaid virtual information delivery platform for restaurants, catering businesses and other businesses using menu cards, pizza boxes, salt and pepper shakers, and other objects
First Claim
1. A system comprising:
- a physical food container or a physical food;
a computing device including a processor and a memory;
at least one camera communicatively coupled to the computing device and configured to capture one or more frames of video of the physical food container, the physical food, or physical objects, or at least one sensor communicatively coupled to the computing device and configured to capture sensory data from the physical food container, the physical food, or the physical objects;
a server, including a processor and a memory, in communication with the computing device, wherein the server is configured to store, transmit, or receive data, information, or virtual multimedia content associated with the physical food container or the physical food; and
a display device communicatively coupled to the computing device and configured to display a video camera feed together with data, information, virtual multimedia content, virtualized objects, or virtualized object toys,wherein the processor of the computing device or the server is configured to computationally recognize distinguishing characteristics of the physical food container or the physical food based on the video captured by the at least one camera or the sensory data captured by the at least one sensor,wherein the processor of the computing device or the server is configured to transform the computationally recognized physical food container or the computationally recognized physical food into a virtualized food container toy or a virtualized food toy, respectively, or to transform the computationally recognized physical food container or the computationally recognized physical food into a virtualized food container or a virtualized food, respectively, andwherein the computing device;
retrieves data, information, or virtual multimedia content from the server or locally based on the computationally recognized physical food container or the computationally recognized physical food;
inserts the retrieved data, information, virtual multimedia content, virtualized objects, or virtualized object toys into the video camera feed as captured by the at least one camera to create a composite scene;
integrates the virtualized food container toy or the virtualized food toy corresponding to the physical food container or the physical food, respectively, into a resulting composite scene; and
causes the display device to display the composite scene.
0 Assignments
0 Petitions
Accused Products
Abstract
The present invention obviates the need for restaurants to install expensive physical hardware such as swings, slides, etc that consume valuable property real-estate, to provide playing entertainment to customers, by constructing a virtual playground out of objects typically found in restaurants such as salt and pepper shakers, napkin dispensers, spoons, forks, plates, glasses, menu cards, pizza-boxes, etc. The present invention virtualizes these real-world objects and uses the virtualized characters to populate a virtual playground that is overlaid on top of real-world objects. This virtual playground allows users to manipulate virtual characters facilitating gameplay and entertainment.
The present invention also transforms conventional printed restaurant menu cards into a platform for rich multimedia information delivery/consumption by superimposing/overlaying real-world printed menu cards with virtual multimedia contents such as video, audio, graphics, graphical characters in 2-dimension or 3-dimension, animation, etc that can be interacted with, providing a rich infotainment experience for customers.
-
Citations
66 Claims
-
1. A system comprising:
-
a physical food container or a physical food; a computing device including a processor and a memory; at least one camera communicatively coupled to the computing device and configured to capture one or more frames of video of the physical food container, the physical food, or physical objects, or at least one sensor communicatively coupled to the computing device and configured to capture sensory data from the physical food container, the physical food, or the physical objects; a server, including a processor and a memory, in communication with the computing device, wherein the server is configured to store, transmit, or receive data, information, or virtual multimedia content associated with the physical food container or the physical food; and a display device communicatively coupled to the computing device and configured to display a video camera feed together with data, information, virtual multimedia content, virtualized objects, or virtualized object toys, wherein the processor of the computing device or the server is configured to computationally recognize distinguishing characteristics of the physical food container or the physical food based on the video captured by the at least one camera or the sensory data captured by the at least one sensor, wherein the processor of the computing device or the server is configured to transform the computationally recognized physical food container or the computationally recognized physical food into a virtualized food container toy or a virtualized food toy, respectively, or to transform the computationally recognized physical food container or the computationally recognized physical food into a virtualized food container or a virtualized food, respectively, and wherein the computing device; retrieves data, information, or virtual multimedia content from the server or locally based on the computationally recognized physical food container or the computationally recognized physical food; inserts the retrieved data, information, virtual multimedia content, virtualized objects, or virtualized object toys into the video camera feed as captured by the at least one camera to create a composite scene; integrates the virtualized food container toy or the virtualized food toy corresponding to the physical food container or the physical food, respectively, into a resulting composite scene; and causes the display device to display the composite scene. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18)
-
-
19. A method comprising:
-
capturing, by at least one camera communicatively coupled to a computing device, one or more frames of video of a physical food container, a physical food, or physical objects, or capturing, by at least one sensor communicatively coupled to the computing device, sensory data from a physical food container, a physical food, or the physical objects; providing a server, including a processor and a memory, in communication with the computing device, wherein the server is configured to store, transmit, or receive data, information, or virtual multimedia content associated with the physical food container or the physical food; providing a display device communicatively coupled to the computing device and configured to display a video camera feed together with data, information, virtual multimedia content, virtualized objects, or virtualized object toys; computationally recognizing, by the computing device, distinguishing characteristics of the physical food container or the physical food based on the video captured by the at least one camera or the sensory data captured by the at least one sensor; transforming, by the computing device, the computationally recognized physical food container or the computationally recognized physical food into a virtualized food container toy or a virtualized food toy, respectively, or transforming, by the computing device, the computationally recognized physical food container or the computationally recognized physical food into a virtualized food container or a virtualized food, respectively; retrieving, by the computing device, data, information, or virtual multimedia content locally or from the server based on the computationally recognized physical food container or the computationally recognized physical food; inserting, by the computing device, the retrieved data, information, or virtual multimedia content into the video camera feed as captured by the at least one camera to create a composite scene; integrating, by the computing device, the virtualized food container toy or the virtualized food toy corresponding to the physical food container or the physical food, respectively, into a resulting composite scene; and causing, by the computing device, the display device to display the composite scene. - View Dependent Claims (20, 21, 22)
-
-
23. A system comprising:
-
a physical restaurant menu card; a computing device including a processor and a memory; at least one camera communicatively coupled to the computing device and configured to capture one or more frames of video of a physical restaurant menu card or a physical object, or at least one sensor communicatively coupled to the computing device and configured to capture sensory data from the physical restaurant menu card or the physical object; a server, including a processor and a memory, in communication with the computing device, wherein the server is configured to store, transmit, or receive data, information, or virtual multimedia content associated with the physical restaurant menu card and the content of the physical restaurant menu card; and a display device communicatively coupled to the computing device and configured to display a video camera feed together with data, information, virtual multimedia content, virtualized objects, or virtualized object toys, wherein the computing device is configured to computationally recognize distinguishing characteristics of the physical restaurant menu card and understand the content of the physical restaurant menu card based on the video captured by the at least one camera or the sensory data captured by the at least one sensor, wherein the computing device is configured to transform the computationally recognized physical restaurant menu card and the content of the computationally recognized physical restaurant menu card into a virtualized interactive restaurant menu card, and wherein the computing device; retrieves data, information, or virtual multimedia content from the server or locally based on the computationally recognized physical restaurant menu card and content of the computationally recognized physical restaurant menu card; inserts the retrieved data, information, or virtual multimedia content into the video camera feed as captured by the at least one camera to create a composite scene; integrates the virtualized interactive restaurant menu card corresponding to the physical restaurant menu card into a resulting composite scene; and causes the display device to display the composite scene. - View Dependent Claims (24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40)
-
-
41. A method comprising:
-
capturing, by at least one camera communicatively coupled to a computing device, one or more frames of video of a physical restaurant menu card or a physical object, or capturing, by at least one sensor communicatively coupled to the computing device, sensory data from a physical restaurant menu card or the physical object; providing a server, including a processor and a memory, in communication with the computing device, wherein the server is configured to store, transmit, or receive data, information, or virtual multimedia content associated with the physical restaurant menu card and the content of the physical restaurant menu card; providing a display device communicatively coupled to the computing device and configured to display a video camera feed together with data, information, virtual multimedia content, virtualized objects, or virtualized object toys; computationally recognizing, by the computing device, distinguishing characteristics of the physical restaurant menu card and understanding the content of the physical restaurant menu card based on the video captured by the at least one camera or the sensory data captured by the at least one sensor; transforming, by the computing device, the computationally recognized physical restaurant menu card into a virtualized interactive restaurant menu card; retrieving, by the computing device, data, information, or virtual multimedia content locally or from the server based on the computationally recognized physical restaurant menu card and the content of the computationally recognized physical restaurant menu card; inserting, by the computing device, the retrieved data, information, or virtual multimedia content into the video camera feed as captured by the at least one camera to create a composite scene; integrating, by the computing device, the virtualized interactive restaurant menu card corresponding to the physical restaurant menu card and the content of the physical restaurant menu card, respectively, into a resulting composite scene; and causing, by the computing device, the display device to display the composite scene. - View Dependent Claims (42, 43, 44)
-
-
45. A playground system comprising:
-
at least one physical play-object; a computing device including a processor and a memory; at least one imaging system communicatively connected to the computing device and configured to capture one or more frames of the at least one physical play-object, or at least one sensor system communicatively connected to the computing device and configured to capture sensory data from the at least one physical play-object; at least another computing system, including a processor and a memory, in communication with the computing device, wherein the at least another computing system is configured to store, transmit, or receive data, information, or virtual multimedia content associated with the at least one physical play-object; and a display device communicatively connected to the computing device and configured to display a video camera feed together with data, information, virtual multimedia content, virtualized objects, or virtualized object toys, wherein the computing device is configured to computationally recognize distinguishing characteristics of the at least one physical play-object based on the frames captured by the at least one imaging system or the sensory data captured by the at least one sensor system, wherein the computing device is configured to transform the computationally recognized at least one physical play-object into a virtualized game character toy, and wherein the computing device; retrieves data, information, or virtual multimedia content from the at least another computing system or locally based on the computationally recognized at least one physical play-object; inserts the retrieved data, information, or virtual multimedia content into the video camera feed as captured by the at least one imaging system to create a composite scene; integrates the virtualized game character toy corresponding to the at least one physical play-object into a resulting composite scene; and causes the display device to display the composite scene. - View Dependent Claims (46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62)
-
-
63. A method comprising:
-
capturing, by at least one imaging system communicatively connected to a computing device, one or more frames of at least one physical play-object, or capturing, by at least one sensor system communicatively connected to the computing device, sensory data from the at least one physical play-object; providing at least another computing system, including a processor and a memory, in communication with the computing device, wherein the at least another computing system is configured to store, transmit, or receive data, information, or virtual multimedia content associated with the at least one physical play-object; providing a display device communicatively connected to the computing device and configured to display a video camera feed together with data, information, virtual multimedia content, virtualized objects, or virtualized object toys; computationally recognizing, by the computing device, distinguishing characteristics of the at least one physical play-object based on the frames captured by the at least one imaging system or the sensory data captured by the at least one sensor system; transforming, by the computing device, the computationally recognized at least one physical play-object into a virtualized game character toy; retrieving, by the computing device, data, information, or virtual multimedia content locally or from the at least another computing system based on the computationally recognized at least one physical play-object; inserting, by the computing device, the retrieved data, information, or virtual multimedia content into the video camera feed as captured by the at least one imaging system to create a composite scene; integrating, by the computing device, the virtualized game character toy corresponding to the at least one physical play-object into a resulting composite scene; and causing, by the computing device, the display device to display the composite scene. - View Dependent Claims (64, 65, 66)
-
Specification