Augmented reality system for product identification and promotion
First Claim
1. A computer-implemented method for providing an augmented reality interface, comprising:
- preloading a plurality of image snippets from the server based on a location information of a portable electronic device, each of the plurality of image snippets being a smaller image file of a corresponding stored image;
acquiring an image of a real-world scene and metadata with a camera of a portable electronic device;
overlaying one or more of the plurality of image snippets corresponding to a location and a direction at which a corresponding image was originally captured based on the location information and a orientation information of the portable electronic device without manipulating the plurality of image snippets based on corner features of the image of the real-world scene;
manipulating a retrieved image corresponding to an displayed image snippet based on matching corner feature information of the displayed image snippet generated and provided by the server and corner features of the image of the real-world scene, wherein the retrieved image is retrieved with metadata having selected features; and
combining the manipulated image with a currently observed real-world scene viewed with the portable electronic device; and
providing commercial information regarding the selected features.
1 Assignment
0 Petitions
Accused Products
Abstract
A system, method, and computer program product for automatically combining computer-generated imagery with real-world imagery in a portable electronic device by retrieving, manipulating, and sharing relevant stored videos, preferably in real time. A video is captured with a hand-held device and stored. Metadata including the camera'"'"'s physical location and orientation is appended to a data stream, along with user input. The server analyzes the data stream and further annotates the metadata, producing a searchable library of videos and metadata. Later, when a camera user generates a new data stream, the linked server analyzes it, identifies relevant material from the library, retrieves the material and tagged information, adjusts it for proper orientation, then renders and superimposes it onto the current camera view so the user views an augmented reality.
26 Citations
20 Claims
-
1. A computer-implemented method for providing an augmented reality interface, comprising:
-
preloading a plurality of image snippets from the server based on a location information of a portable electronic device, each of the plurality of image snippets being a smaller image file of a corresponding stored image; acquiring an image of a real-world scene and metadata with a camera of a portable electronic device; overlaying one or more of the plurality of image snippets corresponding to a location and a direction at which a corresponding image was originally captured based on the location information and a orientation information of the portable electronic device without manipulating the plurality of image snippets based on corner features of the image of the real-world scene; manipulating a retrieved image corresponding to an displayed image snippet based on matching corner feature information of the displayed image snippet generated and provided by the server and corner features of the image of the real-world scene, wherein the retrieved image is retrieved with metadata having selected features; and combining the manipulated image with a currently observed real-world scene viewed with the portable electronic device; and providing commercial information regarding the selected features. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17)
-
-
18. A system for providing an augmented reality interface, comprising:
-
a processor; and a memory containing instructions that, when executed by the processor cause the processor to; preload a plurality of video snippets from the server based on a location of a location information of a portable electronic device, each of the plurality of video snippets being a smaller video file of a corresponding stored video; acquire a video of a real-world scene and metadata with a camera of a portable electronic device; overlay one or more of the plurality of video snippets corresponding to a location and a direction at which a corresponding video was originally captured based on the location information and a orientation information of the portable electronic device without manipulating the plurality of video snippets based on corner features of the video of the real-world scene; manipulate a retrieved video corresponding to an displayed video snippet based on matching corner feature information of the displayed video snippet generated and provided by a server and corner features of the video of the real-world scene, wherein the retrieved video is retrieved with metadata having selected features; combine the manipulated video with a currently observed real-world scene viewed with the portable electronic device; and provide commercial information regarding the selected features.
-
-
19. A computer program product for providing an augmented reality interface, comprising a non-transitory computer readable medium embodying computer-executable program instructions thereon that, when executed, cause a computing device to:
-
preload a plurality of video snippets from the server based on a location of a location information of a portable electronic device, each of the plurality of video snippets being a smaller video file of a corresponding stored video; acquire a video of a real-world scene and metadata with a camera of a portable electronic device; overlay one or more of the plurality of video snippets corresponding to a location and a direction at which a corresponding video was originally captured based on the location information and an orientation information of the portable electronic device without manipulating the plurality of video snippets based on corner features of the video of the real-world scene; manipulate a retrieved video corresponding to an displayed video snippet based on matching corner feature information of the displayed video snippet generated and provided by a server and corner features of the video of the real-world scene, wherein the retrieved video is retrieved with metadata having selected features; and combine the manipulated video with a currently observed real-world scene viewed with the portable electronic device; and provide commercial information regarding the selected features.
-
-
20. A system for providing an augmented reality interface, comprising:
-
means for preloading a plurality of video snippets from the server based on a location of a location information of a portable electronic device, each of the plurality of video snippets being a smaller video file of a corresponding stored video; means for acquiring a video of a real-world scene and metadata with a camera of a portable electronic device; means for overlaying one or more of the plurality of video snippets corresponding to a location and a direction at which a corresponding video was originally captured based on the location information and an orientation information of the portable electronic device without manipulating the plurality of video snippets based on corner features of the video of the real-world scene; means for manipulating a retrieved video corresponding to an displayed video snippet based on matching corner feature information of the displayed video snippet generated and provided by a server and corner features of the video of the real-world scene, wherein the retrieved video is retrieved with metadata having selected features; means for combining the manipulated video with a currently observed real-world scene viewed with the portable electronic device; and means for providing commercial information regarding the selected features.
-
Specification