Method and system for E-commerce video editing
First Claim
1. A video editing system or tool for E-commerce, said system utilizing augmented reality (AR) technology for combining real and virtual worlds together to provide an interface for a user to sense and interact with virtual objects in the real world, said system comprising:
- a programmable computer for performing data processing of video and calibration data;
a source of video data coupled to said computer;
a set of markers for calibration of said camera and for pose estimation of said markers, for providing calibration results;
a source of a 3-dimensional (3-D) image data model for a product;
said computer utilizing said 3-D image data and said calibration results for rendering a 3D model; and
said computer utilizing said 3D model and said video data for generating a 3-D model with superposition of said 3D model and said video data so as to provide an AR video.
1 Assignment
0 Petitions
Accused Products
Abstract
A video editing system or tool for E-commerce utilizing augmented reality (AR) technology combines real and virtual worlds together to provide an interface for a user to sense and interact with virtual objects in the real world. The AR video editing system is usable in conjunction with an ordinary desktop computer and a low-cost parallel port camera. A known camera calibration algorithm is utilized together with a set of specially designed markers for camera calibration and pose estimation of the markers. OpenGL and VRML (Virtual Reality Modeling Language) for 3D virtual model rendering and superimposition. are utilized. Marker-based calibration is utilized to calibrate the camera and estimate the pose of the markers in the AR video editing system. The system comprises video input/output, image feature extraction and marker recognition, camera calibration/pose estimation, and virtual reality (VR) model rendering/augmentation. This allows a sales person to create and edit customized AR video for product presentation and advertisement. In the video, the sales person can present different aspects of the product while keeping eye-to-eye contact with customers. The system is capable of providing a user with real-time augmented reality feedback while recording a video. The augmented videos can be made available on E-Commerce Web-sites or they can be emailed to customers. Because of the real-time editing capability, the AR video can be directly broadcast on the Internet, for example, for an E-commerce advertisement. Inserted virtual objects can be hyper-linked to product specification WebPages providing more detailed product and price information.
-
Citations
45 Claims
-
1. A video editing system or tool for E-commerce, said system utilizing augmented reality (AR) technology for combining real and virtual worlds together to provide an interface for a user to sense and interact with virtual objects in the real world, said system comprising:
-
a programmable computer for performing data processing of video and calibration data;
a source of video data coupled to said computer;
a set of markers for calibration of said camera and for pose estimation of said markers, for providing calibration results;
a source of a 3-dimensional (3-D) image data model for a product;
said computer utilizing said 3-D image data and said calibration results for rendering a 3D model; and
said computer utilizing said 3D model and said video data for generating a 3-D model with superposition of said 3D model and said video data so as to provide an AR video. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 13, 14, 15, 17, 18, 19, 20, 21, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 36, 38, 41, 42, 43)
-
-
12. A method for video editing comprising the steps of:
-
obtaining video image data from a source;
extracting feature information data from said video image data;
extracting marking recognition data from said video image data;
utilizing said information data and said recognition data to derive calibration data and pose estimation data for said source;
deriving 3-dimensional (3-D) model data for an object;
utilizing said calibration data, said pose estimation data, said video image data, and said 3-dimensional (3-D) model data for an object to perform volume rendering (VR) and superposition to produce an artificial reality (AR) image.
-
-
16. A system for video editing comprising:
-
means for obtaining video image data from a source;
means for extracting feature information data from said video image data;
means for extracting marking recognition data from said video image data;
means for utilizing said information data and said recognition data to derive calibration data and pose estimation data for said source;
means for deriving 3-dimensional (3-D) model data for an object; and
means for utilizing said calibration data, said pose estimation data, said video image data, and said 3-dimensional (3-D) model data for an object to perform volume rendering (VR) and superposition to produce an artificial reality (AR) image.
-
-
22. A video editing system or tool for E-commerce, said system utilizing augmented reality (AR) technology for combining real and virtual worlds together to provide an interface for a user to sense and interact with virtual objects in the real world, said system comprising:
-
a programmable computer for performing data processing of video and calibration data in real time;
a source of video data coupled to said computer;
a set of markers for calibration of said camera and for pose estimation of said markers, for providing calibration results;
a source of a 3-dimensional (3-D) image data model for a product;
said computer utilizing said 3-D image data and said calibration results for rendering a 3D model; and
said computer utilizing said 3D model and said video data for generating a 3-D model with superposition of said 3D model and said video data so as to provide an AR video in real time relative to said video data. - View Dependent Claims (39)
-
-
33. A method for video editing comprising the steps of:
-
obtaining video image data from a source;
extracting feature information data from said video image data;
extracting marking recognition data from said video image data;
utilizing said information data and said recognition data to derive calibration data and pose estimation data for said source;
deriving 3-dimensional (3-D) model data for an object; and
utilizing said calibration data, said pose estimation data, said video image data, and said 3-dimensional (3-D) model data for an object to perform volume rendering (VR) and superposition to produce an artificial reality (AR) image. - View Dependent Claims (34, 37, 40)
-
-
35. A system for video editing comprising:
-
means for obtaining video image data, including accompanying sound data from a source;
means for extracting feature information data from said video image data;
means for extracting marking recognition data from said video image data;
means for utilizing said information data and said recognition data to derive calibration data and pose estimation data for said source;
means for deriving 3-dimensional (3-D) model data for an object; and
means for utilizing said calibration data, said pose estimation data, said video image data, and said 3-dimensional (3-D) model data for an object to perform volume rendering (VR) and superposition to produce an artificial reality (AR) image.
-
-
44. A method for video editing comprising the steps of:
-
obtaining video image data and associated synchronized sound data from a source;
extracting feature information data from said video image data;
extracting marking recognition data from said video image data;
utilizing said information data and said recognition data to derive calibration data and pose estimation data for said source;
deriving 3-dimensional (3-D) model data for an object; and
utilizing said calibration data, said pose estimation data, said video image data, and said 3-dimensional (3-D) model data for an object to perform volume rendering (VR) and superposition so as to produce an artificial reality (AR) image in real time. - View Dependent Claims (45)
-
Specification