Methods and systems for determining the pose of a camera with respect to at least one object of a real environment
First Claim
1. A method for superimposing a virtual model with a real environment, comprising:
- receiving, from a camera, an image depicting a real environment;
generating first orientation data describing a vector normal to a 3D plane within a reference coordinate system;
placing a virtual model at a first location within the reference coordinate system, wherein the virtual model represents an object;
determining first position data indicative of at least one distance between the at least one camera and the 3D plane within the reference coordinate system;
moving the virtual model to a second location in the reference coordinate system, the second location positioned on the 3D plane defined by the first orientation data and the first position data;
modifying a dimension of the virtual model to generate a modified virtual model such that a first projection of the virtual model onto the image from the first location substantially equals a second projection of the modified virtual model onto the image from the second location; and
generating a modified version of an additional image of the real environment by projecting the modified virtual model from the second location onto the additional image of the real environment.
2 Assignments
0 Petitions
Accused Products
Abstract
Method for determining the pose of a camera with respect to an object of a real environment for use in authoring/augmented reality application that includes generating a first image by the camera capturing a real object of a real environment, generating first orientation data from at least one orientation sensor associated with the camera or from an algorithm which analyzes the first image for finding and determining features which are indicative of an orientation of the camera, allocating a distance of the camera to the real object, generating distance data indicative of the allocated distance, determining the pose of the camera with respect to a coordinate system related to the real object of the real environment using the distance data and the first orientation data. May be performed with reduced processing requirements and/or higher processing speed, in mobile device such as mobile phones having display, camera and orientation sensor.
-
Citations
20 Claims
-
1. A method for superimposing a virtual model with a real environment, comprising:
-
receiving, from a camera, an image depicting a real environment; generating first orientation data describing a vector normal to a 3D plane within a reference coordinate system; placing a virtual model at a first location within the reference coordinate system, wherein the virtual model represents an object; determining first position data indicative of at least one distance between the at least one camera and the 3D plane within the reference coordinate system; moving the virtual model to a second location in the reference coordinate system, the second location positioned on the 3D plane defined by the first orientation data and the first position data; modifying a dimension of the virtual model to generate a modified virtual model such that a first projection of the virtual model onto the image from the first location substantially equals a second projection of the modified virtual model onto the image from the second location; and generating a modified version of an additional image of the real environment by projecting the modified virtual model from the second location onto the additional image of the real environment. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15)
-
-
16. A method for superimposing a virtual model with a real environment, comprising:
-
receiving, from a camera, an image depicting a real environment; generating first orientation data describing a vector normal to a 3D plane within a reference coordinate system; placing a virtual model at a first location within the reference coordinate system, wherein the virtual model represents an object; determining first position data indicative of at least one distance between the camera and the 3D plane within the reference coordinate system; casting at least one ray from a position in the reference coordinate system where the camera captured the image to at least one point of the virtual model placed at the first location; identifying at least one intersection point where the at least one ray intersects the 3D plane; and generating a modified version of an additional image by projecting the virtual model onto the additional image such that the at least one point of the virtual model is superimposed with the corresponding at least one intersection point. - View Dependent Claims (17, 18, 19)
-
-
20. A system for superimposing a virtual model with a real environment, comprising a processing device coupled with at least one camera, wherein the processing device is configured to:
-
receive, from the at least one camera, an image depicting a real environment; generate first orientation data describing a vector normal to a 3D plane within a reference coordinate system; place a virtual model at a first location within the reference coordinate system, wherein the virtual model represents an object; determine first position data indicative of at least one distance between the at least one camera and the 3D plane within the reference coordinate system; move the virtual model to a second location in the reference coordinate system, the second location positioned on the 3D plane defined by the first orientation data and the first position data; modify a dimension of the virtual model to generate a modified virtual model such that a first projection of the virtual model onto the image from the first location substantially equals a second projection of the modified virtual model onto the image from the second location; and generate a modified version of an additional image of the real environment by projecting the modified virtual model from the second location onto the additional image.
-
Specification