METHODS AND SYSTEMS FOR DETERMINING THE POSE OF A CAMERA WITH RESPECT TO AT LEAST ONE OBJECT OF A REAL ENVIRONMENT
First Claim
1. A method for determining the pose of a camera with respect to at least one object of a real environment for use in an authoring or augmented reality application, comprising:
- generating a first image comprising at least one image by a camera capturing a real object of a real environment;
generating first orientation data from at least one orientation sensor associated with the camera or from an algorithm which analyses the first image to find and determine features which are indicative of an orientation of the camera;
allocating a distance of the camera to the real object of the real environment displayed in the first image, and generating distance data that is indicative of the distance; and
,determining a pose of the camera with respect to a coordinate system related to the real object of the real environment using the distance data and the first orientation data.
2 Assignments
0 Petitions
Accused Products
Abstract
Method for determining the pose of a camera with respect to at least one object of a real environment for use in authoring/augmented reality application that includes generating a first image by the camera capturing a real object of a real environment, generating first orientation data from at least one orientation sensor associated with the camera or from an algorithm which analyses the first image for finding and determining features which are indicative of an orientation of the camera, allocating a distance of the camera to the real object, generating distance data indicative of the allocated distance, determining the pose of the camera with respect to a coordinate system related to the real object of the real environment using the distance data and the first orientation data. May be performed with reduced processing requirements and/or higher processing speed, in mobile device such as mobile phones having display, camera and orientation sensor.
-
Citations
30 Claims
-
1. A method for determining the pose of a camera with respect to at least one object of a real environment for use in an authoring or augmented reality application, comprising:
-
generating a first image comprising at least one image by a camera capturing a real object of a real environment; generating first orientation data from at least one orientation sensor associated with the camera or from an algorithm which analyses the first image to find and determine features which are indicative of an orientation of the camera; allocating a distance of the camera to the real object of the real environment displayed in the first image, and generating distance data that is indicative of the distance; and
,determining a pose of the camera with respect to a coordinate system related to the real object of the real environment using the distance data and the first orientation data. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21)
-
-
22. A method for determining the pose of a camera with respect to at least one object of a real environment for use in an authoring or augmented reality application, comprising:
-
generating at least one image by a camera capturing a object of a real environment; displaying the at least one image on an image display; generating orientation data from at least one orientation sensor associated with the camera or from an algorithm which analyses the at least one image for finding and features which are indicative of an orientation of the camera; providing a virtual reference model which is displayed superimposed with the real environment in the at least one image and generating distance data from the virtual reference model, wherein the distance data is indicative of an allocated distance of the camera to the object; and
,determining a pose of the camera with respect to a coordinate system related to the object of the real environment using the distance data and the orientation data.
-
-
23. A method for determining the pose of a camera with respect to at least one object of a real environment for use in an authoring or augmented reality application, comprising:
-
generating at least one image by a camera capturing an object of a real environment; generating orientation data from at least one orientation sensor associated with the camera or from an algorithm which analyses the at least one image for finding and determining features which are indicative of an orientation of the camera; providing a measurement device associated with the camera for measuring at least one parameter that is indicative of distance between the camera and the object; determining a pose of the camera with respect to a coordinate system related to the object of the real environment based on the at least one parameter and the orientation data.
-
-
24. A system for determining the pose of a camera with respect to at least one object of a real environment for use in an authoring or augmented reality system, comprising:
-
at least one camera configured to generate at least one image that captures at least one object of a real environment; an image displaying device configured to display the at least one image; at least one orientation sensor associated with the at least one camera, configured to generate orientation data of the at least one camera; a processing device coupled with the at least one camera and with the image displaying device, the processing device and configured to provide a virtual reference model which is displayed superimposed with the real environment in the at least one image and generate distance data from the virtual reference model, the distance data being indicative of an allocated distance of the at least one camera to the at least one object; receive user instructions via a user interface for manipulation of the virtual reference model by user placement of the virtual reference model at a particular position within the at least one image; determine a pose of the at least one camera with respect to a coordinate system related to the at least one object of the real environment through use of the distance data and the orientation data. - View Dependent Claims (25, 26)
-
-
27. A system for determining the pose of a camera with respect to at least one object of a real environment for use in an authoring or augmented reality system, comprising:
-
at least one camera configured to generate at least one image capturing at least one object of a real environment; at least one orientation sensor associated with the at least one camera, configured to generate orientation data of the at least one camera; a measurement device associated with the at least one camera, configured to measure a distance between the at least one camera and the at least one object; and
,a processing device coupled with the at least one camera, wherein the processing device is configured to generate distance data from the distance, and determine a pose of the at least one camera with respect to a coordinate system related to the at least one object of the real environment through use of the distance data and the orientation data. - View Dependent Claims (28, 29)
-
-
30. A method for determining the pose of a camera with respect to at least one object of a real environment for use in an authoring or augmented reality application, comprising:
-
generating a first image comprising at least one image by a camera that captures a real object of a real environment; generating first orientation data from at least one orientation sensor associated with the camera or from an algorithm which analyses the first image to find and determine features which are indicative of an orientation of the camera or by user-interaction; allocating a distance of the camera to the real object of the real environment displayed in the first image, and generating distance data that is indicative of an allocated distance of the camera to the real object; determining a pose of the camera with respect to a coordinate system related to the real object of the real environment in the first image using the distance data and the first orientation data; generating a second image by the camera that captures the real object of the real environment; extracting at least one respective feature from the first image and the second image and matching the at least one respective feature to provide at least one relation that is indicative of a correspondence between the first image and the second image; providing the pose of the camera with respect to the coordinate system related to the real object in the first image, and determining the pose of the camera with respect to a second coordinate system related to the real object in the second image using the pose of the camera with respect to the coordinate system related to the real object in the first image and the at least one relation; and
,extracting at least one second respective feature from the first image and the second image for determining a ground plane in both the first image and the second image and moving a placement coordinate system to be positioned on the ground plane.
-
Specification