Diminished reality
First Claim
Patent Images
1. A computer method of displaying a subject environment comprising:
- digitally generating a set of one or more images that form a first view depicting a subject environment in an origination state instead of in a current state, such that the first view is a three-dimensional (3D) diminished reality of the subject environment by;
receiving a two-dimensional (2D) source image displaying the subject environment in the current state,determining line segments defining the borders of the subject environment based on line segments in the 2D source image and line segments extrapolated from the 2D source image, the determined line segments being a background of the subject environment, anddigitally forming a 3D model of the 3D diminished reality of the subject environment, the 3D model being based on the background of the subject environment and having objects of the 2D source image that are separate from the background removed from the 3D model; and
enabling computer-based user interaction with the set of images forming the first view in a manner that generates a second view, the second view being a 3D augmented reality representation of the subject environment in its origination state having augmentations based on the enabled computer-based user interaction instead of the current state.
1 Assignment
0 Petitions
Accused Products
Abstract
A computer tool generates user-defined diminished reality images of a subject environment from source images. The diminished reality images display less real-world objects in the subject environment than that displayed in the source images. A 3D model of the subject environment in diminished reality is formed from the diminished reality images. The 3D model supports augmented reality user interaction with views of the subject environment diminished in reality and tidied/decluttered of user-selected objects.
-
Citations
17 Claims
-
1. A computer method of displaying a subject environment comprising:
-
digitally generating a set of one or more images that form a first view depicting a subject environment in an origination state instead of in a current state, such that the first view is a three-dimensional (3D) diminished reality of the subject environment by; receiving a two-dimensional (2D) source image displaying the subject environment in the current state, determining line segments defining the borders of the subject environment based on line segments in the 2D source image and line segments extrapolated from the 2D source image, the determined line segments being a background of the subject environment, and digitally forming a 3D model of the 3D diminished reality of the subject environment, the 3D model being based on the background of the subject environment and having objects of the 2D source image that are separate from the background removed from the 3D model; and enabling computer-based user interaction with the set of images forming the first view in a manner that generates a second view, the second view being a 3D augmented reality representation of the subject environment in its origination state having augmentations based on the enabled computer-based user interaction instead of the current state. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A computer apparatus for displaying a subject environment, comprising:
-
a reality staging engine executable by a processor and configured to generate a set of one or more images that form a first view depicting a subject environment in an origination stage other than a current stage by; receiving a two-dimensional (2D) source image displaying the subject environment in the current state, and determining line segments defining the borders of the subject environment based on line segments in the 2D source image and line segments extrapolated from the 2D source image, the determined line segments being a background of the subject environment; a 3D modeler coupled to receive the generated set of images from the reality staging engine, and the 3D modeler configured to form a 3D model of the subject environment in diminished reality by digitally forming a 3D model of the 3D diminished reality of the subject environment, the 3D model being based on the background of the subject environment and having objects of the 2D source image that are separate from the background removed from the 3D model; and an augmented reality interface enabling user interaction with an augmented reality representation of the subject environment formed from the 3D model in its origination state having augmentations based on the enabled computer-based user interaction instead of the current state. - View Dependent Claims (12, 13, 14, 15, 16)
-
-
17. A computer program product for displaying a subject environment, comprising:
-
a non-transitory computer readable medium; and computer code embodied on the computer readable medium and executable by a processor to display a subject environment by; digitally generating a set of one or more images that form a first view depicting the subject environment in a user-selectable stage different from a current stage of the subject environment, such that the first view is a diminished reality of the subject environment by; receiving a two-dimensional (2D) source image displaying the subject environment in the current state, determining line segments defining the borders of the subject environment based on line segments in the 2D source image and line segments extrapolated from the 2D source image, the determined line segments being a background of the subject environment, and digitally forming a 3D model of the 3D diminished reality of the subject environment, the 3D model being based on the background of the subject environment and having objects of the 2D source image that are separate from the background removed from the 3D model; and providing an augmented reality interface applied to the set of images forming the first view in a manner that generates a second view, the second view being an augmented reality representation of the subject environment in its user-selectable stage having augmentations based on the enabled computer-based user interaction instead of the current stage.
-
Specification