Diminished Reality

• US 20150187136A1
• Filed: 12/26/2013
• Published: 07/02/2015
• Est. Priority Date: 12/26/2013
• Status: Active Grant

• Current Assignee: Dassault Systemes SA
• Original Assignee: Dassault Systemes SA
• Inventors: Grimaud, Jean-Jacques
• Granted Patent: US 9,514,573 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2210/04 Architectural design, interior design
• CPC Class Codes: G06T 7/564 from contours

Abstract

A computer tool generates user-defined diminished reality images of a subject environment from source images. The diminished reality images display less real-world objects in the subject environment than that displayed in the source images. A 3D model of the subject environment in diminished reality is formed from the diminished reality images. The 3D model supports augmented reality user interaction with views of the subject environment diminished in reality and tidied/decluttered of user-selected objects.

Claims

1. A computer method of displaying a subject environment comprising:

digitally generating a set of one or more images that form a first view depicting a subject environment in an origination state instead of in a current state, such that the first view is a diminished reality of the subject environment; and

enabling computer-based user interaction with the set of images forming the first view in a manner that generates a second view, the second view being an augmented reality representation of the subject environment.

2. A computer method as claimed in claim 1 wherein digitally generating a set of images includes:

receiving in a processor a source image displaying the subject environment in the current state;

determining line segments in the source image that define borders of the subject environment; and

from the determined line segments, digitally forming a 3D model of the diminished reality of the subject environment.

3. A computer method as claimed in claim 2 wherein the first view depicts a lesser amount of real-world objects in the subject environment than amount of real-world objects displayed in the source image.

4. A computer method as claimed in claim 2 wherein the first view depicts the subject environment being bare of objects.

5. A computer method as claimed in claim 1 wherein enabling computer-based user interaction includes providing a user interface to an augmented reality subsystem.

6. A computer method as claimed in claim 1 wherein the generated second view superimposes one or more virtual elements on the first view, each virtual element representing a respective real-world object.

7. A computer method as claimed in claim 1 wherein the subject environment is a room;

and

the first view depicts the room being substantially empty contrary to the current state of the room.

8. A computer method as claimed in claim 7 wherein the second view displays an augmented reality representation of the room with one of:

one or more objects in the room that are absent from the current state of the room, and

one or more objects in the room that are different from the current state of the room.

9. A computer method as claimed in claim 8 wherein the one or more objects are any of:

furniture, furnishings, amenities and accessories.

10. A computer method as claimed in claim 1 wherein for each of a plurality of objects in the subject environment, display of the object in the first view is user-selectable.

11. A computer method as claimed in claim 1 further comprising:

creating a 3D model of the subject environment in diminished reality using the set of images forming the first view, wherein the 3D model is employed in the augmented reality representation of the subject environment.

12. Computer apparatus for displaying a subject environment, comprising:

a reality staging engine executable by a processor and configured to generate a set of one or more images that form a first view depicting a subject environment in a stage other than a current stage;

a 3D modeler coupled to receive the generated set of images from the reality staging engine, and the 3D modeler configured to form a 3D model of the subject environment in diminished reality; and

an augmented reality interface enabling user interaction with an augmented reality representation of the subject environment formed from the 3D model.

13. Computer apparatus as claimed in claim 12 wherein the reality staging engine is further configured to:

receive one or more source images displaying the subject environment in the current stage; and

determine line segments in the source images that define borders of the subject environment.

14. Computer apparatus as claimed in claim 13 wherein the 3D modeler is configured to form the 3D model from the determined line segments.

15. Computer apparatus as claimed in claim 13 wherein the first view depicts a lesser amount of real-world objects in the subject environment than amount of real-world objects displayed in the source image, such that amount of real-world objects in the 3D model of the subject environment is lesser than amount of real-world objects displayed in the source images.

16. Computer apparatus as claimed in claim 12 wherein the augmented reality interface superimposes one or more virtual elements on views of the 3D model, each virtual element representing a respective real-world object.

17. Computer apparatus as claimed in claim 12 wherein the subject environment is a room, and the first view depicts the room being substantially empty.

18. Computer apparatus as claimed in claim 17 wherein the augmented reality representation of the room is displayed with one of:

one or more objects in the room that are absent from the current stage of the room, and

one or more objects in the room that are different from the current stage of the room.

19. Computer apparatus as claimed in claim 18 wherein the objects include any of:

furniture, furnishings, amenities and accessories.

20. A computer program product for displaying a subject environment, comprising:

a non-transitory computer readable medium; and

computer code embodied on the computer readable medium and executable by a processor to display a subject environment by;

digitally generating a set of one or more images that form a first view depicting the subject environment in a user-selectable stage different from a current stage of the subject environment, such that the first view is a diminished reality of the subject environment; and

providing an augmented reality interface applied to the set of images forming the first view in a manner that generates a second view, the second view being an augmented reality representation of the subject environment.