Method for replacing 3D objects in 2D environment

• US 9,971,853 B2
• Filed: 05/12/2015
• Issued: 05/15/2018
• Est. Priority Date: 05/13/2014
• Status: Active Grant

• Current Assignee: West Texas Technology Partners LLC
• Original Assignee: Atheer, Inc.
• Inventors: Jovanovic, Milos
• Primary Examiner(s): Nguyen, Kimbinh T
• Application Number:
  US14/710,565
• Publication Number:
  US 20150332510A1
• Time in Patent Office: 1,099 Days
• Field of Search: 345419, 345427, 345473
• CPC Class Codes: G06F 2203/04802 3D-info-object: information is displayed on the internal or external surface of a three dimensional manipulable object, e.g. on the faces of a cube that can be rotated by the user
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0486 Drag-and-drop
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 30/00 Computer-aided design [CAD]
• CPC Class Codes: G06F 30/13 Architectural design, e.g. computer-aided architectural design [CAAD] related to design of buildings, bridges, landscapes, production plants or roads
• CPC Class Codes: G06T 13/205 driven by audio data
• CPC Class Codes: G06T 15/10 Geometric effects
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2215/12 Shadow map, environment map
• CPC Class Codes: G06T 2215/16 Using real world measurements to influence rendering
• CPC Class Codes: G06T 2219/004 Annotating, labelling
• CPC Class Codes: G06T 2219/008 Cut plane or projection plane definition
• CPC Class Codes: G06T 2219/012 Dimensioning, tolerancing
• CPC Class Codes: G06T 2219/2004 Aligning objects, relative positioning of parts
• CPC Class Codes: G06T 2219/2008 Assembling, disassembling
• CPC Class Codes: G06T 2219/2012 Colour editing, changing, or manipulating; Use of colour codes
• CPC Class Codes: G06T 2219/2016 : Rotation, translation, scaling
• CPC Class Codes: G06T 2219/2024 : Style variation

Abstract

Example systems and methods for virtual visualization of a three-dimensional (3D) model of an object in a two-dimensional (2D) environment. The method may include superimposing a first 3D model of an object onto the 2D environment, and replacing the first 3D model of the object with a second 3D model of an object. Further, the method may include superimposing a smart 3D model of an object onto the 2D environment. Additionally, the method may include a code or mark to identify images of the 2D environment to which 3D models of objects have been superimposed.

Claims

1. A method for visualizing a three-dimensional model of an object in a two-dimensional environment, the method comprising:

receiving, with a processor, from a user, an import request to import the two-dimensional environment to be used as a background for the three-dimensional model;

importing, with the processor, based on the import request, the two-dimensional environment;

receiving, with the processor, from the user, a superimposing request to superimpose a three-dimensional model of a smart object onto the two-dimensional environment;

superimposing, with the processor, the three-dimensional model of the smart object onto the two-dimensional environment based on the superimposing request with a scale and a perspective based on the two-dimensional environment, where the smart object includes a playback animation;

saving, with the processor, a resulting image in a storage device communicatively coupled to the processor, the resulting image including the three-dimensional model of the smart object superimposed onto the two-dimensional environment; and

visualizing, via a video display unit communicatively coupled to the processor, the resulting image including the three-dimensional model of the smart object, wherein the playback animation of the smart object is displayed with a scale and a perspective based on the scale and the perspective of the three-dimensional model of the smart object and a position of the three-dimensional model of the smart object within the two-dimensional environment.

2. The method of claim 1, wherein the playback animation comprises a video.

3. The method of claim 1, wherein the playback animation is displayed in accordance with a location of the smart object.

4. The method of claim 1, wherein the position of the smart object is changed from a first position to a second position, where the first and second positions are in different planes and where the playback animation adjusts accordingly.

5. The method of claim 1, wherein the playback animation is a representative image of an audio or visual display.

6. The method of claim 1, further comprising:

receiving a request to replace a first three-dimensional model of a first smart object with a second three-dimensional model of a second smart object within the two-dimensional environment;

removing the first three-dimensional model of the first smart object from the two-dimensional environment; and

superimposing the second three-dimensional model of the second smart object at a same position as the first three-dimensional model within the two-dimensional environment, wherein the second three-dimensional model of the second smart object includes a second playback animation.

7. The method of claim 1, further comprising:

determining, from the two-dimensional environment, a presence of scale data and perspective data added to the two-dimensional environment; and

displaying an object indicating the presence of the scale data and perspective data of the two-dimensional environment.

8. A system for visualization of a three-dimensional model of a smart object in a two-dimensional environment, the system comprising:

a processor; and

a storage device, the storage device containing instructions executable by the processor comprising;

a receiving module configured to receive one or more requests from a user, the requests including one or more of an import request, a scale data request, a superimposing request, and a request to save a resulting image;

an importing module configured to import, based on the import request of the user, the two-dimensional environment;

a superimposing module configured to superimpose, based on the superimposing request, the three-dimensional model of the smart object onto the two-dimensional environment with a scale and a perspective based on the two-dimensional environment;

a visualizing module configured to display playback animation of the smart object wherein a scale and a perspective of the playback animation is based on a position of the three-dimensional model of the smart object in the two-dimensional environment, wherein the playback animation of the smart object corresponds to a type of the smart object, the type of the smart object including one or more of a video playback smart object, an audio playback smart object, and an environment playback smart object; and

a saving module configured to save the resulting image, based on the request to save the resulting image, wherein the resulting image includes the three-dimensional model of the smart object superimposed onto the two-dimensional environment.

9. The system of claim 8, wherein the playback animation comprises a video.

10. The system of claim 8, wherein the playback animation is displayed in accordance with a location of the smart object.

11. The system of claim 8, wherein the storage device further contains instructions executable by the processor comprising a moving module configured to move the position of the smart object from a first position to a second position, where the first and second positions are in different planes.

12. The system of claim 11, wherein the visualizing module is further configured to display the playback animation according to a perspective of the second position.

13. The system of claim 8, wherein the playback animation is a representative image of an audio or visual display.

14. The system of claim 8, wherein the storage device further contains instructions executable by the processor comprising a replacement module configured to, upon receiving a request at the receiving module to replace a first three-dimensional model of a first smart object with a second three-dimensional model of a second smart object within the two-dimensional environment:

remove the first three-dimensional model of the first smart object from the two-dimensional environment; and

superimpose the second three-dimensional model of the second smart object at a same position as the first three-dimensional model within the two-dimensional environment, wherein the second three-dimensional model of the second smart object includes a second playback animation.

15. The system of claim 8, wherein the visualizing module is further configured to:

determine, from the two-dimensional environment, a presence of scale data and perspective data added to the two-dimensional environment; and

display an object indicating the presence of the scale data and perspective data of the two-dimensional environment.

16. A system for visualization of a three-dimensional model of a smart object in a two-dimensional environment, the system comprising:

a processor; and

a storage device, the storage device containing instructions executable by the processor comprising;

a receiving module configured to receive one or more requests from a user, the requests including one or more of an import request, a scale data request, a superimposing request, a replacement request, and a request to save a resulting image;

an importing module configured to import, based on the import request of the user, the two-dimensional environment;

a superimposing module configured to superimpose, based on the superimposing request, the three-dimensional model of the smart object onto the two-dimensional environment with a scale and a perspective based on the two-dimensional environment;

a replacement module configured to remove, based upon the replacement request, the three-dimensional model of the smart object and superimpose a second three-dimensional model of a second smart object at a same position as the first three-dimensional model within the two-dimensional environment;

a visualizing module configured to display a video playback animation of the smart object wherein a scale and a perspective of the video playback animation is based on a position of the three-dimensional model of the smart object in the two-dimensional environment;

a saving module configured to save the resulting image, based on the request to save the resulting image, wherein the resulting image includes the three-dimensional model of the smart object superimposed onto the two-dimensional environment;

an uploading module configured to upload the resulting image to a social network; and

a purchasing module configured to receive a purchasing request for the smart object.

17. The system of claim 16, wherein the storage device further contains instructions executable by the processor comprising a moving module configured to move the position of the smart object from a first position to a second position, where the first and second positions are in different planes.

18. The system of claim 17, wherein the visualizing module is further configured to display the video playback animation according to a perspective of the second position of the smart object within the two-dimensional environment.

19. The system of claim 16, wherein the visualizing module is further configured to:

determine, from the two-dimensional environment, a presence of scale data and perspective data added to the two-dimensional environment; and

display an object indicating the presence of the scale data and perspective data of the two-dimensional environment.

20. The system of claim 16, wherein the visualizing module is configured to generate an audio signal, the audio signal generated according to the perspective of the smart object within the two-dimensional environment.