Real-time video image analysis for providing virtual interior design

• US 8,668,498 B2
• Filed: 01/01/2012
• Issued: 03/11/2014
• Est. Priority Date: 03/08/2011
• Status: Active Grant

• Current Assignee: Bank of America Corp.
• Original Assignee: Bank of America Corp.
• Inventors: Calman, Matthew A., Ross, Erik Stephen
• Primary Examiner(s): Frisby, Kesha
• Application Number:
  US13/342,066
• Publication Number:
  US 20120231424A1
• Time in Patent Office: 800 Days
• Field of Search: 434/72, 434/79, 434/80
• US Class Current: 434/80
• CPC Class Codes: G09B 25/04 of buildings

Abstract

System, method, and computer program product are provided for using real-time video analysis, such as augmented reality, to assist a user of a mobile device with interior design. Through the use of real-time object recognition features, logos, artwork, products, locations, etc. can be recognized in a real-time video stream and can subsequently be matched with data associated with such to assist the user with selecting the proper design elements for a space, such as a kitchen. The proper design elements may be based off of several factors regarding the design space, include the dimensions of the space, the location of windows, doors and outlets, geographic and positional data, other space features, current design elements, architectural features, décor, and style data of the space, etc. This invention provides a virtual area with design elements, such that a user may view the area and determine the proper décor for the area.

Claims

1. A method for providing interior design recommendations, the method comprising:

receiving a captured image of an interior area for the interior design from a user;

building a directory of data relating to the interior area to design, wherein the directory comprises information regarding characteristics of the interior area to design;

receiving information about products from a mobile device, wherein the products are to be incorporated in the interior area to design;

identifying the products associated with the received information about products;

matching the product with the directory of data relating to the interior area to design, through the use of a processing device; and

presenting the products and indicators associated with the products, via the mobile device of a user, over the captured image of the area to design, wherein the user may position the products within the captured image of the interior area to design, wherein presenting the products and the indicators associated with the products comprises superimposing the products and the indicators associated with the products over real-time video that is captured by the mobile device, of the interior area to design.

2. The method of claim 1, wherein the directory comprises information regarding dimensions of the area.

3. The method of claim 1, wherein the directory further comprises geographical location indications of the area.

4. The method of claim 1, wherein the directory further comprises prior decorating information of the user.

5. The method of claim 1, wherein the receiving product information comprises manually inputted data, wherein the manually inputted data indicates user products preferences.

6. The method of claim 1, wherein the products include furniture to be incorporated into the area to design.

7. The method of claim 1, wherein the products include decorative items to be incorporated into the area to design.

8. The method of claim 1, wherein the receiving product information comprises real-time imaging of a product.

9. The method of claim 1, wherein identifying the products associated with the received information about products further comprises capturing a tag located on or proximate to the product and reading the tag to identify the product.

10. The method of claim 1, wherein presenting an indicator associated with the product comprises displaying the indicator on a display of the mobile device.

11. The method of claim 1, wherein presenting an indicator associated with the product comprises superimposing the indicator over real-time video that is captured by the mobile device.

12. The method of claim 1, wherein the indicator is selectable by the user.

13. The method of claim 1, wherein the indicator, upon being selected, provides the user an offer to purchase the product for the interior design.

14. A system for providing landscaping design recommendations, comprising:

a memory device;

a communication device;

a processing device operatively coupled to the memory device and the communication device, wherein the processing device is configured to execute computer-readable program code to;

receive a captured image of an interior area for the interior design from a user;

build a directory of data relating to the interior area to design, wherein the directory comprises information regarding characteristics of the interior area to design;

receive information about products from a mobile device, wherein the products are to be incorporated in the interior area to design;

identify the products associated with the received information about products;

match the product with the directory of data relating to the interior area to design; and

present the products and indicators associated with the products, via the mobile device of a user, over the captured image of the area to design, wherein the user may position the products within the captured image of the interior area to design, wherein presenting the products and the indicators associated with the products comprises superimposing the products and the indicators associated with the products over real-time video that is captured by the mobile device, of the interior area to design.

15. The system of claim 14, wherein the directory comprises information regarding dimensions of the area.

16. The system of claim 14, wherein the directory further comprises geographical location indications of the area.

17. The system of claim 14, wherein the directory further comprises prior decorating information of the user.

18. The system of claim 14, wherein the receiving product information comprises manually inputted data, wherein the manually inputted data indicates user products preferences.

19. The system of claim 14, wherein the products include furniture to be incorporated into the area to design.

20. The system of claim 14, wherein the products include decorative items to be incorporated into the area to design.

21. The system of claim 14, wherein the receiving product information comprises real-time imaging of a product.

22. The system of claim 14, wherein identifying the products associated with the received information about products further comprises capturing a tag located on or proximate to the product and reading the tag to identify the product.

23. The system of claim 14, wherein presenting an indicator associated with the product comprises displaying the indicator on a display of the mobile device.

24. The system of claim 14, wherein presenting an indicator associated with the product comprises superimposing the indicator over real-time video that is captured by the mobile device.

25. The system of claim 14, wherein the indicator is selectable by the user.

26. The system of claim 14, wherein the indicator, upon being selected, provides the user an offer to purchase the product for the interior design.

27. A computer program product for providing landscaping design recommendations, the computer program product comprising at least one non-transitory computer-readable medium having computer-readable program code portions embodied therein, the computer-readable program code portions comprising:

an executable portion configured for receiving a captured image of an interior area for the interior design from a user;

an executable portion configured for building a directory of data relating to the interior area to design, wherein the directory comprises information regarding characteristics of the interior area to design;

an executable portion configured for receiving information about products from a mobile device, wherein the products are to be incorporated in the interior area to design;

an executable portion configured for identifying the products associated with the received information about products;

an executable portion configured for matching the product with the directory of data relating to the interior area to design; and

an executable portion configured for presenting the products and indicators associated with the products, via the mobile device of a user, over the captured image of the area to design, wherein the user may position the products within the captured image of the interior area to design, wherein presenting the products and the indicators associated with the products comprises superimposing the products and the indicators associated with the products over real-time video that is captured by the mobile device, of the interior area to design.

28. The computer program product of claim 27, wherein the directory comprises information regarding dimensions of the area.

29. The computer program product of claim 27, wherein the directory further comprises geographical location indications of the area.

30. The computer program product of claim 27, wherein the directory further comprises prior decorating information of the user.

31. The computer program product of claim 27, wherein the receiving product information comprises manually inputted data, wherein the manually inputted data indicates user products preferences.

32. The computer program product of claim 27, wherein the products include furniture to be incorporated into the area to design.

33. The computer program product of claim 27, wherein the products include decorative items to be incorporated into the area to design.

34. The computer program product of claim 27, wherein the receiving product information comprises real-time imaging of a product.

35. The computer program product of claim 27, wherein identifying the products associated with the received information about products further comprises capturing a tag located on or proximate to the product and reading the tag to identify the product.

36. The computer program product of claim 27, wherein presenting an indicator associated with the product comprises displaying the indicator on a display of the mobile device.

37. The computer program product of claim 27, wherein presenting an indicator associated with the product comprises superimposing the indicator over real-time video that is captured by the mobile device.

38. The computer program product of claim 27, wherein the indicator is selectable by the user.

39. The computer program product of claim 27, wherein the indicator, upon being selected, provides the user an offer to purchase the product for the interior design.