METHOD AND SYSTEM FOR PROVIDING INFORMATION ABOUT OBJECTS IN REFRIGERATOR

• US 20200134291A1
• Filed: 10/25/2019
• Published: 04/30/2020
• Est. Priority Date: 10/25/2018
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Kim, Jaehwan, Kim, Taehoon
• Granted Patent: US 11,508,166 B2
• Time in Patent Office: Days
• CPC Class Codes: F25D 11/00 Self-contained movable devices, e.g. domestic refrigerators
• CPC Class Codes: F25D 2400/361 Interactive visual displays
• CPC Class Codes: F25D 2500/06 Stock management
• CPC Class Codes: F25D 2700/06 Sensors detecting the presence of a product
• CPC Class Codes: F25D 29/00 Arrangement or mounting of control or safety devices
• CPC Class Codes: G06F 16/538 Presentation of query results
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 20/64 Three-dimensional objects
• CPC Class Codes: G06V 20/68 Food, e.g. fruit or vegetables

Abstract

A method of providing information about an object in a refrigerator is provided. The method includes: obtaining, using a camera, an image of a plurality of objects stored in the refrigerator; displaying the image on a display of the refrigerator; receiving a first user input indicating a first object from among the plurality of objects included in the image; and displaying a substitute image of the first object on the display based on the first user input.

Claims

1. A method of providing information about an object in a refrigerator, the method comprising:

obtaining, using a camera, an image of a plurality of objects stored in the refrigerator;

displaying the image on a display of the refrigerator;

receiving a first user input indicating a first object from among the plurality of objects included in the image; and

displaying a substitute image of the first object on the display based on the first user input.

2. The method of claim 1, wherein the displaying the substitute image of the first object comprises:

retrieving a representative image corresponding to the first object; and

displaying the representative image on the display as the substitute image.

3. The method of claim 1, wherein the displaying the substitute image of the first object comprises:

superimposing and displaying the substitute image of the first object on the display at a location of the image that corresponds to the first object.

4. The method of claim 1, further comprising:

receiving a second user input; and

displaying a rotated substitute image on the display based on the second user input.

5. The method of claim 1, further comprising:

receiving a third user input; and

displaying detailed information about the first object on the display based on the third user input.

6. The method of claim 1, further comprising:

identifying at least one object of which an expiration date is within a preset time limit from among the plurality of objects; and

displaying, on the image displayed on the display, information indicating the expiration date and the at least one object.

7. A refrigerator comprising:

a camera configured to obtain an image of a plurality of objects stored in the refrigerator;

a display configured to display the image;

a user input interface configured to receive a first user input indicating a first object from among the plurality of objects included in the image; and

a processor configured to display a substitute image of the first object on the display based on the first user input.

8. The refrigerator of claim 7, wherein the processor is further configured to:

retrieve a representative image corresponding to the first object; and

display the representative image on the display as the substitute image.

9. The refrigerator of claim 7, wherein the processor is further configured to superimpose and display the substitute image of the first object on the first object of the image on the display.

10. The refrigerator of claim 7, wherein the processor is further configured to:

receive, through the user input interface, a second user input; and

display a rotated substitute image on the display based on the second user input.

11. The refrigerator of claim 7, wherein the processor is further configured to:

receive, through the user input interface, a third user input; and

display detailed information about the first object on the display based on the third user input.

12. The refrigerator of claim 7, wherein the processor is further configured to:

identify at least one object of which an expiration date is within a preset time limit from among the plurality of objects; and

display, on the image displayed on the display, information indicating the expiration date and the at least one object.

13. A non-transitory computer readable recording medium storing a program which is executable by a processor to perform a method for controlling a refrigerator that includes a camera and a display, the method comprising:

obtaining, using the camera, an image of a plurality of objects stored in the refrigerator;

displaying the image on the display;

receiving a first user input indicating a first object from among the plurality of objects included in the image; and

displaying a substitute image of the first object on the display based on the first user input.

14. The non-transitory computer readable recording medium of claim 13, wherein the displaying of the substitute image of the first object comprises:

retrieving a representative image corresponding to the first object; and

displaying the representative image on the display as the substitute image.

15. The non-transitory computer readable recording medium of claim 13, wherein the displaying of the substitute image of the first object comprises superimposing and displaying the substitute image of the first object on the display at a location of the image that corresponds to the first object.

16. The non-transitory computer readable recording medium of claim 13, wherein the method further comprises:

receiving a second user input; and

displaying a rotated substitute image on the display based on the second user input.

17. The non-transitory computer readable recording medium of claim 13, wherein the method further comprises:

receiving a third user input; and

displaying detailed information about the first object on the display based on the third user input.

18. The non-transitory computer readable recording medium of claim 13, wherein the method further comprises:

identifying at least one object of which an expiration date is within a preset time limit from among the plurality of objects; and

displaying, on the image displayed on the display, information indicating the expiration date and the at least one object.