Method for controlling operation of refrigerator by using speech recognition, and refrigerator employing same

• US 9,373,164 B2
• Filed: 01/13/2012
• Issued: 06/21/2016
• Est. Priority Date: 01/13/2012
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Lee, Kyehwan, Kim, Eugene, Myung, Joohyun
• Primary Examiner(s): Cunningham, Gregory F
• Application Number:
  US14/371,681
• Publication Number:
  US 20150294451A1
• Time in Patent Office: 1,621 Days
• Field of Search: 177/143, 62/36, 382/312
• US Class Current: 1/1
• CPC Class Codes: F25D 2400/361 Interactive visual displays
• CPC Class Codes: F25D 2500/06 Stock management
• CPC Class Codes: F25D 2700/02 Sensors detecting door opening
• CPC Class Codes: F25D 2700/06 Sensors detecting the presence of a product
• CPC Class Codes: F25D 29/00 Arrangement or mounting of control or safety devices
• CPC Class Codes: G06T 2207/30128 Food products
• CPC Class Codes: G06T 7/0004 Industrial image inspection
• CPC Class Codes: G06V 20/68 Food, e.g. fruit or vegetables
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems
• CPC Class Codes: G10L 15/00 Speech recognition G10L17/00 takes precedence
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence

Abstract

A refrigerator according to one embodiment of the present invention includes: a memory for storing information on food stored in a storeroom; a weight detecting unit disposed in the storeroom for detecting the weight of the food in order to determine whether food is received or withdrawn; a controller for creating a request for confirmation information on the received or withdrawn food when the food is determined to have been received or withdrawn; a speech output unit for outputting the request created by the controller as speech; and a speech input unit for receiving the response to the output request as speech, wherein the controller analyzes the response and updates information on the food stored in the storeroom.

Claims

1. A refrigerator comprising:

a storage chamber shaped to store food items;

a memory configured to store information regarding food items presently kept in the storage chamber;

a weight sensing unit coupled to the storage chamber and configured to sense weight of the food items presently kept in the storage chamber;

a speech output unit;

a speech input unit; and

a controller configured to;

generate a query directed to a user of the refrigerator for identifying information regarding either a food item which has been received at the storage chamber when the weight sensing unit indicates that a food item has been placed in the storage chamber, or regarding a food item which has been removed from the storage chamber when the weight sensing unit indicates that a food has been removed from the storage chamber;

cause the speech output unit to output the query as speech;

receive a response, via the speech input unit, with respect to the query; and

update the information regarding food items presently kept in the storage chamber based on the response.

2. The refrigerator of claim 1, wherein the weight sensing unit includes a plurality of weight sensors, and the weight sensing unit determines whether the food item has been received or removed by sensing a change in weight of each of the plurality of weight sensors and a change in weight of the entirety of the plurality of sensors.

3. The refrigerator of claim 2, wherein when the change in weight of said each of the plurality of weight sensors is sensed and the change in weight of the entirety of the plurality of weight sensors is sensed, the weight sensing unit determines that the food item has been received or removed.

4. The refrigerator of claim 2, wherein when the change in weight of said each of the plurality of weight sensors is sensed but the change in weight of the entirety of the plurality of weight sensors is not sensed, the weight sensing unit determines that the food item has been moved within the storage chamber.

5. The refrigerator of claim 4, wherein when it is determined that the food item has been moved within the storage chamber, the controller is further configured to generate a query for identifying information regarding the moved food item.

6. The refrigerator of claim 1, wherein the information regarding the food items presently kept in the storage chamber includes a name of each of the food items presently kept in the storage chamber and a storage position of each of the food items presently kept in the storage chamber.

7. The refrigerator of claim 1, further comprising:

an opening and closing sensing unit configured to sense opening and closing of a door of the refrigerator,

wherein the controller is further configured to cause the speech output unit to output the generated query as speech when the door is sensed to be closed.

8. The refrigerator of claim 1, wherein the weight sensing unit includes any one of a load cell, a touch sensor, or a vibration sensor.

9. A method for controlling an operation of a refrigerator, the method comprising:

storing, in a memory, information regarding food items presently kept in a storage chamber of the refrigerator;

sensing, by a weight sensor of the refrigerator coupled to the storage chamber, weight of the food items presently kept in the storage chamber;

generating, by a controller of the refrigerator, a query directed to a user of the refrigerator for identifying information regarding either a food item which has been received at the storage chamber when the weight sensor indicates that a food item has been placed in the storage chamber, or regarding a food item which has been removed from the storage chamber when the weight sensor indicates that a food has been removed from the storage chamber;

outputting, via a speech output unit of the refrigerator, the generated query as speech;

receiving, via a speech input unit of the refrigerator, a response with respect to the query; and

updating the information regarding food items presently kept in the storage chamber based on the response.