Information processing apparatus, information outputting method and computer program storage device

• US 8,712,108 B2
• Filed: 03/28/2011
• Issued: 04/29/2014
• Est. Priority Date: 04/06/2010
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Miyahara, Masanori, Hagiwara, Takehiro, Tsunoda, Tomohiro
• Primary Examiner(s): AZARIAN, SEYED H
• Application Number:
  US13/073,400
• Publication Number:
  US 20110243392A1
• Time in Patent Office: 1,128 Days
• Field of Search: 382/100, 382/103, 382106-107, 382/123, 382/155, 382/162, 382/168, 382/173, 382/181, 382/189, 382/206, 382/220, 382/224, 382/232, 382/254, 382/274, 382/276, 382/294, 382/305, 382/312, 600/316, 600/300, 482/4, 434/127, 707/3
• US Class Current: 382/110
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G16H 20/30 relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
• CPC Class Codes: G16H 20/60 relating to nutrition control, e.g. diets

Abstract

An apparatus, method and computer program storage device cooperate to acquire an image of at least a part of a meal. An analysis is then done on the image to determine a substance in the image. The analysis also considers caloric intake and exercise data and compares the same with a health management model to arrive at a recommendation for a user who consumed the meal. Various optional features include using wireless communications to receive exercise data from sensors, as well as communication related images such as the menu of a restaurant or the location of the restaurant.

Claims

1. A computer comprising:

an interface configured to acquire an image, said image including at least part of a meal; and

an image analysis mechanism configured to analyze the image using a discriminant function of discriminating the content of a meal from the image of the at least part of the meal, and to recognize a property of the at least part of the meal, said property including at least one of an energy and a quantity of one or more nutrients associated with the at least part of a meal,

the image analysis mechanism further being configured to assign a score for said property to the at least part of the meal based on the discriminant function,

wherein said image analysis mechanism is further configured to receive at least one of an image of a menu or a text-based version of said menu to assist the image analysis mechanism in recognizing the property.

2. The computer of claim 1, further comprising:

a generation unit configured to generate display information upon which an analysis result is displayed, said analysis result including at least one of an activity recommendation, a nutrient recommendation and at least part of a meal recommendation based on the property of the at least part of a meal.

3. The computer of claim 1, wherein:

said processor is configured to perform a comparison of a health management model with said property of the at least part of a meal and exercise data and produce at least one of activity recommendation, a nutrient recommendation and at least part of a meal recommendation based on said comparison, said health management model having at least a property of a part of a meal component and an exercise component.

4. The computer of claim 1, wherein

said image analysis mechanism is configured to receive data describing a location of a terminal that sends said image of the at least a part of the meal to assist the image analysis mechanism in recognizing the property.

5. The computer of claim 1, wherein said image analysis mechanism includes an infrared processing section.

6. An apparatus comprising:

a non-transitory computer readable storage device configured to store therein computer readable instructions; and

a processor configured to acquire an image of at least a part of a meal and when said processor executes said computer readable instructions, said processor sends a request to another device for analyzing the image using a discriminant function of discriminating the content of a meal from the image of the at least part of the meal, to recognize a property of the at least part of a meal,

said property including at least one of an energy and a quantity of one or more nutrients associated with the at least part of a meal,

wherein the processor is further configured to assign a score for said property to the at least part of the meal based on the discriminant function.

7. The apparatus of claim 6, further comprising:

a communication interface through which said processor sends said request, and through which said processor receives an analysis result from said another device; and

a display upon which said analysis result is displayed, said analysis result including at least one of an activity recommendation, a nutrient recommendation and at least part of a meal recommendation based on the property of the at least part of a meal.

8. The apparatus of claim 7, wherein said at least one of said activity recommendation, said nutrient recommendation and said at least part of a meal recommendation is based on a comparison of the property of the at least part of a meal and exercise data against a predetermined health management model.

9. The apparatus of claim 6, further comprising:

at least one of a heart rate monitor, a pedometer and an accelerometer configured to monitor accumulated exercise data.

10. The apparatus of claim 6, wherein:

said communication interface is configured to receive a wireless signal input from at least one of a heart rate monitor, a pedometer and an accelerometer as input regarding user exercise.

11. The apparatus of claim 6, wherein:

said processor also sends at least one of an image of a menu and a text-based version of said menu to said another device for facilitating in the analyzing the image.

12. The apparatus of claim 6, further comprising:

a location detector configured to detect a location of said apparatus when said image of the at least a part of the meal is sent to said another device for facilitating said another device in determining a menu of food items available at eating establishments near said location.

13. A non-transitory computer readable storage device, comprising:

an interface configured to receive and store therein downloaded instructions, said downloaded instructions when executed by a computer processor perform a method including

acquiring an image of at least a part of a meal; and

analyzing with the computer processor the image using a discriminant function of discriminating the content of a meal from the image of the at least part of meal, to recognize a property of the at least part of the meal, said property including at least one of an energy and a quantity of one or more nutrients associated with the at least part of a meal,

wherein the analyzing step includes assigning a score for said property to the at least part of the meal based on the discriminant function.

14. The non-transitory computer readable storage device of claim 13, wherein said analyzing includes

sending a wireless message to another device of the image to recognize the property of the at least part of a meal, and

receiving an analysis result from said another device.

15. The non-transitory computer readable storage device of claim 13, wherein the method performed by the processor further comprising:

using at least one of location information and menu information to assist in said analyzing.

16. The non-transitory computer readable storage device of claim 13, wherein the method performed by the processor further comprising:

including accumulated exercise information in said analyzing step; and

presenting on a display at least one of a nutrition advice message, a recommended exercise message, and at least part of a meal recommendation based on said analysis result.

17. A method for analyzing at least part of a meal, comprising:

acquiring an image of at least part of a meal; and

analyzing with a computer processor the image using a discriminant function of discriminating the content of a meal from an image of the at least part of the meal, to recognize a property of the at least part of the meal as a factor in an analysis result, said property including at least one of an energy and a quantity of one or more nutrients associated with the at least part of a meal,

wherein the image analyzing step includes assigning a score for said property to the at least part of the meal based on the discriminant function.

18. The method of claim 17, wherein:

said analyzing includes

including accumulated exercise data as another factor in said analysis result, and

comparing said accumulated exercise data and said property of the at least part of a meal to a predetermined health management model.

19. The method of claim 18, further comprising:

sensing at least a portion of accumulated exercise data with at least one of a heart rate monitor, a pedometer and an accelerometer.