Image information search

• US 9,336,243 B2
• Filed: 11/12/2012
• Issued: 05/10/2016
• Est. Priority Date: 11/17/2011
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Hayato, Kiriyama, Shioya, Tomohiro, Tsumura, Tadashi
• Primary Examiner(s): Gorney, Boris
• Assistant Examiner(s): Andersen, Kris
• Application Number:
  US13/674,558
• Publication Number:
  US 20130132414A1
• Time in Patent Office: 1,275 Days
• Field of Search: 707/758
• US Class Current: 1/1
• CPC Class Codes: G06F 16/532 Query formulation, e.g. graphical querying
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually

Abstract

To inform a user that image data including an image of the user or the like is posted on a network, an information providing apparatus includes an acquisition unit for acquiring an action log including a history of a set of a user'"'"'s positions and dates and times when the user was at the positions. The apparatus further includes a search unit for searching for image data that has been captured at a location and a date and time corresponding to a position of the user and a date and time included in the action log from image data posted on a network. The apparatus also includes a matching unit for detecting image data that includes an image relating to the user from pieces of image data found by the search unit.

Claims

1. An information providing apparatus comprising:

a processor;

a computer readable storage medium storing computer readable program code executable by the processor to;

acquire an action log comprising a history of a set of user positions and dates and times when a user was at the user was at the user positions;

expand the user positions and times in the action log into circular spatial ranges with a first radius when it does not rain and a smaller radius when it rains and merge the circular spatial ranges into elliptic spatial ranges;

acquire a user means of transportation between the user positions from a terminal apparatus;

modify the elliptic spatial ranges based on the user means of transportation, wherein the elliptic spatial ranges have a first longitudinal diameter and a first lateral diameter when the user moves on foot, a second longitudinal diameter and a second lateral diameter when the user moves by bicycle, a third longitudinal diameter and a third lateral diameter when the user is in an automobile, and a fourth longitudinal diameter and a fourth lateral diameter when the user moves by public transportation;

search for image data that has been captured at a location and time within the elliptic spatial ranges and a time range corresponding to a position and time of the user in the action log from network image data posted on a network; and

detect image data that comprises an image relating to the user from pieces of image data found by the search.

2. The information providing apparatus according to claim 1, wherein the processor expands the user positions and the dates and time in the action log into the elliptic spatial ranges and the time range, respectively, according to a preset interpolation policy and searches for image data that has been captured in the elliptic spatial ranges and in the time range.

3. The information providing apparatus according to claim 2, wherein the processor expands the user positions and the dates and times included in the action log into the elliptic spatial ranges and the time range, respectively, according to the interpolation policy to change a degree of expansion according to the weather between the user positions and the dates and times.

4. The information providing apparatus according to claim 1, wherein the processor acquires a velocity of the user from a terminal apparatus, and estimates the user means of transportation based on the velocity.

5. The information providing apparatus according to claim 4, wherein the processor acquires an acceleration of the user from the terminal apparatus and estimates the user means of transportation based on the acceleration.

6. The information providing apparatus according to claim 5, wherein the processor acquires audio data representing an ambient sound around the user and determines the user means of transportation based on the audio data.

7. The information providing apparatus according to claim 6, wherein the processor searches the network image data by extracting a data part representing the location and the date and time.

8. The information providing apparatus according to claim 7, wherein the processor acquires an image data detection exemption range from the user and does not search for image data that has been captured within the detection exemption range.

9. The information providing apparatus according to claim 1, wherein the processor detects whether each piece of image data includes an image of the face of the user.

10. The information providing apparatus according to claim 1, wherein when the processor searches motion picture data and detects whether an image relating to the user is in a time range corresponding to a date and time of the motion picture data.

11. A method for image information search comprising:

acquiring, by use of a processor, an action log comprising a history of a set of user positions and dates and times when a user was at the user positions;

expanding the user positions and times in the action log into circular spatial ranges with a first radius when it does not rain and a smaller radius when it rains and merges the circular spatial ranges into elliptic spatial ranges;

acquiring a user means of transportation between the user positions from a terminal apparatus;

modifying the elliptic spatial ranges based on the user means of transportation, wherein the elliptic spatial ranges have a first longitudinal diameter and a first lateral diameter when the user moves on foot, a second longitudinal diameter and a second lateral diameter when the user moves by bicycle, a third longitudinal diameter and a third lateral diameter when the user is in an automobile, and a fourth longitudinal diameter and a fourth lateral diameter when the user moves by public transportation;

searching for image data that has been captured at a location and time within the elliptic spatial ranges and a time range corresponding to a position and time of the user in the action log from network image data posted on a network; and

detecting image data that comprises an image relating to the user from pieces of image data found by the search.

12. The method according to claim 11, the method further comprising expanding the user positions and the dates and times in the action log into the elliptic spatial ranges and the time range, respectively, according to a preset interpolation policy and searching for image data that has been captured in the elliptic spatial ranges and in the time range.

13. The method according to claim 12, the method further comprising expanding the user positions and the dates and time included in the action log into the elliptic spatial ranges and the time range, respectively, according to the interpolation policy to change a degree of expansion according to the weather between the user positions and the dates and times.

14. A computer program product for image information search, the computer program product comprising a non-transitory computer readable storage medium having program code embodied therein, the program code readable/executable by a processor to:

acquire an action log comprising a history of a set of user positions and dates and times when a user was at the user positions;

expand the user positions and times in the action log into circular spatial ranges with a first radius when it does not rain and a smaller radius when it rains and merge the circular spatial ranges into elliptic spatial ranges;

acquire a user means of transportation between the user positions from a terminal apparatus;

modify the elliptic spatial ranges based on the user means of transportation, wherein the elliptic spatial ranges have a first longitudinal diameter and a first lateral diameter when the user moves on foot, a second longitudinal diameter and a second lateral diameter when the user moves by bicycle, a third longitudinal diameter and a third lateral diameter when the user is in an automobile, and a fourth longitudinal diameter and a fourth lateral diameter when the user moves by public transportation;

search for image data that has been captured at a location and time within the elliptic spatial ranges and a time range corresponding to a position and time of the user in the action log from network image data posted on a network; and

detect image data that comprises an image relating to the user from pieces of image data found by the search.

15. A system comprising:

a non-transitory computer readable storage medium storing computer readable program code executable by a processor, the computer readable program code comprising;

code that acquires an action log comprising a history of a set of user positions and dates and times when the user was at the user positions;

code that expands the user positions and times in the action log into circular spatial ranges with a first radius when it does not rain and a smaller radius when it rains and merges the circular spatial ranges into elliptic spatial ranges;

code that acquires a user means of transportation between the user positions from a terminal apparatus;

code that modifies the elliptic spatial ranges based on the user means of transportation, wherein the elliptic spatial ranges have a first longitudinal diameter and a first lateral diameter when the user moves on foot, a second longitudinal diameter and a second lateral diameter when the user moves by bicycle, a third longitudinal diameter and a third lateral diameter when the user is in an automobile, and a fourth longitudinal diameter and a fourth lateral diameter when the user moves by public transportation;

code that searches for image data that has been captured at a location and time within the elliptic spatial ranges and a time range corresponding to a position and time of the user in the action log from network image data posted on a network;

code that detects image data that comprises an image relating to the user from pieces of image data found by the search; and

a terminal apparatus connected to an information providing apparatus via the network.