Augmenting an information request

• US 9,633,019 B2
• Filed: 01/05/2015
• Issued: 04/25/2017
• Est. Priority Date: 01/05/2015
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Bostick, James E., Ganci, Jr., John M., Rakshit, Sarbajit K., Trim, Craig M.
• Primary Examiner(s): Lu, Kuen
• Application Number:
  US14/589,110
• Publication Number:
  US 20160196264A1
• Time in Patent Office: 841 Days
• Field of Search: 707706
• CPC Class Codes: G06F 16/433 using audio data
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/5866 using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
• CPC Class Codes: G16C 20/20 Identification of molecular entities, parts thereof or of chemical compositions
• CPC Class Codes: H04N 23/60 Control of cameras or camera modules
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image

Abstract

An electronic device comprises a microphone for receiving an oral request for information about an unspecified object. A sensor receives augmentation information about the unspecified object. Combination logic combines information from the oral request with the augmentation information into a combined format information request. Information retrieval logic then retrieves an answer to the combined format information request.

Claims

1. An electronic device comprising:

a microphone for receiving an oral request for information about an unspecified object;

a camera for receiving augmentation information about the unspecified object, wherein the augmentation information is in a video file generated by the camera;

combination logic for combining information from the oral request with the augmentation information into a combined format information request;

information retrieval logic for retrieving an answer to the combined format information request;

a metadata retrieving logic, wherein the unspecified object is an object that is represented by the video file, wherein the metadata retrieving logic retrieves metadata from the video file that describes the object represented by the video file; and

correlation logic that correlates information from the metadata to identify information about the unspecified object to generate an answer to the combined format information request.

2. The electronic device of claim 1, further comprising:

a transmitter for transmitting the combined format information request to an information server.

3. A method for augmenting an information request, the method comprising:

receiving, by an information server, a request for information about an object, wherein the object is shown in a photograph, wherein the request for information is from an electronic device, and wherein the request for information is in a first format, wherein the first format is for speech recognition;

receiving, by the information server, augmentation information about the object, wherein the augmentation information is generated by the electronic device, wherein the augmentation information is in a second format that is different from the first format, and wherein the second format is for the photograph;

generating, by the information server, a response to the request for information based on the augmentation information;

retrieving, by the information server, embedded information in the photograph about the object shown in the photograph, wherein the embedded information describes the object shown in the photograph; and

locating, by the information server, additional information about the object in the photograph based on the embedded information, wherein the additional information surpasses the embedded information.

4. The method of claim 3, wherein the object is not shown in the photograph, and wherein the method further comprises:

utilizing, by the information server, embedded information in the photograph to retrieve additional information about the object not shown in the photograph, wherein the additional information surpasses the embedded information.

5. The method of claim 3, wherein the request for information is generated by a specific user, and wherein the method further comprises:

associating the request for information with a user profile for the specific user; and

tailoring the response to the request for information based on the user profile.

6. The method of claim 3, further comprising:

receiving, by the information server, a physical gesture of a user; and

utilizing, by the information server, the physical gesture as additional augmentation information about the object.

7. A computer program product for augmenting an information request, the computer program product comprising a computer readable storage medium having program code embodied therewith, wherein the computer readable storage medium is not a transitory signal per se, and wherein the program code is readable and executable by a processor to perform a method comprising:

receiving a request for information about an object, wherein the request for information is from an electronic device, and wherein the request for information is in a first format, wherein the first format is for speech recognition;

receiving augmentation information about the object, wherein the augmentation information is generated by the electronic device, and wherein the augmentation information is in a second format that is different from the first format, wherein the second format is for a video file, and wherein the object is not represented by the video file;

generating a response to the request for information based on the augmentation information; and

utilizing embedded information in the video file to retrieve additional information about the object not represented by the video file, wherein the additional information surpasses the embedded information.

8. The computer program product of claim 7, wherein the object is a photograph that is represented by the video file, and wherein the method further comprises:

retrieving embedded information about the object shown in the photograph, wherein the embedded information describes the object shown in the photograph; and

locating additional information about the object in the photograph based on the embedded information, wherein the additional information surpasses the embedded information.