Method and system for associating user comments to a scene captured by a digital imaging device

• US 7,529,772 B2
• Filed: 09/27/2005
• Issued: 05/05/2009
• Est. Priority Date: 09/27/2005
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Scenera Technologies LLC (Scenera Research LLC)
• Inventors: Singh, Mona
• Primary Examiner(s): Fleurantin; Jean B
• Application Number:
  US11/237,148
• Publication Number:
  US 20070081090A1
• Time in Patent Office: 1,316 Days
• Field of Search: 707 1- 10, 707100-1041, 707200-206, 715/700, 715/728, 715/773, 715/831, 348/208.14
• US Class Current: 1/1
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/322 used signal is digitally coded
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 1/00132 in a digital photofinishing system, i.e. a system where digital photographic images undergo typical photofinishing processing, e.g. printing ordering
• CPC Class Codes: H04N 1/00183 Photography assistance, e.g. displaying suggestions to the user
• CPC Class Codes: H04N 2101/00 Still video cameras
• CPC Class Codes: H04N 23/631 Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 5/765 Interface circuits between an apparatus for recording and another apparatus
• CPC Class Codes: H04N 5/772 the recording apparatus and the television camera being placed in the same enclosure
• CPC Class Codes: H04N 5/907 using static stores, e.g. storage tubes or semiconductor memories H04N5/91 takes precedence
• CPC Class Codes: H04N 9/8205 involving the multiplexing of an additional signal and the colour video signal
• CPC Class Codes: H04N 9/8211 the additional signal being a sound signal H04N9/835 takes precedence
• CPC Class Codes: H04N 9/8233 the additional signal being a character code signal

Abstract

A method for providing user comments relating to a scene captured by an image capture device and a digital imaging device configured to implement the method are described. In one aspect, a scene to be captured is displayed to a user through a display device of the image capture device. The image capture device uses an eye-tracking system to track where the user is gazing as the user views the scene, and detects and collects a user input that comprises user comments. While the user views the scene, a processor in the image capture device associates the user input with a location in the scene corresponding to an area where the user is gazing.

Claims

1. A method for providing comments relating to a scene captured by an image capture device, the method comprising:

displaying a scene to be captured to a user through a display device of the image capture device;

tracking where the user is gazing as the user views the scene;

detecting and collecting a user input that comprises user comments; and

associating the user input with a location in the scene corresponding to an area where the user is gazing while the user views the scene.

2. The method according to claim 1 further comprising repeatedly tracking, detecting, collecting and associating until the user captures the scene using the image capture device.

3. The method according to claim 1 wherein detecting and collecting the user input comprises:

recording voice data.

4. The method according to claim 3 further comprising:

providing a voice recognition module in the image capture device; and

using the voice recognition module to translate the voice data into text data, wherein associating the user input includes associating at least one of the voice data and the text data with the location in the scene.

5. The method according to claim 1 wherein detecting and collecting the user input comprises providing in the image capture device a keypad having a plurality of keys for text entry and sensing an activation of at least one of the plurality of keys.

6. The method according to claim 1 further comprising:

after an image of the scene is captured by the image capture device, storing the location in the scene and the associated user comments as metadata for the captured image.

7. The method according to claim 6 further comprising:

displaying the captured image to the user;

tracking the user'"'"'s gaze as the user views the captured image; and

presenting the user comments associated with the location in the image when the user'"'"'s gaze dwells on the location.

8. The method according to claim 6 further comprising:

allowing the user to review and modify the user comments; and

storing the modified user comments as metadata for the captured image.

9. The method of claim 1 wherein tracking the direction of the user'"'"'s gaze includes:

providing a marker in the display device corresponding to the location where the user is gazing; and

moving the marker as the user'"'"'s gaze moves.

10. The method of claim 1 further comprising zooming-in on a portion of the scene where the user is gazing so that the user comments are more precisely associated with a particular location in the scene.

11. The method of claim 1, wherein the user input comprising the user comments is associated with the location in the scene at the time the user input is detected.

12. The method of claim 11, wherein if the user'"'"'s gaze moves a predetermined amount while detecting the user input, the method further comprises associating the user input with a combination of locations upon which the user'"'"'s gaze was tracked while detecting the user input.

13. A digital imaging device comprising:

a display device for displaying a scene to be captured to a user;

an eye-tracking system for tracking where a user is gazing as the user views the scene through the display device;

a user input module stored on the digital imaging device for detecting and collecting user comments; and

a processor for associating the user input with a location in the scene corresponding to an area where the user is gazing while the user views the scene.

14. The digital imaging device of claim 13 wherein the user input module comprises a voice data recorder.

15. The digital imaging device of claim 14 further comprising a voice recognition module that translates the voice data into text data.

16. The digital imaging device of claim 15 wherein the processor associates at least one of the voice data and the text data with the location in the scene.

17. The digital imaging device of claim 13 wherein the user input module comprises a keypad having a plurality of keys for text entry and a means for sensing an activation of at least one of the plurality of keys.

18. The digital imaging device of claim 13 further comprising:

an imaging module for capturing an image of the scene; and

a storage mechanism for storing the location in the scene and the associated user input as metadata for the captured image.

19. The digital imaging device of claim 18 wherein the display device displays the captured image to the user and, as the user is viewing the captured image, the display device displays the user comments associated with the location in the scene when the user'"'"'s gaze dwells on the location.

20. The digital imaging device of claim 13, wherein the processor is configured to associate the user input comprising the user comments with the location in the scene at the time the user input is detected.

21. The digital imaging device of claim 20, wherein if the user'"'"'s gaze moves a predetermined amount while detecting the user input, the processor is further configured to associate the user input with a combination of locations upon which the user s gaze was tracked while detecting the user input.

22. A computer readable storage medium containing a computer program for providing comments relating to a scene captured by an image capture device, the computer program comprising executable instructions for:

displaying a scene to be captured to a user through a display device of the image capture device;

tracking where the user is gazing as the user views the scene;

detecting and collecting a user input that comprises user comments; and

associating the user input with a location in the scene corresponding to an area where the user is gazing while the user views the scene.

23. The computer readable storage medium according to claim 22 further comprising executable instructions for repeatedly tracking, detecting, collecting and associating until the user captures the scene using the image capture device.

24. The computer readable storage medium according to claim 22 wherein the executable instructions for detecting and collecting the user input comprise executable instructions for:

recording voice data.

25. The computer readable storage medium according to claim 24 further comprising executable instructions for:

using a voice recognition module to translate the voice data into text data, wherein associating the user input includes associating at least one of the voice data and the text data with the location in the scene.

26. The computer readable storage medium according to claim 22 further comprising instructions for:

storing the location in the scene and the associated user comments as metadata for the captured image after an image of the scene is captured by the image capture device.

27. The computer readable storage medium according to claim 26 further comprising instructions for:

displaying the captured image to the user;

tracking the user'"'"'s gaze as the user views the captured image; and

presenting the user comments associated with the location in the image when the user'"'"'s gaze dwells on the location.

28. The computer readable storage medium according to claim 26 further comprising instruction for:

allowing the user to review and modify the user comments; and

storing the modified user comments as metadata for the captured image.

29. The computer readable storage medium of claim 22 further comprising instructions for zooming-in on a portion of the scene where the user is gazing so that the user comments are more precisely associated with a particular location in the scene.

30. The computer readable storage medium of claim 22, wherein if the user'"'"'s gaze moves a predetermined amount while detecting the user input, the computer readable medium further comprises instructions for associating the user input with a combination of locations upon which the user'"'"'s gaze was tracked while detecting the user input.