Method and apparatus for tactile perception of digital images

• US 20090251421A1
• Filed: 04/08/2008
• Published: 10/08/2009
• Est. Priority Date: 04/08/2008
• Status: Abandoned Application

• Current Assignee: Sony Ericsson Mobile Communications USA Incorporated (Sony Group Corp.)
• Original Assignee: Sony Ericsson Mobile Communications USA Incorporated (Sony Group Corp.)
• Inventors: Bloebaum, Leland Scott
• Application Number:
  US12/099,318
• Publication Number:
  US 20090251421A1
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user

Abstract

The method and apparatus enables a user to “feel” remote objects depicted in a visual scene. Exemplary embodiments of the invention detect image texture in a digital scene and generate tactile feedback control signals as a function of the detected image texture. In one exemplary embodiment, edge detection techniques are used to detect discontinuities in the digital scene, such as sharp changes in image luminous intensity. Tactile feedback is produced responsive to the tactile feedback control signals by a tactile feedback device. The tactile feedback may be in the form of a vibration and the tactile feedback device may be a vibrator. The strength of intensity of the vibration may be varied depending on the discontinuities in the digital scene.

Claims

1. A method of generating tactile feedback to augment visual perception of a digital scene, said method comprising:

detecting image texture in a digital scene; and

generating tactile feedback control signals as a function of the detected image texture.

2. The method of claim 1 wherein detecting image texture in said digital scene comprises detecting image texture in a digital video of a scene captured while the user pans an image capture device.

3. The method of claim 1 wherein detecting image texture in said digital scene comprises detecting image texture in a digital still image of a scene as the user navigates the still image.

4. The method of claim 1 wherein detecting image texture in said digital scene comprises detecting spatial variations in pixel intensity and/or pixel color in a predetermined sensing window of the digital scene.

5. The method of claim 4 wherein detecting image texture in a digital scene comprises detecting edges and boundaries in the digital scene based on said spatial variations in pixel intensity and/or pixel color.

6. The method of claim 4 wherein detecting image texture in a digital scene comprises detecting texture patterns in said digital scene based on said spatial variations in pixel intensity and/or pixel color.

7. The method of claim 1 wherein generating tactile feedback control signals comprises generating tactile feedback control signals as a reference object is moved relative to the digital scene.

8. The method of claim 1 further comprising generating tactile feedback responsive to said tactile feedback control signals.

9. The method of claim 1 wherein generating tactile feedback comprises producing vibration responsive to said tactile feedback control signals.

10. The method of claim 9 wherein generating tactile feedback comprises varying the properties of the vibration responsive to said tactile feedback control signals.

11. An augmented reality system for augmenting visual perception with tactile sensation, said device comprising:

an image processor to detect image texture in a digital scene; and

a tactile feedback processor to generate tactile feedback control signals as a function of the detected image texture.

12. The augmented reality system of claim 11 wherein the image processor is configured to detect image texture in said digital scene by detecting image texture in a digital video of a scene captured while the user pans an image capture device.

13. The augmented reality system of claim 11 wherein the image processor is configured to detect image texture in said digital scene by detecting image texture in a digital still image of a scene as the user navigates the still image.

14. The augmented reality system of claim 11 wherein the image processor is configured to detect image texture in said digital scene by detecting spatial variations in pixel intensity and/or pixel color in a predetermined sensing window of the digital scene.

15. The augmented reality system of claim 14 wherein the image processor is configured to detect image texture in a digital scene by detecting edges and boundaries in the digital scene based on said spatial variations in pixel intensity and/or pixel color.

16. The augmented reality system of claim 14 wherein the image processor is configured to detect image texture in a digital scene by detecting texture patterns in said digital scene based on said spatial variations in pixel intensity and/or pixel color.

17. The augmented reality system of claim 11 wherein the tactile feedback processor is configured to generate tactile feedback control signals as a reference object is moved relative to the digital scene.

18. The augmented reality system of claim 11 further comprising a tactile feedback device for producing tactile sensation responsive to said tactile feedback control signals.

19. The augmented reality system of claim 18 wherein said tactile feedback device comprises a vibrator.

20. The augmented reality device of claim 19 wherein the tactile feedback processor is configured to generate tactile feedback control signals for varying the properties of the vibration depending on the detected image texture.