Audio/visual device user interface with tactile feedback

• US 9,201,584 B2
• Filed: 04/17/2012
• Issued: 12/01/2015
• Est. Priority Date: 11/06/2009
• Status: Active Grant

• Current Assignee: Bose Corporation
• Original Assignee: Bose Corporation
• Inventors: Schuler, David L., Sakalowsky, John Michael, Carvajal, Santiago
• Primary Examiner(s): Moorad, Waseem
• Application Number:
  US13/448,657
• Publication Number:
  US 20130106734A1
• Time in Patent Office: 1,323 Days
• Field of Search: 345/173
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 3/03547 Touch pads, in which fingers can move on a surface
• CPC Class Codes: G06F 3/0362 with detection of 1D translations or rotations of an operating part of the device, e.g. scroll wheels, sliders, knobs, rollers or belts
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: H04N 21/42224 Touch pad or touch panel provided on the remote control
• CPC Class Codes: H04N 21/4312 involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/47217 for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks specific graphical features in visual interfaces H04N21/4312

Abstract

A user interface for an audio/visual device includes a touch sensor in which the touch sensor is vibrated by an actuator coupled thereto to provide a user with a virtual texture for a corresponding menu on which the user is provided with the impression that menu item have textures, where the menu may extend about the periphery of a display element so as to at least partially surround a display area in which a visual portion of an audio/visual program may be played and possibly in a manner corresponding to how a surface defined on the touch sensor at least partially surrounds another manually-operable control.

Claims

1. An apparatus comprising:

a touch sensor having a touch-sensitive surface that is manually operable with a digit of a hand of a user, and on which at least a portion of a racetrack surface is defined;

an actuator coupled to the touch sensor to cause vibratory movement of the touch sensor;

a processing device; and

a storage accessible to the processing device and storing a sequence of instructions that when executed by the processing device, causes the processing device to, in response to an indication of the digit touching the racetrack surface at a position on the racetrack surface;

cause a marker to be visually displayed at a location on a menu visually displayed on a display element that corresponds to the position on the racetrack surface, wherein the menu is disposed about a periphery of the display element surrounding a display area at which a visual portion of an audio/visual program is displayed and the shape of the racetrack surface corresponds to the shape of the menu;

cause the display area to be reduced in size to accommodate the menu, and cause the visual portion of the audio/visual program to be rescaled based on the reduced size;

store menu data corresponding to a location of a plurality of menu items on the menu and virtual textures associated with the plurality of menu items;

employ the menu data to determine a virtual texture that corresponds to the location of the marker on the menu; and

operate the actuator to cause vibratory movement of the touch sensor to provide a perception of the virtual texture, wherein a virtual texture of a menu item displayed on the menu differs from a virtual texture of a space between menu items displayed on the menu.

2. The apparatus of claim 1, wherein the virtual texture of a menu item is a virtual bump perceivable by a user of the apparatus as extending outward towards them.

3. The apparatus of claim 1, wherein the processing device is further caused to operate the actuator to cause vibratory movement of the touch sensor to provide a perception of a virtual ridge along an edge of the racetrack surface that corresponds to an edge of the menu.

4. The apparatus of claim 1, wherein the processing device is further caused, in response to an indication of the user increasing a pressure with which the user'"'"'s digit touches the racetrack surface at the position and in response to the marker having been moved to a location in the vicinity of a menu item displayed on the menu, to cause the menu item to be selected, wherein causing the menu item to be selected comprises taking an action to cause the audio/visual program to be selected for playing.

5. The apparatus of claim 1, wherein the menu has a ring shape and the racetrack surface has a ring shape that substantially corresponds to the ring shape of the menu.

6. The apparatus of claim 5, wherein the ring shapes of the menu and the racetrack surface are rectangular ring shapes having four sides, and the racetrack surface is disposed about a periphery of the of the touch-sensitive surface of the touch sensor.

7. The apparatus of claim 1, further comprising a manually-operable control, wherein the shape of the touch-sensitive surface corresponds to the shape of the racetrack surface and the touch-sensitive surface surrounds the manually-operable control.

8. The apparatus of claim 1, wherein a navigation surface is defined on the touch-sensitive surface of the touch sensor at a position on the touch-sensitive surface that is surrounded by the racetrack surface.

9. The apparatus of claim 1, wherein the processing device is further caused to, in response to an indication of the digit touching the racetrack surface at a time when the menu is not displayed, cause the menu to be visually displayed and operate the actuator to cause vibratory movement of the touch sensor to provide a perception of the virtual texture of the menu.

10. The apparatus of claim 9, wherein the processing device is further caused, in response to an indication of the digit no longer touching the racetrack, ceasing to operate the actuator to cause vibratory movement of the touch sensor.

11. The apparatus of claim 10, wherein the processing device is further caused, in response to a predetermined period of time elapsing since the last indication of the digit touching the racetrack surface, causing the menu to cease to be visually displayed on the display element.

12. The apparatus of claim 1, wherein:

the apparatus is a remote control in which the processing device, the storage, the touch sensor and the actuator are disposed;

the processing device is caused to access a menu data stored in the storage that is received from another processing device; and

the menu data is comprised of location data indicating locations of menu items along the menu, and the processing device employs the location data in determining the virtual texture of the menu at the location corresponding to the position on the racetrack surface.

24. The apparatus of claim 1, wherein at least a portion of the menu is substantially transparent, such that a visual portion of an audio/visual program is visible through the portion of the menu.

13. A method comprising:

causing a marker to be visually displayed at a location on a menu visually displayed on a display element that corresponds to a position at which a digit of a hand of a user touches a portion of a racetrack surface defined on a manually-operable touch-sensitive surface of a touch sensor, wherein the menu is disposed about a periphery of the display element surrounding a display area at which a visual portion of an audio/visual program is displayed and the shape of the racetrack surface corresponds to the shape of the menu;

causing the display area to be reduced in size to accommodate the menu, and causing the visual portion of the audio/visual program to be rescaled based on the reduced size;

storing menu data corresponding to a location of a plurality of menu items on the menu and virtual textures associated with the plurality of menu items;

employing the menu data to determine a virtual texture that corresponds to the location of the marker on the menu; and

operating an actuator coupled to the touch sensor to cause vibratory movement of the touch sensor to provide a perception of the virtual texture, wherein a virtual texture of a menu item displayed on the menu differs from a virtual texture of a space between menu items displayed on the menu.

14. The method of claim 13, wherein the virtual texture of a menu item is a virtual bump perceivable by a user of the apparatus as extending outward towards them.

15. The method of claim 13, further comprising operating the actuator to cause vibratory movement of the touch sensor to provide a perception of a virtual ridge along an edge of the racetrack surface that corresponds to an edge of the menu.

16. The method of claim 13, wherein the menu has a ring shape and the racetrack surface has a ring shape that substantially corresponds to the ring shape of the menu.

17. The method of claim 16, wherein the ring shapes of the menu and the racetrack surface are rectangular ring shapes having four sides, and the racetrack surface is disposed about a periphery of the of the touch-sensitive surface of the touch sensor.

18. The method of claim 13, wherein the shape of the touch-sensitive surface corresponds to the shape of the racetrack surface and the touch-sensitive surface surrounds a manually-operable control.

19. The method of claim 13, wherein a navigation surface is defined on the touch-sensitive surface of the touch sensor at a position on the touch-sensitive surface that is surrounded by the racetrack surface.

20. The method of claim 13, further comprising causing the menu to be visually displayed and operating the actuator to cause vibratory movement of the touch sensor to provide a perception of the virtual texture of the menu in response to an indication of the digit touching the racetrack surface at a time when the menu is not displayed.

21. The method of claim 20, further comprising ceasing to operate the actuator to cause vibratory movement of the touch sensor in response to an indication of the digit no longer touching the racetrack.

22. The method of claim 21, further comprising causing the menu to cease to be visually displayed on the display element in response to a predetermined period of time elapsing since the last indication of the digit touching the racetrack surface.

23. The method of claim 13, further comprising employing a processing device and a storage disposed within a remote control in which the touch sensor and actuator are disposed to:

monitor the position at which the racetrack surface is touched by a digit; and

access the storage to employ location data indicating locations of menu items along the menu that is received from another processing device to determine the virtual texture of the menu at the location corresponding to the position on the racetrack surface.

25. The method of claim 13, wherein at least a portion of the menu is substantially transparent, such that a visual portion of an audio/visual program is visible through the portion of the menu.

26. An apparatus comprising:

a touch sensor having a touch-sensitive surface that is manually operable with a digit of a hand of a user, and on which at least a portion of a racetrack surface is defined;

an actuator coupled to the touch sensor to cause vibratory movement of the touch sensor;

a processing device; and

a storage accessible to the processing device and storing a sequence of instructions that when executed by the processing device, causes the processing device to, in response to an indication of the digit touching the racetrack surface at a position on the racetrack surface;

cause a marker to be visually displayed at a location on a menu visually displayed on a display element that corresponds to the position on the racetrack surface, wherein the menu is disposed about a periphery of the display element surrounding a display area at which a visual portion of an audio/visual program is displayed and the shape of the racetrack surface corresponds to the shape of the menu, and wherein the audio/visual program is received from one of a plurality of sources and the content of the menu depends on the source of the audio/visual program and a set of functions supported by the source;

store menu data corresponding to a location of a plurality of menu items on the menu and virtual textures associated with the plurality of menu items;

employ the menu data to determine a virtual texture that corresponds to the location of the marker on the menu; and

operate the actuator to cause vibratory movement of the touch sensor to provide a perception of the virtual texture, wherein a virtual texture of a menu item displayed on the menu differs from a virtual texture of a space between menu items displayed on the menu.