METHOD AND DISPLAY DEVICE WITH TACTILE FEEDBACK

• US 20150253850A1
• Filed: 09/25/2012
• Published: 09/10/2015
• Est. Priority Date: 09/25/2012
• Status: Active Grant

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Corporation
• Inventors: Behles, Thorsten, Yliaho, Marko
• Granted Patent: US 10,671,165 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: H04L 51/046 Interoperability with other network applications or services

Abstract

An apparatus comprising: a receiver configured to receive data for at least one user interface element to be displayed on a displayed user interface at a location on a display and a tactile feedback signal indicator associated with the at least one user interface element; a touch sensor configured to determine at least one touch location corresponds to the at least one user interface element location of the displayed user interface; and a tactile effect generator configured to generate a tactile feedback signal to be output by the display dependent on the displayed user interface and based on the tactile feedback signal indicator such that the at least one user interface element provides a simulated experience.

Claims

1-33. -33. (canceled)

34. A method comprising:

generating at least one user interface element to be displayed on a displayed user interface at a location on a display;

generating a tactile feedback signal indicator configured to indicate a tactile feedback signal to be output; and

associating the tactile feedback signal indicator with the at least one user interface element to be displayed on a displayed user interface at the location on the display.

35. The method as claimed in claim 34, wherein associating the tactile feedback signal indicator with the at least one user interface element comprises at least one of:

uploading the at least one user interface element and the tactile feedback signal indicator to a content server;

transmitting control data for selecting the at least one user interface element and the tactile feedback signal indicator from a server apparatus;

transmitting a short message service message comprising the at least one user interface element and the tactile feedback signal indicator;

transmitting a network message comprising the at least one user interface element and the tactile feedback signal indicator;

transmitting a server message comprising the at least one user interface element and the tactile feedback signal indicator; and

transmitting an application message comprising the at least one user interface element and the tactile feedback signal indicator.

36. The method as claimed in claim 34, wherein the tactile feedback signal indicator comprises at least one of:

a tactile feedback signal file;

a recorded audio signal;

an indicator for selecting at least one predefined audio signal;

at least one base tactile feedback signal;

at least one tactile feedback signal processing characteristic;

at least one tactile feedback signal processing characteristic value;

a tactile feedback signal link to a memory location within an apparatus; and

a tactile feedback signal link to a network location external to an apparatus.

37. The method as claimed in claim 34, wherein generating at least one user interface element at a location on the display comprises at least one of:

selecting at least one defined user interface element;

selecting at least one touch based response tag;

generating at least one defined user interface element;

generating text configured to generate the at least one user interface element to be displayed on a displayed user interface at a location on a display; and

generating data configured to generate the at least one user interface element to be displayed on a displayed user interface at a location on a display.

38. The method as claimed in claim 37, wherein when the at least one touch based response is selected, the touch based response tag comprises at least one of:

a touch location;

a defined number of touches;

a touch pressure;

a touch duration;

a touch speed; and

a touch direction.

47. The method as claimed in claim 34, wherein the user interface element comprises at least one of:

a social media user interface element;

a dialogue box user interface element;

an application user interface element;

a universal resource link user interface element;

a user identifier user interface element;

a profile picture user interface element;

a comment user interface element;

a hashtag user interface element;

a mention user interface element;

a feedback user interface element;

a keyword search result user interface element; and

a provided content user interface element.

39. A method comprising:

receiving data for at least one user interface element to be displayed on a displayed user interface at a location on a display and a tactile feedback signal indicator associated with the at least one user interface element;

determining at least one touch location corresponds to the at least one user interface element location of the displayed user interface; and

generating a tactile feedback signal to be output by the display dependent on the displayed user interface and based on the tactile feedback signal indicator such that the at least one user interface element provides a simulated experience.

40. The method as claimed in claim 39, wherein receiving the data for at least one user interface element and the tactile feedback signal indicator associated with the at least one user interface element interface comprises at least one of:

receiving a short message service comprising data;

downloading the at least one user interface element and the tactile feedback signal indicator from a content server;

receiving control data for selecting the at least one user interface element and the tactile feedback signal indicator from a server apparatus;

receiving a network message comprising the data;

receiving a server message comprising data; and

receiving an application message comprising data.

41. The method as claimed in claim 39, wherein the tactile feedback signal indicator comprises at least one of:

a tactile feedback signal file;

a recorded audio signal;

an indicator for selecting at least one predefined audio signal;

at least one base tactile feedback signal;

at least one tactile feedback signal processing characteristic;

at least one tactile feedback signal processing characteristic value;

a tactile feedback signal link to a memory location within an apparatus; and

a tactile feedback signal link to a network location external to an apparatus.

42. The method as claimed in claim 39, wherein the user interface element is associated with at least one field having a value and wherein generating the tactile feedback signal comprises generating the tactile feedback signal based on the value.

43. The method as claimed in claim 42, wherein the field has a range of different values and generating the tactile feedback signal based on the value comprises generating a different tactile feedback signal for each different value within the range of values.

44. The method as claimed in claim 42, wherein the field has a range of different values and generating the tactile feedback signal based on the value comprises:

determining a base tactile feedback signal based on the user interface element; and

modifying the base tactile feedback signal based on the value of the field.

45. The method as claimed in claim 44, wherein modifying the base tactile feedback signal comprises at least one of:

modulating the amplitude of the base tactile feedback signal based on the value of the field; and

modulating the frequency of the base tactile feedback signal based on the value of the field.

46. The method as claimed in claim 42, further comprising at least one of:

generating an audio feedback signal to be output by the display dependent on the user interface element; and

outputting on the display the tactile feedback signal, such that a user experiences at the location of the at least one user interface element the tactile feedback signal based on the user interface element.

48. An apparatus comprising at least one processor and at least one memory including computer code for one or more programs, the at least one memory and the computer code configured to with the at least one processor cause the apparatus at least to:

generate at least one user interface element to be displayed on a displayed user interface at a location on a display;

generate a tactile feedback signal indicator configured to indicate a tactile feedback signal to be output; and

associate the tactile feedback signal indicator with the at least one user interface element to be displayed on a displayed user interface at the location on the display.

49. An apparatus comprising at least one processor and at least one memory including computer code for one or more programs, the at least one memory and the computer code configured to with the at least one processor cause the apparatus at least to:

receive data for at least one user interface element to be displayed on a displayed user interface at a location on a display and a tactile feedback signal indicator associated with the at least one user interface element;

determine at least one touch location corresponds to the at least one user interface element location of the displayed user interface; and

generate a tactile feedback signal to be output by the display dependent on the displayed user interface and based on the tactile feedback signal indicator such that the at least one user interface element provides a simulated experience.

50. The apparatus as claimed in claim 49, wherein the user interface element is associated with at least one field having a value and wherein generating the tactile feedback signal causes the apparatus to generate the tactile feedback signal based on the value.

51. The apparatus as claimed in claim 50, wherein the field has a range of different values and the tactile feedback signal is generated based on one of different values in such a way that the apparatus is configured to generate a different tactile feedback signal for each different value within the range of values.

52. The apparatus as claimed in claim 51, wherein the field has a range of different values and the tactile feedback signal is generated based on one of different values in such a way that the apparatus is configured to:

determine a base tactile feedback signal based on the user interface element; and

modify the base tactile feedback signal based on the value of the field.

53. The apparatus as claimed in claim 52, wherein when the apparatus is configured to modify the base tactile feedback signal further comprises at least one of:

modulate the amplitude of the base tactile feedback signal based on the value of the field; and

modulate the frequency of the base tactile feedback signal based on the value of the field.