Display device and control method thereof

• US 8,743,072 B2
• Filed: 04/05/2013
• Issued: 06/03/2014
• Est. Priority Date: 09/28/2012
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Kim, Jihwan
• Primary Examiner(s): Merkoulova, Olga
• Application Number:
  US13/857,831
• Publication Number:
  US 20140092037A1
• Time in Patent Office: 424 Days
• Field of Search: 345173-183, 341/27, 434/113, 434/114, 715/702, 4555751-5759, 463 1- 69, 178 1801- 1811, 178 1901- 1907
• US Class Current: 345/173
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A display device provides a user with tactile feedback using a tactile user interface. The display device includes a display unit, a tactile feedback unit, and a controller. The controller detects a first control input selecting a first object displayed on the display unit, detects a second control input controlling the first object that is consecutive to the first control input, controls the first object in response to the second control input, generates first tactile feedback according to properties of the first object in response to the second control input, detects a third control input controlling the first object that is consecutive to the second control input, the third control input being detected in a region of a second object displayed on the display unit, and maintains the first tactile feedback in response to the third control input while the first object is controlled by the third control input.

Claims

1. A display device comprising:

a display unit configured to display an object;

a tactile feedback unit configured to generate tactile feedback; and

a controller configured to;

detect a first control input selecting a first object displayed on the display unit;

detect a second control input controlling the first object that is consecutive to the first control input;

control the first object in response to the second control input;

generate first tactile feedback according to properties of the first object in response to the second control input while the first object is controlled by the second control input;

detect a third control input controlling the first object that is consecutive to the second control input, wherein the third control input is detected in a region of a second object displayed on the display unit; and

maintain the first tactile feedback in response to the third control input while the first object is controlled by the third control input.

2. The display device according to claim 1, wherein the first, second or third control input include at least one of touch input, gesture input, sound input, and signal input.

3. The display device according to claim 1, wherein the controller is further configured to:

detect a fourth control input that is input in the region of the second object, wherein the fourth control input is not in control of the first object; and

generate second tactile feedback according to properties of the second object in response to the fourth control input.

4. The display device according to claim 1, wherein the controller is further configured to generate second tactile feedback according to properties of the second object in response to the third control input if control with respect to the first object by the third control input ends.

5. The display device according to claim 1, wherein the second object is a background image displayed on the display unit.

6. The display device according to claim 1,

wherein the controller is further configured to display a background image, and

wherein generation of the first tactile feedback includes generating the first tactile feedback according to texture of the first object and texture of the background image.

7. The display device according to claim 1, wherein the controller is further configured to temporarily generate second tactile feedback different from the first tactile feedback at a time point when the third control input begins to be detected in the region of the second object.

8. The display device according to claim 1, wherein the controller is further configured to generate second tactile feedback according to properties of the second object in response to the third control input if a distance between a position where the first object is displayed and a position where the third control input is detected exceeds a preset distance threshold.

9. The display device according to claim 1, wherein the controller is further configured to:

detect a fourth control input that is input in the region of the second object after the third control input is finished;

generate the first tactile feedback if a time from a time point when the third control input is finished to a time point when the fourth control input is detected is equal to or less than a preset time threshold; and

generate second tactile feedback according to properties of the second object if the time from the time point when the third control input is finished to the time point when the fourth control input is detected exceeds the preset time threshold.

10. The display device according to claim 1, wherein the first object includes a plurality of sub-objects.

11. The display device according to claim 1, wherein the properties of the first object include at least one of texture, color, weight, pattern and brightness of the displayed first object.

12. The display device according to claim 1, wherein the display unit includes:

a sensor unit configured to detect a user'"'"'s control input; and

a display unit configured to display a visual user interface.

13. The display device according to claim 1, wherein the controller is further configured to control the first object in response to the second control input such that the first object is controlled based on any one of an X-axis component or a Y-axis component of the second control input.

14. The display device according to claim 1, wherein control with respect to the first object includes at least one of movement, rotation, enlargement and contraction of the first object.

15. The display device according to claim 1, wherein the display device includes at least one of a smart phone, Personal Digital Assistant (PDA), cellular phone, MP3 music player, laptop computer, smart pad, tablet Personal Computer (PC), television, and smart table, which includes the display unit.

16. The display device according to claim 1, wherein the tactile feedback unit is configured to generate tactile feedback using ultrasonic vibration and to control intensity of the tactile feedback by changing the frequency and magnitude of the ultrasonic vibration.

17. The display device according to claim 1, wherein the tactile feedback includes non-contact tactile feedback.

18. The display device according to claim 10, wherein the controller is further configured to generate third tactile feedback according to properties of a first sub-object and fourth tactile feedback according to properties of a second sub-object when the second control input is detected in a region of the first sub-object and the second sub-object respectively.

19. The display device according to claim 18, wherein the controller is further configured to:

generate the third tactile feedback when the second control input is detected in the region of the first sub-object;

generate the fourth tactile feedback when the second control input is detected in the region of the second sub-object; and

maintain the fourth tactile feedback when the third control input is detected in the region of the second object.

20. The display device according to claim 18, wherein the controller is further configured to:

generate the third tactile feedback if the first control input is detected in the region of the first sub-object; and

maintain the third tactile feedback if a time from a time point when the second control input is detected to a time point when the third control input is detected is less than a time threshold.

21. The display device according to claim 19, wherein the fourth tactile feedback is maintained if a time from a time point when the second control input is detected to a time point when the third control input is detected is equal to or exceeds a time threshold.

22. The display device according to claim 17, wherein the tactile feedback unit is configured to generate tactile feedback using at least one of ultrasonic vibration, acoustic radiation pressure, magnetic field, compressed air, wearable tactile device and remote tactile device.

23. A method of controlling a display device, the method comprising:

detecting a first control input selecting a first object displayed on the display unit;

detecting a second control input controlling the first object that is consecutive to the first control input;

controlling the first object in response to the second control input;

generating first tactile feedback according properties of the first object in response to the second control input while the first object is controlled by the second control input;

detecting a third control input controlling the first object that is consecutive to the second control input, wherein the third control input is detected in a region of a second object displayed on the display unit; and

maintaining the first tactile feedback in response to the third control input while the first object is controlled by the third control input.