Display device and control method thereof

• US 9,367,134 B2
• Filed: 03/11/2014
• Issued: 06/14/2016
• Est. Priority Date: 09/28/2012
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Kim, Jihwan
• Primary Examiner(s): Merkoulova, Olga
• Application Number:
  US14/204,817
• Publication Number:
  US 20140192003A1
• Time in Patent Office: 826 Days
• Field of Search: 345173-183, 178 1801- 1811, 178 1901- 1907
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A display device and method for controlling the display device are discussed. In one embodiment, the display device includes a display unit configured to display an object; a tactile feedback unit configured to generate tactile feedback; and a controller configured to: assign first tactile feedback to a first region corresponding to a first object and second feedback to a second region corresponding to a second object; detect a first control input in the first region corresponding to the first object, the first control input controlling the first object displayed on the display unit; generate the first tactile feedback according to properties of the first object; and maintain the first tactile feedback when the first control input is moving from the first region to the second region corresponding to the second object while the first object is controlled by the first control input.

Claims

1. A display device comprising:

a display unit configured to display an object on a display screen;

a tactile feedback unit configured to generate tactile feedback on the display screen; and

a controller configured to;

assign first tactile feedback to a first region corresponding to a first object on the display screen and second tactile feedback to a second region corresponding to a second object on the display screen;

detect a first control input in the first region corresponding to the first object, the first control input controlling the first object displayed on the display screen;

generate the first tactile feedback according to properties of the first object on the display screen;

maintain the first tactile feedback when the first control input is moving from the first region to the second region corresponding to the second object while the first object is controlled by the first control input; and

generate the second tactile feedback according to properties of the second object in response to the first control input when the first control input is detected at a position to which a distance from the first region exceeds a distance threshold.

2. The display device according to claim 1, wherein the first control input includes at least one of touch input, gesture input, sound input, and signal input.

3. The display device according to claim 1, wherein the controller is further configured to generate the second tactile feedback according to properties of the second object in response to the first control input when control with respect to the first object by the first control input ends in the second region.

4. The display device according to claim 1, wherein the controller is further configured to:

detect a second control input that is detected in the second region corresponding to the second object, wherein the second control input is not in control of the first object; and

generate the second tactile feedback according to properties of the second object in response to the second control input.

5. The display device according to claim 1, wherein the second region is a background image displayed on the display unit.

6. The display device according to claim 1, wherein the controller is further configured to display a background image, and

wherein generation of the first tactile feedback includes generating the first tactile feedback according to texture of the first object and texture of the background image.

7. The display device according to claim 1, wherein the controller is further configured to temporarily generate the second tactile feedback different from the first tactile feedback at a time point when the first control input begins to be detected in the second region corresponding to the second object.

8. The display device according to claim 1, wherein the first object includes a plurality of sub-objects, and

wherein the controller is further configured to generate third tactile feedback according to properties of a first sub-object and fourth tactile feedback according to properties of a second sub-object when the first control input is detected in a region of the first sub-object and the second sub-object respectively.

9. The display device according to claim 1, wherein the properties of the first object include at least one of texture, color, weight, pattern and brightness of the displayed first object.

10. The display device according to claim 1, wherein the controller is further configured to control the first object in response to the first control input such that the first object is controlled based on any one of an X-axis component or a Y-axis component of the first control input.

11. The display device according to claim 1, wherein control with respect to the first object includes at least one of movement, rotation, enlargement and contraction of the first object.

12. The display device according to claim 1, wherein the display device includes at least one of a smart phone, Personal Digital Assistant (PDA), cellular phone, MP3 music player, laptop computer, smart pad, tablet Personal Computer (PC), television, and smart table, which includes the display unit.

13. The display device according to claim 1, wherein the tactile feedback includes non-contact tactile feedback.

14. The display device according to claim 13, wherein the tactile feedback unit is configured to generate tactile feedback using at least one of ultrasonic vibration, acoustic radiation pressure, magnetic field, compressed air, wearable tactile device and remote tactile device.

15. A method of controlling a display device, the method comprising:

assigning first tactile feedback to a first region corresponding to a first object on a display screen and second tactile feedback to a second region corresponding to a second object on the display screen;

detecting a first control input in the first region corresponding to the first object, the first control input controlling the first object displayed on the display screen;

generating the first tactile feedback according to properties of the first object on the display screen;

maintaining the first tactile feedback when the first control input is moving from the first region to the second region corresponding to the second object while the first object is controlled by the first control input; and

generating the second tactile feedback according to properties of the second object in response to the first control input when the first control input is detected at a position to which a distance from the first region exceeds a distance threshold.

16. The method according to claim 15, wherein the first control input includes at least one of touch input, gesture input, sound input, and signal input.

17. The method according to claim 15, further comprising:

generating the second tactile feedback according to properties of the second object in response to the first control input when control with respect to the first object by the first control input ends in the second region.

18. The method according to claim 15, further comprising:

detecting a second control input that is detected in the second region corresponding to the second object, wherein the second control input is not in control of the first object; and

generating the second tactile feedback according to properties of the second object in response to the second control input.

19. The method according to claim 15, wherein the second region is a background image displayed on the display unit.

20. The method according to claim 15, further comprising:

displaying a background image, and

wherein generation of the first tactile feedback includes generating the first tactile feedback according to texture of the first object and texture of the background image.

21. The method according to claim 15, further comprising:

generating the second tactile feedback different from the first tactile feedback at a time point when the first control input begins to be detected in the second region corresponding to the second object.

22. The method according to claim 15, further comprising:

generating third tactile feedback according to properties of a first sub-object and fourth tactile feedback according to properties of a second sub-object when the first control input is detected in a region of the first sub-object and the second sub-object respectively,

wherein the first object includes the first sub-object and the second sub-object.

23. The method according to claim 15, wherein the properties of the first object include at least one of texture, color, weight, pattern and brightness of the displayed first object.

24. The method according to claim 15, further comprising:

controlling the first object in response to the first control input such that the first object is controlled based on any one of an X-axis component or a Y-axis component of the first control input.

25. The method according to claim 15, wherein control with respect to the first object includes at least one of movement, rotation, enlargement and contraction of the first object.

26. The method according to claim 15, wherein the display device includes at least one of a smart phone, Personal Digital Assistant (PDA), cellular phone, MP3 music player, laptop computer, smart pad, tablet Personal Computer (PC), television, and smart table, which includes the display unit.

27. The method according to claim 15, wherein the tactile feedback includes non-contact tactile feedback.

28. The method according to claim 27, the tactile feedback is generated by using at least one of ultrasonic vibration, acoustic radiation pressure, magnetic field, compressed air, a wearable tactile device and a remote tactile device.