Hand-held device with two-finger touch triggered selection and transformation of active elements

• US 9,367,216 B2
• Filed: 10/07/2009
• Issued: 06/14/2016
• Est. Priority Date: 05/21/2009
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Inventors: Zalewski, Gary M., Nicholson, Charles
• Primary Examiner(s): Pan, Yongjia
• Application Number:
  US12/574,860
• Publication Number:
  US 20100299595A1
• Time in Patent Office: 2,442 Days
• Field of Search: 715/700, 715/702, 715/764, 715/770, 715/773, 715/860, 715/863, 715/864
• US Class Current: 1/1
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/169 the I/O peripheral being an integrated pointing device, e.g. trackball in the palm rest area, mini-joystick integrated between keyboard keys, touch pads or touch stripes G06F1/1643 takes precedence; constructional details of pointing devices G06F3/033
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04805 Virtual magnifying lens, i.e. window or frame movable on top of displayed information to enlarge it for better reading or selection
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/03547 Touch pads, in which fingers can move on a surface
• CPC Class Codes: G06F 3/04186 Touch location disambiguation
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04855 Interaction with scrollbars
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06N 7/01 Probabilistic graphical models, e.g. probabilistic networks

Abstract

A hand-held electronic device, method of operation and computer readable medium are disclosed. The device may include a case having one or more major surfaces. A visual display and a touch interface are disposed on at least one of the major surfaces. A processor is operably coupled to the visual display and touch screen. Instructions executable by the processor may be configured to a) present an image on the visual display containing one or more active elements; b) correlate one or more active portions of the touch interface to one or more corresponding active elements in the image on the visual display; c) operate the one or more active elements according to a first mode of operation in response to a first mode of touch on one or more of the active portions; and d) operate the one or more active elements according to a second mode of operation in response to a second mode of touch on one or more of the active portions, wherein in the second mode of operation, the second mode of touch activates an enhancement of one or more of the active elements.

Claims

1. A hand-held electronic device, comprising:

a case having first and second major surfaces;

a visual display disposed on the first major surface;

a touch interface disposed on at least one of the major surfaces, wherein the visual display is a touch screen that includes a touch interface;

a processor operably coupled to the visual display and the touch interface; and

instructions executable by the processor configured such that, when executed, the instructions cause the device to;

a) present an image on the visual display containing one or more active elements and one or more inactive elements;

b) operate the one or more active elements according to a first mode of operation in response to a first mode of touch on the touch interface;

c) activate an enhancement of a one of the active elements into an enhanced active element in response to a second mode of touch on the corresponding touch sensitive region that corresponds to the enhanced active element, wherein the instructions are configured to interpret a touch anywhere on the touch screen as an activation of a most recently transformed active element.

2. The device of claim 1 wherein one of the first or second modes of touch is a single fingered touch and the other of the second or first modes of touch is a two-fingered touch.

3. The device of claim 1 wherein the enhancement of the one or more active elements includes a transformation or magnification of an active element.

4. The device of claim 3 wherein the instructions are configured to control a degree of magnification of the active element according to a mode of touch on the touch interface.

5. The device of claim 1 further comprising dividing an entire area of the touch interface into one or more touch sensitive regions that fill the entire area and correlating each said touch sensitive region of the touch interface to a different corresponding one of the active elements in the image on the visual display by performing a tessellation of the image so that the image is divided into one or more regions that fill the display, each of which corresponding to a different one of the active elements.

6. The device of claim 5 wherein the tessellation divides the image into one or more convex regions.

7. The device of claim 6, wherein the tessellation is a Voronoi decomposition.

8. The device of claim 1, wherein the visual display is a touch screen that includes the touch interface.

9. The device of claim 1 wherein the visual display is a touch screen that is separate from the touch interface.

10. The device of claim 1 wherein the visual display is located on first surface of a case and the touch interface is located on a second surface of the case that is opposite the first surface.

11. The device of claim 1 wherein the visual display and touch interface are disposed on the same side of the case.

12. The device of claim 1 wherein the visual display is disposed on a front side of the case and the touch interface is disposed on a back side of the case.

13. The device of claim 1 wherein the case includes first and second case portions wherein the visual display is disposed on the first case portion and wherein the touch interface is disposed on the second case portion.

14. The device of claim 13 wherein the first and second case portions are slidably connected to each other.

15. The device of claim 13 wherein the first and second case portions are connected to each other in a hinged configuration.

16. The device of claim 15 wherein the visual display and touch interface face inward when the first and second portions are in a closed position.

17. The device of claim 15 wherein one of the visual display and touch interface faces inward and the other of the touch interface and visual display faces outward when the first and second portions are in a closed position.

18. The device of claim 15 wherein the visual display and touch interface face inward when the first and second portions are in a closed position.

19. The device of claim 1 wherein the visual display includes a touch screen and the touch interface includes the touch screen.

20. The device of claim 1 wherein the instructions further comprise instructions that activate one or more of the elements in response to a distinct mode of touch that is distinct from a normal mode of touch that does not activate the one or more active elements.

21. The device of claim 20 wherein the distinct mode of touch is a two finger touch and wherein the normal mode of touch is a single finger touch.

22. The device of claim 1 wherein the enhanced active element is a transformed element appears magnified on the visual display compared to the active element prior to transformation into the transformed active element.

23. The device of claim 22 wherein the instructions are configured to control a degree of magnification of the transformed element according to a mode of touch on the touch interface.

24. The device of claim 1, wherein the enhanced active element is a transformed element, wherein the instructions further comprise an instruction configured to revert the transformed element to a form the transformed active element had prior to being transformed into the transformed active element in response to a signal from the touch interface or after an interaction with the transformed element is completed.

25. The device of claim 24 wherein the instructions are configured to revert the transformed active element in response to a removal of a touch on the touch interface.

26. The device of claim 24, wherein the instructions further comprise an instruction to highlight an active element that was most recently transformed.

27. The device of claim 1, wherein each said touch sensitive region is larger than the corresponding active element.

28. The device of claim 1, wherein the first mode of touch is a single fingered touch and the second mode of touch is a two fingered touch.

29. The device of claim 1,

wherein said activating the enhancement includes re-purposing one or more portions of the touch screen outside the enhanced active element to act as inputs for commands associated with the enhanced active element,

wherein the one or more repurposed portions of the touch screen include at least a first portion, a second portion, or both the first portion and the second portion, wherein the first portion is configured to cancel a previous manipulation of the enhanced active element and wherein the second portion is configured to commit to a previous manipulation of the enhanced active element.

30. The device of claim 29, wherein said activating the enhancement includes re-purposing one or more portions of the touch screen outside the enhanced active element to act as inputs for commands associated with the enhanced active element, wherein the one or more re-purposed portions of the touch screen include a buffer region between first or second re-purposed portions and the enhanced active element, wherein the instructions are configured such that a touch to the buffer region is ignored.

31. The device of claim 29, wherein said activating the enhancement includes re-purposing one or more portions of the touch screen outside the enhanced active element to act as inputs for commands associated with the enhanced active element, wherein the one or more re-purposed portions of the touch screen include a buffer region surrounding the enhanced active element, wherein the instructions are configured such that a touch to the buffer region is ignored.

32. The device of claim 1, wherein the enhanced active element is a link and the enhancement includes display of a pre-rendered image of content to which a user may navigate by activating the link.

33. The device of claim 1, further comprising wherein the instructions cause the device to activate a further enhancement of a one of the enhanced active elements into one or more further enhanced active elements in response to an additional mode of touch on the corresponding touch sensitive region that corresponds to the enhanced active element, wherein one of the additional modes of touch is a three-fingered touch.

34. The device of claim 1, further comprising wherein the instructions cause the device to activate a further enhancement of a one of the enhanced active elements into one or more further enhanced active elements in response to an additional mode of touch on the corresponding touch sensitive region that corresponds to the enhanced active element, wherein one of the additional modes of touch is a four-fingered touch.

35. A method for operating a hand-held electronic device having a case with one or more major surfaces, a visual display disposed on at least one of the first major surfaces, a touch interface disposed on at least one of the major surfaces, a processor operably coupled to the visual display and the touch interface;

and instructions executable by the processor to implement the method, the method comprising;

a) presenting an image on the visual display containing one or more active elements and one or more inactive elements, wherein the visual display is a touch screen that includes a touch interface;

b) operating the one or more active elements according to a first mode of operation in response to a first mode of touch on the touch interface;

c) activating an enhancement of a one of the active elements into an enhanced active element in response to a second mode of touch on the corresponding touch sensitive region that corresponds to the enhanced active element, wherein a touch anywhere on the touch interface activates a most recently transformed active element.

36. The method of claim 35 wherein one of the first or second modes of touch is a single fingered touch and the other of the second or first modes of touch is a two-fingered touch.

37. The method of claim 35 wherein the enhancement of the one or more active elements includes a transformation or magnification of an active element.

38. The method of claim 35 wherein a mode of touch on the touch interface controls a degree of magnification of the active element.

39. The method of claim 35 further comprising dividing an entire area of the touch interface into one or more touch sensitive regions that fill the entire area and correlating each said touch sensitive region of the touch interface to a different corresponding one of the active elements in the image on the visual display by performing a tessellation of the image so that the image is divided into one or more regions that fill the display, each of which corresponding to a different active element.

40. The method of claim 39 wherein the tessellation divides the image into one or more convex regions.

41. The method of claim 40, wherein the tessellation is a Voronoi decomposition.

42. The method of claim 35 wherein the one or more active elements interact with the touch interface in a different mode of operation than a mode of operation of the corresponding active element prior to activation of the enhancement.

43. The method of claim 35 wherein the enhancement includes a transformation of an active element to a transformed element, wherein the transformed element interacts with the touch interface in a different mode of operation than a mode of operation of the corresponding active element prior to its transformation.

44. The method of claim 43 wherein the transformed element appears magnified on the visual display compared to the active element prior to transformation into the transformed active element.

45. The method of claim 44 wherein a mode of touch controls a degree of magnification of the transformed element.

46. The method of claim 44, further comprising reverting the transformed element to a form the active element had prior to being transformed into the transformed element in response to a signal from the touch interface.

47. The method of claim 44 wherein a removal of a touch on the touch interface triggers reverting the transformed element.

48. The method of claim 44, further comprising highlighting an active element that was most recently transformed.

49. The method of claim 35, wherein each said touch sensitive region is larger than the corresponding active element.

50. The method of claim 35, wherein the first mode of touch is a single fingered touch and the second mode of touch is a two fingered touch.

51. The method of claim 35,

wherein said activating the enhancement includes re-purposing one or more portions of the touch screen outside the enhanced active element to act as inputs for commands associated with the enhanced active element,

wherein the one or more repurposed portions of the touch screen include at least a first portion, a second portion, or both the first portion and the second portion, wherein the first portion is configured to cancel a previous manipulation of the enhanced active element and wherein the second portion is configured to commit to a previous manipulation of the enhanced active element.

52. The method of claim 51, wherein the one or more re-purposed portions of the touch screen include a buffer region between first or second re-purposed portions and the enhanced active element, wherein the instructions are configured such that a touch to the buffer region is ignored.

53. The method of claim 51, wherein the one or more re-purposed portions of the touch screen include a buffer region surrounding the enhanced active element, wherein the instructions are configured such that a touch to the buffer region is ignored.

54. The method of claim 35, wherein the enhanced active element is a link and the enhancement includes display of a pre-rendered image of content to which a user may navigate by activating the link.

55. The method of claim 35, further comprising activating a further enhancement of a one of the enhanced active elements into one or more further enhanced active elements in response to an additional mode of touch on the corresponding touch sensitive region that corresponds to the enhanced active element, wherein one of the additional modes of touch is a three-fingered touch.

56. The method of claim 35, further comprising activating a further enhancement of a one of the enhanced active elements into one or more further enhanced active elements in response to an additional mode of touch on the corresponding touch sensitive region that corresponds to the enhanced active element, wherein one of the additional modes of touch is a four-fingered touch.

57. A non-transitory computer readable medium programmed with computer executable instructions for operating a hand-held electronic device having a case with one or more major surfaces, a visual display disposed on the first major surface, a touch interface disposed on at least one of the major surfaces, a processor operably coupled to the visual display and the touch interface, wherein the instructions are executable by the processor to implement a method comprising:

a) presenting an image on the visual display containing one or more active elements and one or more inactive elements, wherein the visual display is a touch screen that includes a touch interface;

b) operating the one or more active elements according to a first mode of operation in response to a first mode of touch on the touch interface;

c) activating an enhancement of a one of the active elements into an enhanced active element in response to a second mode of touch on the corresponding touch sensitive region that corresponds to the enhanced active element, wherein a touch anywhere on the touch interface activates a most recently transformed active element.