CONTINUOUS AND DYNAMIC SCENE DECOMPOSITION FOR USER INTERFACE

• US 20100295797A1
• Filed: 10/07/2009
• Published: 11/25/2010
• Est. Priority Date: 05/21/2009
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment America (Sony Group Corp.)
• Inventors: Zalewski, Gary M., Nicholson, Charles
• Granted Patent: US 10,705,692 B2
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/169 the I/O peripheral being an integrated pointing device, e.g. trackball in the palm rest area, mini-joystick integrated between keyboard keys, touch pads or touch stripes G06F1/1643 takes precedence; constructional details of pointing devices G06F3/033
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04805 Virtual magnifying lens, i.e. window or frame movable on top of displayed information to enlarge it for better reading or selection
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/03547 Touch pads, in which fingers can move on a surface
• CPC Class Codes: G06F 3/04186 Touch location disambiguation
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04855 Interaction with scrollbars
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06N 7/01 Probabilistic graphical models, e.g. probabilistic networks

Abstract

A hand-held electronic device, method of operation and computer readable medium are disclosed. The device may include a case having one or more major surfaces. A visual display and a touch pad are disposed on at least one of the major surfaces. A processor is operably coupled to the visual display and touch screen. Instructions executable by the processor may be configured to: a) present an image on the visual display containing one or more active elements; b) divide the image into one or more regions that fill the display, wherein each region corresponds to a different active element; c) correlating an active element in the image on the visual display to a corresponding active portion of the touch interface; and d) activate one of the one or more active elements in response to a touch to a corresponding one of the active portions of the touch interface.

Claims

1. A hand-held electronic device, comprising:

a case having one or more major surfaces;

a visual display disposed at least one of first major surfaces;

a touch interface disposed on at least one of the major surfaces;

a processor operably coupled to the visual display and the touch interface; and

instructions executable by the processor, wherein the instructions are configured such that, when executed, the instructions cause the device to;

a) present an image on the visual display containing one or more active elements;

b) divide the image into one or more regions that fill the display, wherein each region corresponds to a different active element;

c) correlate an active element in the image on the visual display to a corresponding active portion of the touch interface; and

d) activate one of the one or more active elements in response to a touch to a corresponding one of the active portions of the touch interface.

2. The device of claim 1 wherein the visual display includes a touch screen that serves as the touch interface.

3. The device of claim 2, wherein the touch screen is configured to respond to a physical interaction with a stylus.

4. The device of claim 2, wherein the touch screen is configured to respond to a physical interaction with a user'"'"'s finger.

5. The device of claim 1, wherein the touch interface is configured to respond to a physical interaction with a user'"'"'s finger.

6. The device of claim 1, wherein b) includes performing a tessellation on the image.

7. The device of claim 6 wherein the tessellation divides the image into one or more convex regions.

8. The device of claim 6, wherein the tessellation is a Voronoi decomposition.

9. The device of claim 6, wherein the tessellation is performed on a browser-rendered canvas.

10. The device of claim 1 wherein the touch interface is a touch pad.

11. The device of claim 10 wherein the visual display and touch pad are disposed on the same side of the case.

12. The device of claim 10 wherein the visual display and touch pad are disposed on different sides of the case.

13. The device of claim 12 wherein the visual display is disposed on a front side of the case and the touch pad is disposed on a back side of the case.

14. The device of claim 10 wherein the case includes first and second case portions wherein the visual display is disposed on the first case portion and wherein the touch pad is disposed on the second case portion.

15. The device of claim 14 wherein the first and second case portions are slidably connected to each other.

16. The device of claim 14 wherein the first and second case portions are connected to each other in a hinged configuration.

17. The device of claim 16 wherein the visual display and touch pad face inward when the first and second portions are in a closed position.

18. The device of claim 16 wherein one of the visual display and touch pad faces inward and the other of the touch pad and visual display faces outward when the first and second portions are in a closed position.

19. The device of claim 16 wherein the visual display and touch pad face inward when the first and second portions are in a closed position.

20. A method for operating a hand-held electronic device having a case with one or more major surfaces, a visual display disposed on at least one of the first major surfaces, a touch interface disposed on at least one of the major surfaces, a processor operably coupled to the visual display and the touch interface;

and instructions executable by the processor to implement the method, the method comprising;

a) presenting an image on the visual display containing one or more active elements;

b) dividing the image into one or more regions that fill the display, wherein each region corresponds to a different active element;

c) correlating an active element in the image on the visual display to a corresponding active portion of the touch interface; and

d) activating one of the one or more active elements in response to a touch to a corresponding one of the active portions of the touch interface.

21. The method of claim 20, wherein b) includes performing a tessellation of the image.

22. The method of claim 21 wherein the tessellation divides the image into one or more convex regions.

23. The method of claim 21, wherein the tessellation is a Voronoi decomposition.

24. The method of claim 21, wherein the tessellation is performed on a browser-rendered canvas.

25. A computer readable medium programmed with computer executable instructions for operating a hand-held electronic device having a case with one or more major surfaces, a visual display disposed on at least one of the major surfaces, a touch pad disposed on at least one of the major surfaces, a processor operably coupled to the visual display and the touch interface, wherein the instructions are executable by the processor to implement a method comprising:

a) presenting an image on the visual display containing one or more active elements;

b) dividing the image into one or more regions that fill the display, wherein each region corresponds to a different active element;

c) correlating an active element in the image on the visual display to a corresponding active portion of the touch interface; and

d) activating one of the one or more active elements in response to a touch to a corresponding one of the active portions of the touch interface.