Gesture-based user interface to multi-level and multi-modal sets of bit-maps

• US 20020015064A1
• Filed: 11/29/2000
• Published: 02/07/2002
• Est. Priority Date: 08/07/2000
• Status: Abandoned Application

• Current Assignee: DigiMedia Tech, LLC (IP Investments Group LLC)
• Original Assignee: DigiMedia Tech, LLC (IP Investments Group LLC)
• Inventors: Robotham, John S., Johnson, Charles Lee
• Application Number:
  US09/726,163
• Publication Number:
  US 20020015064A1
• Time in Patent Office: Days
• US Class Current: 345/863
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A method of navigating within a plurality of bit-maps through a client user interface, comprising the steps of displaying at least a portion of a first one of the bit-maps on the client user interface, receiving a gesture at the client user interface, and in response to the gesture, altering the display by substituting at least a portion of a different one of the bit-maps for at least a portion of the first bit-map.

Claims

1. A method of navigating within a plurality of bit-maps through a client user interface, comprising the steps of:

displaying at least a portion of a first one of the bit-maps on the client user interface;

receiving a gesture at the client user interface; and

in response to the gesture, altering the display by substituting at least a portion of a different one of the bit-maps for at least a portion of the first bit-map.

2. The method of claim 1 wherein the bit-maps depict common subject matter at different resolutions.

3. The method of claim 1 wherein the gesture comprises a location gesture.

4. The method of claim 3 wherein the location gesture comprises a sequence of at least one client event.

5. The method of claim 3 wherein the gesture comprises at least one of a move and a hover.

6. The method of claim 5 wherein the user interface comprises a pointing device.

7. The method of claim 6 wherein the move gesture comprises a pointing device start location on the client interface and a pointing device end location on the client interface.

8. The method of claim 6 wherein the hover gesture comprises a hover start event followed by the pointing device remaining relatively still for at least a predetermined time interval.

9. The method of claim 1 wherein the gesture comprises a selection gesture.

10. The method of claim 9 wherein the gesture comprises at least one of a swipe, a drag, a pick, a tap, a double-tap, and a hold.

11. The method of claim 10 wherein the user interface comprises a pointing device.

12. The method of claim 11 wherein the swipe gesture comprises a pointing device movement of at least a certain distance within no more than a predetermined time.

13. The method of claim 12 wherein the swipe gesture further comprises a pointing device movement in a particular determined direction across the user interface.

14. The method of claim 12 wherein the swipe gesture further comprises a pointing device movement that begins within the client device viewport, and ends outside of the client device viewport.

15. The method of claim 11 wherein the drag gesture comprises a pointing device movement of at least a certain distance within no more than a predetermined time.

16. The method of claim 11 wherein the hold gesture comprises a hold start event followed by the pointing device remaining relatively still within a predetermined hold region for at least a predetermined hold time interval.

17. The method of claim 16 wherein the pick gesture comprises the pointing device continuing to remain relatively still within a predetermined hold region for at least a predetermined pick time interval beyond the hold time interval.

18. The method of claim 11 wherein the tap gesture comprises two sequential pointing device selection actions without substantial motion of the pointing device.

19. The method of claim 18 wherein the double tap gesture comprises four sequential pointing device selection actions, without substantial motion of the pointing device, within a predetermined double tap time.

20. The method of claim 1 wherein one bit-map includes a source visual content element rasterized into a bit-map representation through a first rasterizing mode and at least one other bit-map includes the source visual content element rasterized into a bit-map representation through a second rasterizing mode.

21. The method of claim 20 wherein the first and second rasterizing modes can differ from one another by at least one of a difference in a parameter of the rasterizing function, a difference in rasterizing algorithm, a difference in a parameter of a transcoding step, a difference in transcoding algorithm, and the insertion of at least one transcoding step before the rasterizing.

22. The method of claim 1 further including creating at least one correspondence map to map between corresponding parts of different bit-maps, to allow correspondences to be made between related areas of related bit-maps.

23. The method of claim 22 wherein a correspondence map is a source to source map that maps the correspondences from one source to another related source.

24. The method of claim 22 wherein a correspondence map is a source to raster map that maps the correspondences from a source element to a rasterized representation of that source element.

25. The method of claim 22 wherein a correspondence map is a raster to source map that maps the correspondences from a rasterized representation of a source element to that source element.

26. The method of claim 22 wherein a correspondence map is a raster to raster map that maps corresponding pixel regions within the raster representations.

27. The method of claim 20 wherein a first rasterizing mode is a rasterization and another rasterizing mode comprises a transcoding step.

28. The method of claim 27 further including an intermediate transcoding step to extract text-related aspects of the source visual content element and store them in a transcoded representation.

29. The method of claim 1 wherein one bit-map includes a source visual content element rasterized into a bit-map representation through one rasterizing mode, to accomplish an overview representation.

30. The method of claim 29 wherein another bit-map includes a text-related summary extraction of a source visual content element from the overview representation.

31. The method of claim 30 wherein the text-related summary extraction is displayed separately from the overview representation on the client user interface display.

32. The method of claim 31 wherein the text-related summary extraction is displayed over the portions of the overview representation containing the extracted source visual content element.

33. The method of claim 32 wherein the text-related summary extraction is displayed apart from the portions of the overview representation containing the extracted source visual content element.

34. The method of claim 1 wherein the method is accomplished in a client-server environment.

35. A system for navigating within a plurality of bit-maps comprising:

a client user interface for entry of user interface events;

a client display for displaying at least a portion of a first one of the bit-maps; and

a client processor in communication with the client user interface and the client display, the client processor detecting a user interface event and determining a gesture type in response thereto, the client processor altering the display of the at least a portion of a first one of the bit-maps by substituting at least a portion of a different one of the bit maps for at least a portion of the first bit-map