View navigation guidance system for hand held devices with display

• US 9,424,810 B2
• Filed: 01/31/2014
• Issued: 08/23/2016
• Est. Priority Date: 12/03/2009
• Status: Active Grant

• Current Assignee: Innoventions Incorporated, Orna Feinstein
• Original Assignee: Innoventions Incorporated
• Inventors: Feinstein, David Y.
• Primary Examiner(s): Yang, Ryan R
• Application Number:
  US14/169,539
• Publication Number:
  US 20140218387A1
• Time in Patent Office: 935 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/04855 Interaction with scrollbars
• CPC Class Codes: G06F 3/0486 Drag-and-drop
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G09G 2320/0666 for control of colour parameters, e.g. colour temperature
• CPC Class Codes: G09G 2320/0686 with two or more screen areas displaying information with different brightness or colours
• CPC Class Codes: G09G 2340/12 Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
• CPC Class Codes: G09G 5/026 Control of mixing and/or overlay of colours in general G09G5/022 and G09G5/024 take precedence
• CPC Class Codes: G09G 5/377 for mixing or overlaying two or more graphic patterns G09G5/02, G09G5/397 take precedence

Abstract

System and method for view navigation guidance system for a physical display that is smaller than the virtual display it needs to display. Guidance map placed in a heads-up display layer within a small user defined area of the physical display provides an instantaneous indication of the current position of the screen view with minimal obstruction of the contents information. Color selection for the guidance map is automatically determined based on the background color in the main display layer beneath the map. The guidance map area on a touch screen display may include tapping controls, and the position of the guidance map can be dynamically altered by the user during the view navigation to control the navigation parameters.

Claims

1. A method for guiding the view navigation of a virtual display on the screen view of a physical display, comprising the steps of:

(a) computing a first rectangle corresponding to the shape and size of said virtual display;

(b) computing a second rectangle corresponding to the shape and size of said screen view;

(c) rendering a guidance map on a graphic layer showing said first rectangle scaled down by a scale factor computed to fit said first rectangle within a predefined area;

(d) scaling down said second rectangle by said scale factor and rendering said second rectangle to said guidance map at a position within said first rectangle corresponding to the relative location of said screen view within said virtual display;

(e) displaying said graphic layer with said guidance map as heads-up display layer at a predefined location on said screen view;

(f) examining changes in the relation between said screen view and said virtual display performed at a predefined view navigation update rate; and

(g) updating said guidance map by repeating steps (a) through (e) when changes in the relation between said screen view and said virtual display detected in step (f) exceed a predefined limit, whereby said guidance map indicates the position and size of said screen view relative to said virtual display.

2. The method of claim 1, wherein said virtual display is changing dynamically while portions of the contents of said virtual display are being deleted or added so that the transitory shape of said virtual display over time may become irregular, and wherein step (a) selects a minimal rectangle that bounds the irregular transitory shape of said virtual display.

3. The method of claim 1, wherein step (e) further comprising switching the visibility of said graphic layer so that said guidance map is visible when said view navigation is active and invisible when said view navigation ends.

4. The method of claim 3, further comprising extending the visibility of said guidance map for a predefined time interval after the time at which the view navigation ends.

5. The method of claim 1, wherein the step of updating said guidance map is performed at a lower rate than the frame rate update of said physical display.

6. The method of claim 1, wherein the rendering of said guidance map in step (c) displays said first rectangle by four visible markers placed at the corners of said first rectangle to reduce the obstruction of the contents of said screen view.

7. The method of claim 1, further comprising selecting the painting colors for rendering said guidance map based on the background colors in the contents of the virtual display underneath said heads-up display layer.

8. The method of claim 1, further comprising changing said predefined location of said guidance map area in response to the user input.

9. The method of claim 8, wherein step (e) further modifying the transparency alpha level of said heads-up display layer in relation to the distance of said guidance map from the center of said physical display, said alpha level is decreased when said distance is smaller and increased when said distance is larger so that said guidance map is less obstructive when it is closer to the center of the physical display.

10. The method of claim 8, wherein the operation of said view navigation depends on at least one user controlled auxiliary parameter, further comprising responding to location changes of said guidance map along predefined paths within said screen view by modifying said user controlled auxiliary parameter.

11. The method of claim 8, wherein the location of said guidance map area changes in response to touch screen drags by said user.

12. The method of claim 1, wherein the operation of said view navigation responds to a predefined user command, further comprising activating said predefined user command in response to operator touch of said guidance map area.

13. The method of claim 1, wherein:

the operation of said view navigation responds to a plurality of user commands; and

said guidance map area further comprises a plurality of marked tap areas, each tap area is associated with one of said user commands,

further comprising responding to operator touch on each said marked tap area by activating the associated user command.

14. The method of claim 13, wherein:

the mode of operation of said view navigation is selected from a plurality of operation modes; and

each user command is associated with at least one of said operation modes,

further comprising including only the marked tap areas associated with user commands responsive to said selected operation mode within said guidance map area.

15. A user interface for controlling an operational function of a computer system, comprising:

a processor;

a physical display having a touch screen interface coupled to said processor;

a storage device coupled to said processor for storing executable code to interface with said physical display, the executable code comprising;

(a) code for rendering a graphic controller on a display layer, said graphic controller comprises at least one interface control element, said interface control element may accept touch commands from an operator of said computer system or display an output result responsive to said operational function, said graphic controller area is smaller than the size of said physical display;

(b) code for displaying said display layer of said graphic controller as a partially transparent heads-up display on said physical display at a predefined location;

(c) code for storing and retrieving a record of the horizontal and vertical coordinates of the location of said graphic controller on said physical display; and

(d) code for enabling the user to move said graphic controller on said physical display and simultaneously updating said predefined controller location with said record of graphic controller location,

whereby said graphic controller assists the operator to control said operational function with minimal obstruction of the contents of the physical display.

16. The user interface of claim 15 wherein the operational function of said computer system depends on at least one user controlled auxiliary parameter, and wherein said executable code further comprising code for a user selected auxiliary control mode, said auxiliary control code comprising:

code to record initial location of said graphic controller from said record of coordinates when said auxiliary control mode is activated;

code to continuously retrieve said record of coordinates and measure changes of the current graphic controller location from its said initial location along a predefined path; and

code to change said auxiliary parameter in accordance with said changes of graphic controller location.

17. The user interface of claim 16, wherein said auxiliary parameter has a continuous range of values, and wherein said changes of the graphic controller location are mapped onto said continuous range of auxiliary parameter values in accordance with a continuous transformation.

18. The user interface of claim 16, wherein said auxiliary parameter has a plurality of discrete values, and wherein the full range of values for the location changes of the graphic controller location is divided into a plurality of predefined sub-ranges, each predefined sub-range is assigned to one of said discrete values, whereby changes in the graphic controller location within a predefined sub-range selects the assigned discrete value of the auxiliary parameter.

19. The user interface of claim 15, wherein the operational function of said computer system depends on at least one user controlled auxiliary parameter, said executable code further comprising code for a user selected auxiliary control mode, said auxiliary control mode changes said auxiliary parameter in accordance with current location of said graphic controller on said physical display while said auxiliary control mode is set.

20. The user interface of claim 15, wherein the code for displaying said graphic controller further modifies the transparency alpha level of said graphic controller in relation to the distance of said graphic controller from the center of said physical display, said alpha level is decreased when said distance becomes smaller and increased when said distance becomes larger, so that said graphic controller is less obstructive when it is closer to the center of the physical display.

21. The user interface of claim 15, wherein said physical display shows a partial screen view of a virtual display that is larger than said physical display, and wherein said graphic controller area displays a relative map indicating the position of said screen view within said virtual display.