Touch driven method and apparatus to integrate and display multiple image layers forming alternate depictions of same subject matter

• US 8,624,863 B2
• Filed: 09/06/2012
• Issued: 01/07/2014
• Est. Priority Date: 08/06/2004
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Hillis, W. Daniel, Ferren, Bran
• Primary Examiner(s): Nguyen, Kimnhung
• Application Number:
  US13/605,351
• Publication Number:
  US 20120331415A1
• Time in Patent Office: 488 Days
• Field of Search: 345156-158, 345173-179, 178 1801- 1804, 178 1901- 1903, 715/863
• US Class Current: 345/173
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113
• CPC Class Codes: G09G 3/002 to project the image of a two-dimensional display, such as an array of light emitting or modulating elements or a CRT

Abstract

An interactive display system, including a touch sensitive display, establishes a first image and at least one secondary image, each image representing various spatial coordinates, the spatial coordinates overlapping at least in part such that each image comprises an alternate depiction of subject matter common to all of the images. The first image is presented upon the display. Responsive to user input including contact with the display, imagery presented by the display is updated to integrate a region of at least one of the secondary images into the display. Each integrated region has substantially identical represented coordinates as a counterpart region of the first image. Further, each integrated region is presented in same scale and display location as the counterpart region of the first image.

Claims

1. At least one digital data storage media tangibly embodying a program of machine-readable instructions executable by a digital data processing apparatus to perform operations to manage an interactive display system including a touch-sensitive display, the operations comprising:

establishing a first image comprising subject matter having predefined spatial coordinates;

presenting the first image upon the touch-sensitive display; and

responsive to prescribed user input including contact with the touch-sensitive display, integrating at least one secondary image comprising subject matter having predefined spatial coordinates into the display of the first image;

wherein each point on the touch-sensitive display depicts subject matter having substantially identical spatial coordinates regardless of which of the first and said secondary images is presented at the point.

2. The media of claim 1, wherein the first image comprises a depiction of specific subject matter, and wherein the at least one secondary image includes an alternate depiction of the specific subject matter.

3. The media of claim 2, wherein the at least one secondary image comprises a depiction of the specific subject matter at a different time than the first image.

4. The media of claim 2, wherein the at least one secondary image comprises a plan view of a different cross-sectional level of the specific subject matter than the first image.

5. The media of claim 2, wherein the at least one secondary image comprises a diagram limited to a selected aspect of the specific subject matter.

6. The media of claim 1, further comprising operations of receiving one or more mappings defining correspondence between the first and the at least one secondary image and their respective spatial coordinates.

7. At least one digital data storage media tangibly embodying a program of machine-readable instructions executable by a digital data processing apparatus to perform operations to manage an interactive display system including a touch-sensitive display, the display presenting a first one of multiple images, each of the images comprising subject matter having predefined spatial coordinates, the operations comprising, responsive to prescribed user input including contact with the touch-sensitive display:

modifying presentation of the first image upon the touch-sensitive display by integrating a region of at least one other of the multiple images into the display;

wherein each integrated region depicts subject matter of substantially identical spatial coordinates as a counterpart region of the first image within which the integration occurs; and

wherein each point on the touch-sensitive display that depicts any one or a combination of the multiple images always depicts subject matter of unchanging spatial coordinates regardless of which of the multiple images is currently being presented.

8. At least one digital data storage media tangibly embodying a program of machine-readable instructions executable by a digital data processing apparatus to perform operations to manage an interactive display system including a touch-sensitive display, the operations comprising:

establishing a first image and at least one secondary image, each of the images comprising subject matter having predefined spatial coordinates;

presenting the first image upon the touch-sensitive display;

responsive to prescribed user contact upon the touch-sensitive display, performing operations comprising;

reducing visibility of a fade-out region of the first image;

substantially simultaneously increasing visibility of a fade-in region of the at least one secondary image;

wherein the fade-out region and fade-in regions represent substantially identical spatial coordinates.

9. At least one digital data storage media tangibly embodying a program of machine-readable instructions executable by a digital data processing apparatus to perform operations to manage an interactive display system including a touch-sensitive display, the operations comprising:

establishing a sequence of images, each image in the sequence comprising subject matter having predefined spatial coordinates;

responsive to prescribed user contact upon the touch-sensitive display, performing operations comprising;

defining a window upon the touch-sensitive display, the window representing an extent of represented spatial coordinates; and

within the window, presenting a region of an image whose order in the sequence is proportional to force of user contact upon the touch-sensitive display, the region corresponding to the represented spatial coordinates.

10. At least one digital data storage media tangibly embodying a program of machine-readable instructions executable by a digital data processing apparatus to perform operations to manage an interactive display system including a touch-sensitive display, the operations comprising:

establishing a first image and at least one secondary image, each of the images comprising subject matter having predefined spatial coordinates;

presenting the first image upon the touch-sensitive display;

responsive to detecting occurrence of two or more contact sites on the touch-sensitive display, defining a swipe area bounded by the contact sites;

within the swipe area, ceasing presentation of the first image and presenting a region of the at least one secondary image,

wherein the region of the at least one secondary image comprises subject matter with spatial coordinates substantially matching the spatial coordinates of the subject matter of the first image within the swipe area.

11. At least one digital data storage media tangibly embodying a program of machine-readable instructions executable by a digital data processing apparatus to perform operations to manage an interactive display system including a touch-sensitive display, the operations comprising:

establishing a plurality of images, each of the images comprising subject matter having predefined spatial coordinates;

responsive to prescribed user input, presenting a slider tool upon the touch-sensitive display; and

combining two or more of the images and presenting the combined image on the touch-sensitive display,

wherein the images are combined such that each point on the touch-sensitive display presenting the combined image depicts subject matter of substantially identical spatial coordinates regardless of which one or more of the images is presented at the point, and

wherein the combining operation weights the images in proportion to position of the slider tool.

12. A computer driven interactive display apparatus, comprising:

a touch-sensitive display; and

a digital data processing machine programmed to manage said touch-sensitive display by performing operations comprising;

establishing a first image comprising subject matter having predefined spatial coordinates;

presenting the first image upon the touch-sensitive display; and

responsive to prescribed user input including contact with the touch-sensitive display, integrating at least one secondary image comprising subject matter having predefined spatial coordinates into the display of the first image;

wherein each point on the touch-sensitive display depicts subject matter having substantially identical spatial coordinates regardless of which of the first and said secondary images is presented at the point.

13. The apparatus of claim 12, wherein the first image comprises a depiction of specific subject matter, and wherein the at least one secondary image includes an alternate depiction of the specific subject matter.

14. The apparatus of claim 13, wherein the at least one secondary image comprises a depiction of the specific subject matter at a different time than the first image.

15. The apparatus of claim 13, wherein the at least one secondary image comprises a plan view of a different cross-sectional level of the specific subject matter than the first image.

16. The apparatus of claim 13, wherein the at least one secondary image comprises a diagram limited to a selected aspect of the specific subject matter.

17. The apparatus of claim 12, further comprising said digital data processing machine programmed for performing operations of receiving one or more mappings defining correspondence between the first and the at least one secondary image and their respective spatial coordinates.