Touch driven method and apparatus to integrate and display multiple image layers forming alternate depictions of same subject matter

• US 8,269,739 B2
• Filed: 10/20/2009
• Issued: 09/18/2012
• Est. Priority Date: 08/06/2004
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: TOUCHTABLE, INC.
• Inventors: Hillis, W. Daniel, Ferren, Bran
• Primary Examiner(s): NGUYEN, KIMNHUNG T
• Application Number:
  US12/582,611
• Publication Number:
  US 20100039446A1
• Time in Patent Office: 1,064 Days
• Field of Search: 345156-158, 345173-179, 178 1801- 1804, 178 1901- 1903, 715/863
• US Class Current: 345/173
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113
• CPC Class Codes: G09G 3/002 to project the image of a two-dimensional display, such as an array of light emitting or modulating elements or a CRT

Abstract

An interactive display system, including a touch sensitive display, establishes a first image and at least one secondary image, each image representing various spatial coordinates, the spatial coordinates overlapping at least in part such that each image comprises an alternate depiction of subject matter common to all of the images. The first image is presented upon the display. Responsive to user input including contact with the display, imagery presented by the display is updated to integrate a region of at least one of the secondary images into the display. Each integrated region has substantially identical represented coordinates as a counterpart region of the first image. Further, each integrated region is presented in same scale and display location as the counterpart region of the first image.

Claims

1. At least one digital data storage media tangibly embodying a program of machine-readable instructions executable by a digital data processing apparatus to perform operations to manage an interactive display system including a touch-sensitive display, the operations comprising:

establishing a predetermined first image and one or more predetermined second images, each of said images comprising an alternate depiction of shared subject matter having predefined spatial coordinates;

presenting the first image upon the touch-sensitive display;

responsive to prescribed user input including contact with the touch-sensitive display, performing further operations comprising;

modifying presentation of the first image upon the touch-sensitive display by integrating a region of at least one of the secondary images into the display;

where each integrated region depicts subject matter of substantially identical spatial coordinates as a counterpart region of the first image upon which said integration occurs; and

where each point on the touch-sensitive display that depicts any one or a combination of the images always depicts subject matter of unchanging spatial coordinates regardless of which of the images or combination of images is currently being presented.

2. The media of claim 1, where the first image comprises a depiction of specific subject matter, and where each of the secondary images includes an alternate depiction of said subject matter.

3. The media of claim 2, where at least one of the secondary images comprises a depiction of the specific subject matter at a different time than the first image.

4. The media of claim 2, where at least one of the secondary images comprises a plan view of a different cross-sectional level of the subject matter than the first image.

5. The media of claim 2, where at least one of the secondary images comprises a diagram limited to a selected aspect of the specific subject matter.

6. The media of claim 1, further comprising operations of receiving one or more mappings defining correspondence between the images and the spatial coordinates.

12. A computer-implemented process of managing an interactive display system including a touch-sensitive display, the process comprising the operations set forth in any of claim 1, 2, 3, 4, 6, 5, 7, 8, 9, 10, or 11.

13. A computer driven interactive display apparatus, comprising:

a touch-sensitive display; and

a digital data processing machine programmed to perform the operations set forth in any of claim 1, 2, 3, 4, 6, 5, 7, 8, 9, 10, or 11.

7. At least one digital data storage media tangibly embodying a program of machine-readable instructions executable by a digital data processing apparatus to perform operations to manage an interactive display system including a touch-sensitive display, the display presenting a first one of multiple predetermined images, each of said images comprising an alternate depiction of shared subject matter having predefined spatial coordinates, the operations comprising:

responsive to prescribed user input including contact with the touch-sensitive display, performing operations comprising;

modifying presentation of the first image upon the touch-sensitive display by integrating a region of at least one of the secondary images into the display;

where each integrated region depicts subject matter of substantially identical spatial coordinates as a counterpart region of the first image upon which said integration occurs; and

where each point on the touch-sensitive display that depicts any one or a combination of the images always depicts subject matter of unchanging spatial coordinates regardless of which of the images or combination of images is currently being presented.

8. At least one digital data storage media tangibly embodying a program of machine-readable instructions executable by a digital data processing apparatus to perform operations to manage an interactive display system including a touch-sensitive display, the operations comprising:

establishing a predetermined first image and one or more predetermined second images, each of said images comprising an alternate depiction of shared subject matter having predefined spatial coordinates;

presenting the first image upon the touch-sensitive display;

responsive to prescribed user contact upon the touch-sensitive display, performing operations comprising;

reducing visibility of a fade-out region of the first image;

substantially simultaneously increasing visibility of a fade-in region of one of the secondary images;

where the fade-out region and fade-in regions represent substantially identical spatial coordinates; and

where each point on the touch-sensitive display that depicts any one or a combination of the images always depicts subject matter of unchanging spatial coordinates regardless of which of the images or combination of images is currently being presented.

9. At least one digital data storage media tangibly embodying a program of machine-readable instructions executable by a digital data processing apparatus to perform operations to manage an interactive display system including a touch-sensitive display, the operations comprising:

establishing a predetermined first image and one or more predetermined second images, each of said images comprising an alternate depiction of shared subject matter having predefined spatial coordinates;

where the images have a defined order in a series;

presenting the first image upon the touch-sensitive display;

responsive to prescribed user contact upon the touch-sensitive display, performing operations comprising;

defining a window upon the touch-sensitive display, the window representing an extent of represented spatial coordinates; and

within the window, varying the display to substantially exclusively show a region of one of the images whose order in the series is proportional to force of user contact upon the display, the shown region corresponding to spatial coordinates represented by the defined window.

10. At least one digital data storage media tangibly embodying a program of machine-readable instructions executable by a digital data processing apparatus to perform operations to manage an interactive display system including a touch-sensitive display, the operations comprising:

establishing a predetermined first image and one or more predetermined second images, each of said images comprising an alternate depiction of shared subject matter having predefined spatial coordinates;

presenting the first image upon the touch-sensitive display;

responsive to detecting occurrence of at least first and second contact sites on the touch-sensitive display, defining a swipe area upon the touch-sensitive display, the swipe area bounded by the first and second contact sites;

within the swipe area, ceasing presentation of the first image and instead presenting a region of one of the secondary images whose spatial coordinates substantially match spatial coordinates of the first image within the swipe area;

where each point on the touch-sensitive display that depicts any one or a combination of the images always depicts subject matter of unchanging spatial coordinates regardless of which of the images or combination of images is currently being presented; and

maintaining display of the first image outside the swipe area.

11. At least one digital data storage media tangibly embodying a program of machine-readable instructions executable by a digital data processing apparatus to perform operations to manage an interactive display system including a touch-sensitive display, the operations comprising:

establishing a predetermined first image and one or more predetermined second images, each of said images comprising an alternate depiction of shared subject matter having predefined spatial coordinates;

responsive to the prescribed user input, presenting a slider tool upon the touch-sensitive display; and

combining selected ones of the images and presenting the combined image on the touch-sensitive display, where the selected images are combined such that each point on the touch-sensitive display that depicts any one or a combination of the images always depicts subject matter of unchanging spatial coordinates regardless of which of the images or combination of images is currently being presented, and where the combining operation weights the images in proportion to position of the slider tool.