Interactive input system displaying an e-book graphic object and method of manipulating a e-book graphic object

• US 9,665,258 B2
• Filed: 02/04/2011
• Issued: 05/30/2017
• Est. Priority Date: 02/05/2010
• Status: Active Grant

• Current Assignee: Smart Technologies ULC (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Smart Technologies ULC (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Duncalf, Jamie, Tse, Edward, Benner, Erik, Xin, Min
• Primary Examiner(s): Sasinowski, Andrew
• Assistant Examiner(s): Woo, Kuo
• Application Number:
  US13/576,887
• Publication Number:
  US 20130021281A1
• Time in Patent Office: 2,307 Days
• Field of Search: 345173-175, 705 14, 715863, 715776
• CPC Class Codes: G06F 2203/04109 FTIR in optical digitiser, i.e. touch detection by frustrating the total internal reflection within an optical waveguide due to changes of optical properties or deformation at the touch location
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/0483 Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

An interactive input system includes a touch panel; and processing structure displaying on the touch panel at least one graphic object depicting a book having one or more page stacks. The processing structure displays each page stack of the book graphic object with a respective width that is based on a number of pages in the page stack. A method for manipulating a book object, and computer program embodied by a computer readable medium are also disclosed.

Claims

1. An interactive input system comprising:

a touch panel; and

a processing structure configured to;

display on the touch panel at least one graphic object depicting a book having one or more page stacks, the processing structure displaying each page stack of the book graphic object with a respective width that is based on a number of pages in the page stack;

in response to a first input gesture, received by detecting a first touch to a surface of the touch panel on a corner of a displayed page of one of the page stacks, animate the touch panel to show movement of a portion of the displayed page;

in response to a second input gesture, received by detecting a second touch to the surface of the touch panel along a visual representation of a folding crease created by the animated movement of the portion of the displayed page, create a bookmark corresponding to the displayed page; and

in response to a third input gesture less than a threshold distance from the first input gesture, received by detecting a third touch to the surface of the touch panel, determine a movement vector from a location of the first input gesture to a location of the third input gesture.

2. The interactive input system of claim 1, wherein the processing structure is further configured to, in response to a touch input, associate one or more pages in a page stack with a different page stack, and update the respective widths of at least one of the page stacks.

3. The interactive input system of claim 1, wherein the processing structure is further configured to receive a touch input, from the touch panel in association with a page stack and manipulate the book graphic object to display a selected book page in the stack in accordance with the location of the touch input.

4. The interactive input system of claim 3, wherein, in response to the touch input, the processing structure is further configured to automatically associate with a different page stack those book pages that are higher than the selected book page in its book stack, and updates the respective widths of at least one of the page stacks.

5. The interactive input system of claim 1, wherein the width of a page stack is also based on one or more attributes of the pages in the page stack.

6. The interactive input system of claim 5, wherein the one or more attributes include page thickness.

7. The interactive input system of claim 1,

wherein the at least one book graphic object is displayed on a background, and the processing structure is further configured to track one or more touch points associated with the background, and

wherein, in the event that one or more touch points coincide with a page stack of the book graphic object, the processing structure is further configured to associate a top book page in the page stack with a different page stack and display the next book page in the page stack.

8. The interactive input system of claim 1, wherein the processing structure is further configured to, in response to a touch input, cause the book graphic object to be tilted with respect to a display surface of the touch panel.

9. The interactive input system of claim 8, wherein causing the book graphic object to be tilted comprises rotating the book graphic object about an axis that is parallel to the display surface.

10. The interactive input system of claim 9, wherein the rotating is confined to a range of angles.

11. The interactive input system of claim 1, wherein each book graphic object has a respective dimension attributes, and wherein the processing structure is further configured to display each book object according to its dimension attributes.

12. The interactive input system of claim 1, wherein the processing structure is further configured to animate the one or more pages in a page stack in accordance with respective book page attributes.

13. The interactive input system of claim 12, wherein the book page attributes are one or more of at least:

a book page material attribute or a book page dimension attribute.

14. The interactive input system of claim 1, wherein the processing structure is further configured to manipulate the book graphic object in accordance with a touch input by zooming in or zooming out, thereby increasing or decreasing the size of the book graphic object.

15. The interactive input system of claim 1, wherein the processing structure is further configured to manipulate the book graphic object in accordance with a touch input, wherein the effect of the manipulation for the touch input is based on a location relative to the book graphic object that the touch input is received.

16. The interactive input system of claim 1, wherein the processing structure is further configured to automatically remove regions of white space from a displayed page.

17. The interactive input system of claim 1, wherein the processing structure is further configured to:

create another bookmark for one of the pages in one of the page stacks each time the first and second input gestures are performed on the touch panel; and

display on the touch panel a bookmark icon associated with each bookmark such that each bookmark icon is readily accessible to a user regardless of what page is displayed on the touch panel.

18. The interactive input system of claim 1,

wherein the bookmark corresponding to the displayed page is one of multiple bookmarks identified for different pages in a selected stack of the one or more page stacks;

wherein each of the multiple bookmarks is displayed at a position corresponding to a portion of the width of the selected stack; and

wherein each portion of the width of the selected stack for each of the multiple bookmarks is based on a number of pages in the selected stack below the page that bookmark corresponds to.

19. The interactive input system of claim 6,

wherein the page thickness attribute corresponds to a type identified for a physical object containing text identified for the book graphic object;

and

wherein at least a first of multiple page thickness attributes, corresponding to a first type of identified physical object containing text, affects the width of page stacks differently than a second of the multiple page thickness attributes corresponding to a second type of identified physical object containing text.

20. The method of claim 1, further comprising:

animating the touch panel to show movement of the portion of the display page along the movement vector.

21. A method for manipulating a book graphic object displayed on an interactive input system, the method comprising:

tracking one or more touch points, on a touch panel of the interactive input system, associated with the book graphic object;

displaying the book graphic object on the touch panel, the book graphic object having one or more page stacks;

updating the respective widths of at least one of the page stacks based on the numbers of pages in the page stacks;

in response to a first input gesture, identified based on the tracked one or more touch points received by detecting a first touch to a surface of the touch panel on a displayed page of one of the page stacks, animating the touch panel to show movement of a portion of the displayed page;

in response to a second input gesture, identified based on the tracked one or more touch points received by detecting a second touch to the surface of the touch panel along a visual representation of a folding crease created by the animating the portion of the displayed page, creating a bookmark corresponding of the displayed page; and

in response to a third input gesture less than a threshold distance from the first input gesture, received by detecting a third touch to the surface of the touch panel, determine a movement vector from a location of the first input gesture to a location of the third input gesture.

22. The method of claim 21, further comprising:

creating another bookmark for one of the pages in one of the page stacks each time the first and second input gestures are received by the interactive input system; and

displaying on the interactive input system a bookmark icon associated with each bookmark such that each bookmark icon is readily accessible to a user regardless of what page is displayed on the interactive input system.

23. A non-transitory computer readable medium having stored thereon instructions that, when executed by a computing system, cause the computing system to perform operations for manipulating a book graphic object displayed on an interactive input system, the operations comprising:

tracking one or more touch points, on a touch panel of the interactive input system, associated with the book graphic object;

displaying the book graphic object on the touch panel, the book graphic object having one or more page stacks;

updating the respective widths of at least one of the page stacks based on numbers of pages in the page stacks;

in response to a first input gesture, identified based on the tracked one or more touch points received by detecting a first touch to a surface of the touch panel on a displayed page of one of the page stacks, animating the touch panel to show movement of a portion of the displayed; and

in response to a second input gesture, identified based on the tracked one or more touch points received by detecting a second touch to the surface of the touch panel along a visual representation of a folding crease created by the animating the portion of the displayed page, creating a bookmark corresponding to the displayed page; and

in response to a third input gesture less than a threshold distance from the first input gesture, received by detecting a third touch to the surface of the touch panel, determine a movement vector from a location of the first input gesture to a location of the third input gesture.

24. The non-transitory computer readable medium of claim 23, wherein the operations further comprise:

creating another bookmark for one of the pages in one of the page stacks each time the first and second input gestures are received by the interactive input system; and

displaying on the interactive input system a bookmark icon associated with each bookmark such that each bookmark icon is readily accessible to a user regardless of what page is displayed on the interactive input system.