Systems and methods for using interaction information to deform representations of digital content

• US 7,836,409 B2
• Filed: 09/26/2003
• Issued: 11/16/2010
• Est. Priority Date: 09/26/2003
• Status: Expired due to Fees

• Current Assignee: Fujifilm Business Innovation Corp. (Fujifilm Holdings Corporation)
• Original Assignee: Fuji Xerox Company Limited (Xerox Holdings Corp.)
• Inventors: Hilbert, David M., Nelson, Les, Denoue, Laurent, Churchill, Elizabeth F., Chiu, Patrick, Fuse, Tohru, Trevor, Jonathan
• Primary Examiner(s): Bashore; William L
• Assistant Examiner(s): TANK, ANDREW L
• Application Number:
  US10/672,980
• Publication Number:
  US 20050071864A1
• Time in Patent Office: 2,608 Days
• Field of Search: 715/866, 715788-789, 715/811, 715/815, 715800-801, 725/9, 725/14, 725/135
• US Class Current: 715/789
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: H04N 21/40 Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof

Abstract

User behavior while interacting with one or more first representations of digital content can be monitored. Interaction information can be determined by monitoring the user behavior while interacting. Interaction information can include information identifying interaction areas of the first representation, degree of interaction information, and sequence of interaction information. The interaction information can be maintained and used to deform a second representation of digital content. The first and second representations can be of the same or different digital content.

Claims

1. A method for displaying a representation of digital content, comprising:

monitoring user behavior while interacting with a first representation of digital content, wherein the user behavior includes interacting with a first display interaction area and at least a second display interaction area;

determining interaction information from the user behavior, wherein the interaction information identifies the first display interaction area and at least the second display interaction area from the user behavior with the first representation of digital content and an order in which the first display interaction area and at least the second display interaction area of the first representation of digital content are selected;

maintaining the interaction information;

deforming a second representation of digital content using the interaction information, wherein deforming includes scaling at least one of the first display interaction area and the second display interaction area of the first representation of digital content based on the interaction information as the second representation, wherein the scaling alters the first display interaction area relative to the second display interaction area; and

displaying the second representation of digital content, wherein a first display condition of the first display interaction area where the first representation is displayed is different from a second display condition of a second display area where the second representation is displayed.

2. The method of claim 1, wherein deforming a second representation includes deforming an active area of the second representation.

3. The method of claim 1, wherein deforming a second representation includes deforming a layout of the second representation.

4. The method of claim 1, wherein the first and second representation are of the same digital content.

5. The method of claim 4, wherein the digital content is at least one of a web page, a digital document, a digital image, an electronic book, a digital slide, and a graphical user interface.

6. The method of claim 4, wherein maintaining the interaction information comprises:

adding the interaction information to a file containing data for the digital content.

7. The method of claim 1, wherein the first representation is a representation of first digital content and the second representation is a representation of second digital content.

8. The method of claim 7, wherein the first representation is a representation of a first graphical user interface and the second representation is a representation of a second graphical user interface.

9. The method of claim 1, wherein monitoring user behavior while interacting with the first representation comprises:

monitoring user interaction with the first representation of digital content; and

determining interaction areas from the user interaction with the first representation.

10. The method of claim 9, wherein monitoring user behavior while interacting with the first representation further comprises:

evaluating user interaction with the interaction areas.

11. The method of claim 9, wherein deforming the second representation comprises:

determining interaction areas of the second representation corresponding to the first representation;

deforming the corresponding interaction areas.

12. The method of claim 11, wherein deforming the corresponding interaction areas includes at least one of enlarging the interaction areas, applying a fisheye perspective to the interaction areas, and zooming the interaction areas.

13. The method of claim 1, wherein monitoring user behavior while interacting with a first representation of digital content includes monitoring user behavior while interacting with at least one of a first representation of a graphical user interface, a first representation of a digital image, a first representation of an electronic book, and a first representation of a digital slide.

14. The method of claim 1, wherein maintaining the interaction information includes maintaining the interaction information with an identification of the digital content from which the interaction information was determined.

15. The method of claim 1, wherein deforming the second representation includes applying an animation to areas of the second representation using the interaction information.

16. The method of claim 1, wherein determining interaction information from the user behavior includes determining a degree of interaction with at least one area of the first representation.

17. The method of claim 1, wherein determining interaction information from the user behavior includes determining a sequence of interaction with the first representation.

18. The method of claim 1, wherein the first representation is not deformed when deforming the second representation.

19. The method of claim 1, wherein the first and second representation are representations of the same digital content, and wherein:

the second representation is deformed without modifying the digital content.

20. The method of claim 1, wherein maintaining the interaction information comprises storing the interaction information at at least one of a client-side device, a server, and a proxy server.

21. The method of claim 1, wherein:

monitoring user behavior while interacting with a first representation of digital content comprises monitoring a first user'"'"'s behavior including highlighting a textual passage of content or selecting a portion of an image or document while interacting with the first representation; and

deforming a second representation of digital content using the interaction information comprises deforming a second representation presented to a second user.

22. The method of claim 1, wherein deforming a second representation includes deforming an active area of the second representation corresponding to the first display interaction area and at least the second display interaction area of the first representation.

23. A method for presenting a representation of digital content, comprising:

monitoring user behavior while interacting with a first representation of digital content on a first device, wherein user behavior includes how often or how many times a first display interaction area and at least a second display interaction area are interacted with or in what order a user interacts with the first display interaction area and at least the second display interaction area;

determining interaction information from the user behavior, wherein the interaction information identifies the first display interaction area and at least the second display interaction area from the user interaction with the first representation of digital content and an order in which the first display interaction area and at least the second display interaction area of the first representation of digital content are selected;

maintaining the interaction information;

deforming a second representation of digital content on a second device using the interaction information, wherein deforming includes scaling a portion of at least one of the first display interaction area and the second display interaction area of the first representation of digital content based on the interaction information as the second representation, wherein the scaling scales only a portion of the first display interaction area and the second display interaction area relative to the first representation; and

presenting the representation of digital content.

24. A method for presenting digital content, comprising:

presenting a first representation of digital content on a first device;

presenting a second representation of the digital content on a second device;

monitoring user interaction with at least one of the first representation and the second representation, wherein the user interaction includes identifying a first display interaction area and at least a second display interaction area from the user interaction with the first representation of digital content and a first display interaction area and at least a second display interaction area from the user interaction with the second representation of digital content;

determining interaction information from the user interaction, wherein the interaction information includes an identification of at least the first display interaction area and the second display interaction area of the first representation or the second representation and an order in which the first display interaction area and the second display interaction are of the first representation or the second representation are selected;

maintaining the interaction information;

deforming at least one of the first representation and the second representation of the digital content using the interaction information;

wherein said deforming step includes at least one of deforming the first representation using interaction information determined from interaction with the second representation and deforming the second representation using interaction information determined from interaction with the first representation, wherein deforming includes scaling text contained in at least one of the first display interaction area and the second display interaction area of the first representation of digital content based on the interaction information as the second representation, wherein the scaling scales only the text contained in the first display interaction area and the second display interaction area relative to the first representation; and

presenting the digital content.

25. A method for presenting digital content, comprising:

identifying a first display interaction area and at least a second display interaction area of a representation of digital content determined to be of interest using observed user interaction which includes evaluating an order in which the first display interaction area and at least the second display interaction area of the representation of digital content are selected and how often or how many times the first display interaction area and at least the second display interaction area are selected;

accepting the interaction area and the user interaction as interaction information;

deforming the representation of the digital content using the interaction information, wherein deforming includes scaling at least one of the first display interaction area and the second display interaction area of the first representation of digital content based on the interaction information as the second representation, wherein the scaling scales one of the first display interaction area and the second display interaction area relative to the first representation; and

presenting the digital content.

26. The method of claim 25, wherein the representation of the digital content is a second representation of the digital content, and wherein:

the interaction information is interaction information determined from interaction with a first representation of the digital content.

27. The method of claim 25, wherein the digital content is second digital content, and wherein:

the interaction information is interaction information determined from interaction with a representation of first digital content.

28. The method of claim 27, wherein the first digital content is a first web page and the second digital content is a second web page.

29. A method for determining interaction information, comprising:

monitoring user behavior while interacting with a first representation of digital content, wherein the user behavior includes how often or how many times a first display interaction area and at least a second display interaction area are interacted with and at least an order a user interacts with the first display interaction area and at least the second display interaction area;

determining interaction information from the user behavior, wherein the interaction information includes identifying the first display interaction area and at least the second display interaction area from the user behavior with the first representation of digital content and the order in which the first display interaction area and at least the second display interaction area of the first representation of digital content are selected, wherein deforming includes scaling one or more pixels selected in at least one of the first display interaction area and the second display interaction area of the first representation of digital content based on the interaction information as the second representation, wherein the scaling scales only the one or more pixels selected in the first display interaction area and the second display interaction area relative to the first representation; and

maintaining the interaction information.

30. A method for distributing digital content, comprising:

accepting a request for digital content from a device;

retrieving the digital content;

retrieving interaction information, wherein the interaction information identifies a first display interaction area and at least a second display interaction area from the user interaction with the digital content and an order in which the first display interaction area and at least the second display interaction area of the digital content are selected;

modifying the digital content based on the interaction information, wherein deforming includes scaling two or more pixels selected in at least one of the first display interaction area and the second display interaction area of the first representation of digital content based on the interaction information as the second representation, wherein the scaling scales only the two or more pixels selected in the first display interaction area and the second display interaction area relative to the first representation; and

transferring the modified digital content to the device.

31. The method of claim 30, wherein a representation of the digital content is deformed in accordance with the interaction information when presented on the device.

32. The method of claim 30, wherein retrieving the digital content comprises:

retrieving a copy of the digital content.

33. A method for distributing digital content, comprising:

accepting a request for digital content from a device;

retrieving the digital content;

retrieving interaction information, wherein the interaction information identifies a first display interaction area and at least a second display interaction area from the user interaction with the digital content, wherein the interaction information identifies degrees of interaction with the first display interaction area and at least the second display interaction area and sequences of interaction with the first display interaction area and at least the second display interaction area of the digital content; and

transferring the interaction information and the digital content to the device;

wherein a representation of the digital content is deformed at the device using the interaction information, wherein the deforming includes scaling at least one of the first display interaction area and the second display interaction area of the first representation of digital content based on the interaction information as the second representation, wherein the scaling does not scale the entire first display interaction area relative to the first representation.

34. The method of claim 33, wherein transferring the interaction information and the digital content to the device comprises:

transferring a first file containing the interaction information and a second file containing the digital content.

35. The method of claim 33, wherein transferring the interaction information and the digital content to the device comprises:

adding the interaction information to a file including the digital content;

transferring the file to the device.

36. The method of claim 35, wherein the digital content is not modified by adding the interaction information.

37. A computer readable medium, comprising:

a code segment including instructions to monitor user behavior while interacting with a first representation of digital content;

a code segment including instructions to determine interaction information from the user behavior, wherein the interaction information identifies a first display interaction area and at least a second display interaction area from the user interaction with the digital content, wherein the interaction information includes how often or how many times a first display interaction area and at least a second display interaction area are selected and an order in which the first display interaction area and at least the second display interaction area are selected;

a code segment including instructions to maintain the interaction information, wherein the instructions to maintain include logging and storing; and

a code segment including instructions to deform a second representation of digital content using the interaction information, wherein the deforming includes scaling at least one of the first display interaction area and the second display interaction area of the first representation of digital content based on the interaction information as the second representation, wherein the scaling scales the first display interaction area and the second display interaction area relative to the first representation.

38. A machine readable medium having instructions stored thereon that when executed by a processor cause a system to:

monitor user behavior while interacting with a first representation of digital content;

determine interaction information from the user behavior, wherein the interaction information identifies a first display interaction area and at least a second display interaction area from the user interaction with the first representation of digital content and an order in which the first display interaction area and at least the second display interaction area of the first representation of digital content are selected;

maintain the interaction information, wherein maintaining the interaction information, includes logging and storing; and

deform a second representation of digital content using the interaction information, wherein the deform includes scaling at least one of the first display interaction area and the second display interaction area of the first representation of digital content based on the interaction information as the second representation, wherein the scaling scales the first display interaction area and the second display interaction area relative to the first representation.

39. A system, comprising:

means for monitoring user behavior while interacting with a first representation of digital content;

means for determining interaction information from the user behavior, wherein the interaction information identifies a first display interaction area and at least a second display interaction area from the user interaction with the first representation of digital content and an order in which the first display interaction area and at least the second display interaction area of the first representation of digital content are selected;

means for maintaining the interaction information, wherein the means for maintaining include logging and storing; and

means for deforming a second representation of digital content using the interaction information, wherein the deforming includes scaling the first display interaction area of the first representation of digital content based on the interaction information as the second representation, wherein the scaling scales the second display interaction area with the ratio of the scale of the first display interaction area in the second representation to the first diplay interaction area in the first representation.