Method and apparatus for materials in different screen sizes using an imaging sensor

• US 10,503,812 B2
• Filed: 03/24/2016
• Issued: 12/10/2019
• Est. Priority Date: 10/14/2009
• Status: Active Grant

• Current Assignee: Iplcontent, LLC
• Original Assignee: Iplcontent, LLC
• Inventors: Ho, Chi Fai, Tong, Peter P.
• Primary Examiner(s): Zuberi, Mohammed H
• Application Number:
  US15/079,911
• Publication Number:
  US 20160203110A1
• Time in Patent Office: 1,356 Days
• CPC Class Codes: G06F 15/0291 for reading, e.g. e-books constructional details of portable computers G06F1/1613
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0483 Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06F 40/103 Formatting, i.e. changing of presentation of documents automatic justification G06F40/189; automatic line break hyphenation G06F40/191
• CPC Class Codes: G06F 40/106 Display of layout of documents; Previewing
• CPC Class Codes: G06F 40/114 Pagination
• CPC Class Codes: G06F 40/123 Storage facilities
• CPC Class Codes: G06F 40/169 Annotation, e.g. comment data or footnotes

Abstract

One embodiment includes a mobile device, having at least an imaging sensor, applicable for reading materials, with at least a section including text linked to an illustration. Annotations could be added to the materials. The device can layout the section by keeping the text with the illustration to be displayed in one screen. Another embodiment includes materials with a text sub file with texts, an illustration sub file with illustrations, and a logic sub file with rules on displaying the materials. Either the text or the illustration sub file includes position information linking at least an illustration to a corresponding piece of text. Yet another embodiment includes materials with a logic sub file that can analyze an attribute of, and provide a response to, a user.

Claims

1. A mobile device applicable for a user to read materials, the mobile device comprising:

a controller;

a display;

an imaging sensor; and

a storage medium to store at least a piece of materials, with the piece of materials comprising;

a text sub file including at least a piece of text;

an illustration sub file including at least an illustration; and

a logic sub file including a plurality of instructions executable by at least the controller to result in the mobile device to;

layout at least a screen of a first size, with the screen including at least an area of the piece of materials, at least by keeping the piece of text with the illustration to be presented on the device, wherein to layout includes to calculate at least one position of the piece of text in the screen and to calculate at least one position of the illustration in the screen, to fit at least both the piece of text and the illustration into the screen; and

layout again but for at least a screen of a second size, with the screen including at least the area of the piece of materials, at least by keeping the piece of text with the illustration to be presented on the device, wherein to layout includes to calculate at least one position of the piece of text in the screen and to calculate at least one position of the illustration in the screen, to fit at least both the piece of text and the illustration into the screen, with the second size being different from the first size,

wherein the plurality of instructions executable by at least the controller result in the mobile device to;

analyze at least an attribute of the user based on monitoring the user using at least the imaging sensor;

identify at least the area of the piece of materials based on at least the analyze;

access the area of the piece of materials; and

present the area of the piece of materials on the display.

2. A mobile device as recited in claim 1, wherein the mobile device is configured to enable the user to enter an annotation into the device for at least a portion of the piece of materials.

3. A mobile device as recited in claim 1, wherein the plurality of instructions executable by at least the controller result in the mobile device to access an annotation for at least a portion of the piece of materials.

4. A mobile device as recited in claim 3,

wherein the annotation is wirelessly received by the mobile device, and

wherein the annotation is received by the mobile device not together with the piece of materials.

5. A mobile device as recited in claim 1, wherein the plurality of instructions executable by at least the controller result in the mobile device to:

access an annotation with position information regarding the annotation; and

layout the annotation with a portion of the piece of materials using at least the position information.

6. A mobile device as recited in claim 3, wherein the plurality of instructions executable by at least the controller result in the mobile device to:

determine if there is sufficient space in a screen of the display to present the annotation with the portion of the piece of materials, and layout the annotation with the portion of the piece of materials in the screen if the determine determines that there is sufficient space; and

layout the annotation with at least a part of the portion of the piece of materials for another screen if the determine determines that there is insufficient space.

7. A mobile device as recited in claim 1, wherein the plurality of instructions executable by at least the controller result in the mobile device to access a plurality of annotations for the user to identify one or more annotations to be presented on the display with at least a part of the piece of materials.

8. A mobile device as recited in claim 3, wherein the plurality of instructions executable by at least the controller result in the mobile device to:

present a notification regarding the annotation on the display; and

present the annotation on the display if the mobile device receives a user action regarding the notification.

9. A mobile device as recited in claim 8, wherein the notification includes a symbol.

10. A mobile device as recited in claim 8, wherein the notification includes highlighting at least a part of the portion.

11. A mobile device as recited in claim 8, wherein the plurality of instructions executable by at least the controller result in the mobile device to layout at least the annotation to be presented on the display if the mobile device receives the user action regarding the notification.

12. A mobile device as recited in claim 3,

wherein the portion includes at least the piece of text, and

wherein the plurality of instructions executable by at least the controller result in the mobile device to alert the user of the annotation by providing at least a notification close to the piece of text, such that at least both the notification and the piece of text can be in the same screen.

13. A mobile device as recited in claim 1, wherein to read materials includes to watch a video.

14. A mobile device as recited in claim 1, wherein the illustration includes a video.

15. A mobile device as recited in claim 1, wherein the illustration includes an animation.

16. A mobile device as recited in claim 3, wherein the annotation includes a video.

17. A mobile device as recited in claim 3, wherein the plurality of instructions executable by at least the controller result in the mobile device to:

present on the display a notification regarding the annotation;

receive a user action regarding the notification, with the user action indicating to present the annotation on the display;

determine if there is sufficient space in a screen of the display to present the annotation with the portion of the piece of materials, and layout the annotation with the portion of the piece of materials in the screen if the determine determines that there is sufficient space; and

layout the annotation with at least a part of the portion of the piece of materials for another screen if the determine determines that there is insufficient space.

18. A mobile device as recited in claim 17,

wherein the notification is selected from a list including a symbol and highlighting at least a part of the portion, and

wherein to read materials includes to watch a video.

19. A mobile device as recited in claim 18,

wherein the annotation includes a video, and

wherein the illustration includes an animation.

20. A mobile device as recited in claim 2, wherein the plurality of instructions executable by at least the controller result in the mobile device to:

determine if there is sufficient space in a screen of the display to present the annotation with the portion of the piece of materials, and layout the annotation with the portion of the piece of materials for the screen if the determine determines that there is sufficient space; and

layout the annotation with at least a part of the portion of the piece of materials for another screen if the determine determines that there is insufficient space,

wherein to read materials includes to watch a video, and

wherein the annotation includes a video.

21. A mobile device as recited in claim 1, wherein the imaging sensor is configured to monitor at least an image regarding the head of the user for analysis.

22. A non-transitory computer readable medium of a mobile device, the non-transitory computer readable medium including at least a piece of materials stored therein, the piece of materials comprising a text sub file including at least a piece of text, an illustration sub file including at least an illustration, and a logic sub file including executable computer program code, applicable to present to a user via the mobile device, the mobile device including at least an imaging sensor, the executable computer program code comprising:

computer program code to analyze at least an attribute of the user based on monitoring the user using at least the imaging sensor;

computer program code to identify an area of the piece of materials based on at least the analyze, with the area including at least the piece of text and the illustration;

computer program code to layout at least a screen of a first size, with the screen including at least the area of the piece of materials, at least by keeping the piece of text with the illustration to be presented, wherein to layout includes to calculate at least one position of the piece of text in the screen and to calculate at least one position of the illustration in the screen, to fit at least both the piece of text and the illustration into the screen; and

computer program code to layout again but for at least a screen of a second size, with the screen including at least the area of the piece of materials, at least by keeping the piece of text with the illustration to be presented, wherein to layout includes to calculate at least one position of the piece of text in the screen and to calculate at least one position of the illustration in the screen, to fit at least both the piece of text and the illustration into the screen, with the second size being different from the first size.

23. A non-transitory computer readable medium as recited in claim 22, wherein the executable computer program code comprises computer program code to enable the user to enter an annotation into the device for at least a portion of the piece of materials.

24. A non-transitory computer readable medium as recited in claim 22, wherein the executable computer program code comprises computer program code to access an annotation for at least a portion of the piece of materials.

25. A non-transitory computer readable medium as recited in claim 24, wherein the executable computer program code comprises:

computer program code to access position information regarding the annotation; and

computer program code to layout the annotation with the portion of the piece of materials using at least the position information.

26. A non-transitory computer readable medium as recited in claim 22, wherein the executable computer program code comprises computer program code to access a plurality of annotations for the user to identify one or more annotations to be presented with at least a part of the piece of materials.

27. A non-transitory computer readable medium as recited in claim 22, wherein the attribute of the user is related to the head of the user.

28. A non-transitory computer readable medium as recited in claim 22, wherein the attribute of the user is related to a facial feature of the user.

29. A method to present to a user via a mobile device, with the mobile device comprising at least a display, at least a sensor applicable to monitor images, and at least a storage medium to store at least a piece of materials, with the piece of materials comprising a text sub file including at least a piece of text, and an illustration sub file including at least an illustration, the method, implemented by the mobile device, comprising:

analyzing at least an attribute of the user based on monitoring the user using at least the sensor;

identifying an area of the piece of materials based on at least the analyzing, with the area including at least the piece of text and the illustration;

laying out at least a screen of a first size, with the screen including at least the area of the piece of materials, at least by keeping the piece of text with the illustration to be presented on the device, wherein to laying out includes to calculate at least one position of the piece of text in the screen and to calculate at least one position of the illustration in the screen, to fit at least both the piece of text and the illustration into the screen; and

laying out again but for at least a screen of a second size, with the screen including at least the area of the piece of materials, at least by keeping the piece of text with the illustration to be presented on the device, wherein to laying out includes to calculate at least one position of the piece of text in the screen and to calculate at least one position of the illustration in the screen, to fit at least both the piece of text and the illustration into the screen, with the second size being different from the first size.

30. A method as recited in claim 29 comprising accessing an annotation for at least a portion of the piece of materials.

31. A method as recited in claim 30, wherein the annotation is entered by the user into the device.

32. A method as recited in claim 30, wherein the annotation is wirelessly received by the mobile device.

33. A method as recited in claim 30 comprising:

determining if there is sufficient space in at least the screen of the first size to present the annotation with the portion of the piece of materials, and laying out the annotation with the portion of the piece of materials in the screen if the determining determines that there is sufficient space; and

laying out the annotation with at least a part of the portion of the piece of materials for another screen if the determining determines that there is insufficient space.

34. A method as recited in claim 30,

wherein the portion includes at least the piece of text, and

wherein the method comprises alerting the user of the annotation by providing at least a notification close to the piece of text, such that at least both the notification and the piece of text can be in the same screen.

35. A method as recited in claim 30 comprising:

accessing a notification for the user regarding the annotation;

receiving a user action regarding the notification, with the user action indicating to present the annotation; and

determining if there is sufficient space in at least the screen of the first size to present the annotation with the portion of the piece of materials, and laying out the annotation with the portion of the piece of materials in at least the screen of the first size if the determining determines that there is sufficient space.

36. A method as recited in claim 35 comprising laying out the annotation with at least a part of the portion of the piece of materials for another screen if the determining determines that there is insufficient space.