Method and apparatus for electronic books with enhanced educational features

• US 20060194181A1
• Filed: 11/10/2005
• Published: 08/31/2006
• Est. Priority Date: 02/28/2005
• Status: Abandoned Application

• Current Assignee: Outland Research LLC
• Original Assignee: Outland Research LLC
• Inventors: Rosenberg, Louis Barry
• Application Number:
  US11/271,172
• Publication Number:
  US 20060194181A1
• Time in Patent Office: Days
• US Class Current: 434/317
• CPC Class Codes: G09B 19/06 Foreign languages with audible presentation of material to be studied G09B5/04
• CPC Class Codes: G09B 5/06 with both visual and audible presentation of the material to be studied

Abstract

A method of visually correlating text and speech includes receiving a source file; generating, based on the source file, a page display image including a series of text segments, the generating including rendering the series of text segments with a first set of display characteristics; receiving an input signal representing an utterance; processing the received input signal to determine whether at least a portion of a text segment included within the generated page display image has been uttered; identifying the text segment determined to have been at least partially uttered; rendering the identified text segment with a second set of display characteristics; and enabling the generated page display image to be visually represented on an output device, wherein the identified text segment is rendered with the second set of display characteristics substantially simultaneously upon receiving the input signal.

Claims

1. A method of visually correlating text and speech, comprising:

receiving a source file;

generating, based on the source file, a page display image including a series of text segments, the generating including rendering the series of text segments with a first set of display characteristics;

receiving an input signal representing an utterance;

processing the received input signal to determine whether at least a portion of a text segment included within the generated page display image has been uttered;

identifying the text segment determined to have been at least partially uttered;

rendering the identified text segment with a second set of display characteristics; and

enabling the generated page display image to be visually represented on an output device;

wherein the identified text segment is rendered with the second set of display characteristics substantially simultaneously upon receiving the input signal.

2. The method of claim 1, wherein the text segment includes a syllable.

3. The method of claim 2, wherein the text segment includes a word.

4. The method of claim 1, wherein at least one of the first and second set of display characteristics includes at least one of a font type, font size, font style, font color, background color, font effects, and text effects.

5. The method of claim 1, wherein rendering the identified text segment with the second set of display characteristics includes accentuating the identified text segment with respect to text segments rendered with the first set of display characteristics.

6. The method of claim 1, further comprising re-rendering the identified text segment with the first set of display characteristics after a predetermined amount of time.

7. The method of claim 1, further comprising:

processing the received input signal to determine whether at least a portion of a text segment immediately succeeding the previously identified text segment in the series of text segments has been spoken;

identifying the succeeding text segment determined to have been at least partially spoken; and

rendering the identified succeeding text segment with the second set of display characteristics.

8. The method of claim 7, further comprising rendering the previously identified text segment with the first set of display characteristics.

9. The method of claim 7, further comprising rendering the previously identified text segment with a third set of display characteristics.

10. The method of claim 1, wherein receiving the input signal includes receiving an input signal representing an utterance of a single user.

11. The method of claim 1, wherein receiving the input signal includes receiving an input signal representing an utterance of a plurality of users.

12. The method of claim 1, further comprising:

generating a plurality of page display images based on the received source file, wherein each page display images contains a series of text segments; and

selecting from one of the plurality of page display images to be visually represented on the output device.

13. The method of claim 12, wherein the selecting includes:

processing the received input signal to determine whether a last text segment in the series of text segments within the visually represented page display image has been uttered; and

visually representing a different page display image upon determining that the last text segment has been uttered.

14. The method of claim 13, further comprising visually representing the different page display image after a predetermined amount of time upon determining that the last text segment has been uttered.

15. The method of claim 12, wherein the selecting includes receiving an instruction from a user to visual represent a different page display image.

16. The method of claim 15, wherein the instruction includes at least one of a verbal instruction and a manual instruction.

17. The method of claim 1, further comprising visually representing the generated page display image on a monitor.

18. The method of claim 1, further comprising visually representing the generated page display image on a viewing surface by a projector.

19. A system for visually correlating text and speech, comprising:

a storage medium adapted to store a source file;

a text rendering engine adapted to generate a page display image based on the source file, the page display image including a series of text segments rendered with a first set of display characteristics;

an input port adapted to receive an input signal representing an utterance;

speech recognition circuitry adapted to process the received input signal, determine whether at least a portion of a text segment included within the generated page display image has been uttered, and to output data to the text rendering engine, the output data identifying the text segment determined to have been at least partially uttered; and

an output port adapted to transmit the generated page display image to an output device, wherein the text rendering engine is further adapted to render text segments identified by the speech recognition circuitry with a second set of display characteristics substantially simultaneously upon receiving the input signal.

20. The system of claim 19, wherein the text segment includes a syllable.

21. The system of claim 20, wherein the text segment includes a word.

22. The system of claim 19, wherein at least one of the first and second set of display characteristics includes at least one of a font type, font size, font style, font color, background color, font effects, and text effects.

23. The system of claim 19, wherein speech recognition circuitry is adapted to accentuate the identified text segment with respect to text segments rendered with the first set of display characteristics.

24. The system of claim 19, wherein the text rendering engine is further adapted to re-render the identified text segment with the first set of display characteristics after a predetermined amount of time.

25. The system of claim 19, wherein the speech recognition circuitry is further adapted to:

process the received input signal to determine whether at least a portion of a text segment immediately succeeding the previously identified text segment in the series of text segments has been spoken;

identify the succeeding text segment determined to have been at least partially spoken; and

render the identified succeeding text segment with the second set of display characteristics.

26. The system of claim 25, wherein the text rendering engine is further adapted to render the previously identified text segment with the first set of display characteristics.

27. The system of claim 25, wherein the text rendering engine is further adapted to the previously identified text segment with a third set of display characteristics.

28. The system of claim 19, further comprising a microphone coupled to the input port.

29. The system of claim 28, further comprising a plurality of microphones coupled to the input port.

30. The system of claim 19, wherein the text rendering engine is adapted to generate a plurality of page display images based on the source file, wherein each page display image contains a series of text segments, the system further comprising:

a user interface adapted to select one of the plurality of page display images to be transmitted by the output port.

31. The system of claim 30, wherein the user interface is adapted to enable automatic selection of one of the plurality of page display images to be transmitted by the output port.

32. The system of claim 30, wherein the user interface is adapted to enable manual selection of one of the plurality of page display images to be transmitted by the output port.

33. The system of claim 32, further comprising a housing adapted to be held by a user, wherein the user interface includes a page turning mechanism coupled to the housing and adapted to select one of the plurality of page display images to be transmitted by the output port based on an orientation of the housing.

34. The system of claim 30, wherein the instruction includes at least one of verbal selection of one of the plurality of page display images to be transmitted by the output port.

35. The system of claim 19, further comprising the output device, wherein the output device includes a monitor.

36. The system of claim 19, further comprising the output device, wherein the output device includes a projector.