Autogenerating video from text

• US 9,189,698 B2
• Filed: 04/14/2015
• Issued: 11/17/2015
• Est. Priority Date: 01/20/2012
• Status: Active Grant

• Current Assignee: Elwha LLC (Intellectual Ventures LLC)
• Original Assignee: Elwha LLC (Intellectual Ventures LLC)
• Inventors: Chan, Alistair K., Gates, William, Holman, Pablos, Hyde, Roderick A., Jung, Edward K. Y., Kare, Jordin T., Myhrvold, Nathan P., Rosema, Keith D., Tegreene, Clarence T., Wood, Lowell L. Jr.
• Primary Examiner(s): COUSO, JOSE L
• Application Number:
  US14/686,303
• Publication Number:
  US 20150220803A1
• Time in Patent Office: 217 Days
• US Class Current: 1/1
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 13/00 Animation
• CPC Class Codes: G06T 15/00 3D [Three Dimensional] image rendering
• CPC Class Codes: G06V 10/17 using hand-held instruments
• CPC Class Codes: G06V 20/63 Scene text, e.g. street names
• CPC Class Codes: G06V 30/10 Character recognition
• CPC Class Codes: G06V 30/142 using hand-held instruments; Constructional details of the instruments
• CPC Class Codes: G06V 30/40 Document-oriented image-based pattern recognition

Abstract

A method of converting user-selected printed text to a synthesized image sequence is provided. The method includes capturing a first image of printed text and generating a model information associated with the text.

Claims

1. A client for converting a textual passage to a synthesized image sequence, comprising:

a connection to an image sensor configured to capture an image of text;

an output device configured to communicate with a remote server;

a display; and

processing electronics configured to receive the image of text from the connection to the image sensor, the text being a passage from a source text, and in response to receiving the image of the text;

to translate the text of the image of text into a machine readable format;

to receive auxiliary information; and

to transmit the text in the machine readable format and the auxiliary information to a remote server;

wherein the processing electronics are configured to receive from the remote server model information based on the text in the machine readable format and the auxiliary information, wherein the processing electronics are configured to generate the synthesized image sequence based on the model information, and wherein the processing electronics are configured to output the synthesized image sequence using the display.

2. The client of claim 1, wherein the processing electronics are configured to generate the synthesized image sequence based on the model information using a rendering engine.

3. The client of claim 1, wherein the auxiliary information is at least one of an additional passage of text from the source text, an ISBN number corresponding to the source text, a title of source text, a or bar code corresponding to the source text.

4. The client of claim 1, wherein the auxiliary information is an image of at least one of an additional passage of text from the source text, an ISBN number corresponding to the source text, a title of source text, a or bar code corresponding to the source text.

5. The client of claim 1, wherein the processing electronics are configured to receive the auxiliary information from a remote source.

6. The client of claim 1, where in the processing electronics are further configured to identify the source text from the text and the auxiliary information.

7. The client of claim 1, wherein the transmission to the remote server includes preferences for a user.

8. The client of claim 7, wherein the preferences include at least one of display preferences, a type of character or person displayed in the synthesized image sequence, a setting shown in the synthesized image sequence, or a language.

9. The client of claim 1, wherein the processing electronics are further configured to receive a text selection information before translating the image, the text selection information comprising a subset of the text in the image of the text.

10. The client of claim 1, wherein the processing electronics are further configured to translate the image of text into a machine readable format using a handwriting recognition engine.

11. The client of claim 1, wherein the image sensor is included in a camera associated with the client.

12. The client of claim 1, wherein the image sensor is included in a scanner associated with the client.

13. The client of claim 1, wherein the client is a desktop computer.

15. The mobile phone of claim 13, wherein the processing electronics are configured to generate the synthesized image sequence based on the model information using a rendering engine.

16. The mobile phone of claim 13, wherein the auxiliary information is at least one of an additional passage of text from the source text, an ISBN number corresponding to the source text, a title of source text, a or bar code corresponding to the source text.

17. The mobile phone of claim 13, where in the processing electronics are further configured to identify the source text from the text and the auxiliary information.

18. The mobile phone of claim 13, wherein the auxiliary information is an image of at least one of an additional passage of text from the source text, an ISBN number corresponding to the source text, a title of source text, a or bar code corresponding to the source text.

19. The mobile phone of claim 13, wherein the transmission to the remote server includes preferences for a user.

20. The mobile phone of claim 19, wherein the preferences include at least one of display preferences, a type of character or person displayed in the synthesized image sequence, a setting shown in the synthesized image sequence, or a language.

21. The mobile phone of claim 13, wherein the processing electronics are further configured to receive a text selection information before translating the image, the text selection information comprising a subset of the text in the image of the text.

22. The mobile phone of claim 13, wherein the processing electronics are further configured to translate the image of text into a machine readable format using a handwriting recognition engine.

23. The mobile phone of claim 13, wherein the processing electronics are configured to receive the auxiliary information from a second mobile phone.

24. The mobile phone of claim 13, wherein the processing electronics are further configured to transmit, using the communication device, the synthesized image sequence to a second mobile phone.

14. A mobile phone for converting a textual passage to a synthesized image sequence, comprising:

a camera;

a communications device configured to communicate with a remote server;

a display; and

processing electronics configured to receive an image of text from the camera, the text being a passage from a source text, and in response to receiving the image of the text;

to translate the text of the image of text into a machine readable format;

to receive auxiliary information; and

to transmit the text in the machine readable format and the auxiliary information to a remote server;

wherein the processing electronics are configured to receive from the remote server model information based on the text in the machine readable format and the auxiliary information, wherein the processing electronics are configured to generate the synthesized image sequence based on the model information, and wherein the processing electronics are configured to output the synthesized image sequence using the display.

25. A method for converting a textual passage to a synthesized image sequence, comprising:

receiving, at processing electronics of a mobile phone, an image of text from a camera of the mobile phone, the text being a passage from a source text;

translating the text of the image of text into a machine readable format;

receiving auxiliary information;

transmitting the text in the machine readable format and the auxiliary information to a remote server;

receiving from the remote server model information based on the text in the machine readable format and the auxiliary information;

generating the synthesized image sequence based on the model information; and

displaying the synthesized image sequence using a display of the mobile phone.

26. The method of claim 25, wherein the processing electronics are configured to generate the synthesized image sequence based on the model information using a rendering engine.

27. The method of claim 25, wherein the auxiliary information is at least one of an additional passage of text from the source text, an ISBN number corresponding to the source text, a title of source text, a or bar code corresponding to the source text.

28. The method of claim 25, further comprising identifying the source text from the text and the auxiliary information.

29. The method of claim 25, wherein the auxiliary information is an image of at least one of an additional passage of text from the source text, an ISBN number corresponding to the source text, a title of source text, a or bar code corresponding to the source text.

30. The method of claim 25, further comprising transmitting preferences for a user to the remote server.

31. The method of claim 30, wherein the preferences include at least one of display preferences, a type of character or person displayed in the synthesized image sequence, a setting shown in the synthesized image sequence, or a language.

32. The method of claim 25, further comprising receiving a text selection before translating the image, the text selection comprising a subset of the text in the image of the text.

33. The method of claim 25, further comprising translating the image of text into a machine readable format using a handwriting recognition engine.

34. The method of claim 25, wherein the mobile phone is configured to receive the auxiliary information from a second mobile phone.

35. The method of claim 25, further comprising transmitting the synthesized image sequence to a second mobile phone.