Vocal command directives to compose dynamic display text

• US 8,024,185 B2
• Filed: 10/10/2007
• Issued: 09/20/2011
• Est. Priority Date: 10/10/2007
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: International Business Machines Corporation
• Inventors: Seacat, Lisa A., Do, Lydia M., Nesbitt, Pamela A.
• Primary Examiner(s): ABEBE, DANIEL DEMELASH
• Application Number:
  US11/869,987
• Publication Number:
  US 20090099850A1
• Time in Patent Office: 1,441 Days
• Field of Search: 704/235, 704/275, 709/205, 348/14.09
• US Class Current: 704/235
• CPC Class Codes: G06F 2203/04109 FTIR in optical digitiser, i.e. touch detection by frustrating the total internal reflection within an optical waveguide due to changes of optical properties or deformation at the touch location
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Abstract

Methods, apparatus, products are disclosed for displaying speech for a user of a surface computer, the surface computer comprising a surface, the surface computer capable of receiving multi-touch input through the surface and rendering display output on the surface, that include: registering, by the surface computer, a plurality of users with the surface computer; allocating, by the surface computer to each registered user, a portion of the surface for interaction between that registered user and the surface computer; detecting, by the surface computer, a speech utterance from one of the plurality of users; determining, by the surface computer using a speech engine, speech text in dependence upon the speech utterance; creating, by the surface computer, display text in dependence upon the speech text; and rendering, by the surface computer, the display text on at least one of the allocated portions of the surface.

Claims

1. A method of displaying text derived from speech for a user of a surface computer, the surface computer comprising a surface, the surface computer capable of receiving multi-touch input through the surface and rendering display output on the surface, the method comprising:

registering, by the surface computer, a plurality of users with the surface computer, including selecting a speech engine configuration for each registered user in dependence upon a user profile for that registered user;

allocating, by the surface computer to each registered user, a portion of the surface for interaction between that registered user and the surface computer;

detecting, by the surface computer, a speech utterance from one of the plurality of users;

determining, by the surface computer using a speech engine, speech text in dependence upon the speech utterance, including determining the speech text using the speech engine configuration for at least one of the registered users;

creating, by the surface computer, display text in dependence upon the speech text; and

rendering, by the surface computer, the display text on at least one of the allocated portions of the surface.

2. The method of claim 1 wherein:

the method further comprises determining, by the surface computer, to which particular user of the plurality of users the speech utterance is directed; and

rendering, by the surface computer, the display text on at least one of the allocated portions of the surface further comprises rendering the display text in the portion of the surface allocated to the particular user to which the speech utterance is directed.

3. The method of claim 1 further comprising:

detecting, by the surface computer, a second speech utterance from any of the plurality of users;

determining, by the surface computer using the speech engine, a second speech text in dependence upon the second speech utterance;

modifying, by the surface computer, the display text in dependence upon the second speech text; and

rendering, by the surface computer, the modified display text on at least one of the allocated portions of the surface.

4. The method of claim 1 wherein creating, by the surface computer, display text in dependence upon the speech text further comprises selecting one or more portions of the speech text as the display text.

5. The method of claim 1 wherein creating, by the surface computer, display text in dependence upon the speech text further comprises selecting the display text from a predefined display text repository in dependence upon one or more portions of the speech text.

6. The method of claim 1 further comprises:

detecting, by the surface computer, a portable computing device placed on the surface; and

transferring, by the surface computer, the display text to the portable computing device for storage.

7. A surface computer for displaying text derived from speech for a user of a surface computer, the surface computer comprising a surface, the surface computer capable of receiving multi-touch input through the surface and rendering display output on the surface, the surface computer comprising a computer processor, a computer memory operatively coupled to the computer processor, the computer memory having disposed within it computer program instructions capable of:

registering, by the surface computer, a plurality of users with the surface computer, including selecting a speech engine configuration for each registered user in dependence upon a user profile for that registered user;

allocating, by the surface computer to each registered user, a portion of the surface for interaction between that registered user and the surface computer;

detecting, by the surface computer, a speech utterance from one of the plurality of users;

determining, by the surface computer using a speech engine, speech text in dependence upon the speech utterance, including determining the speech text using the speech engine configuration for at least one of the registered users;

creating, by the surface computer, display text in dependence upon the speech text; and

rendering, by the surface computer, the display text on at least one of the allocated portions of the surface.

8. The surface computer of claim 7 wherein:

the computer memory has disposed within it computer program instructions capable of determining, by the surface computer, to which particular user of the plurality of users the speech utterance is directed; and

rendering, by the surface computer, the display text on at least one of the allocated portions of the surface further comprises rendering the display text in the portion of the surface allocated to the particular user to which the speech utterance is directed.

9. The surface computer of claim 7 wherein computer memory has disposed within it computer program instructions capable of:

detecting, by the surface computer, a second speech utterance from any of the plurality of users;

determining, by the surface computer using the speech engine, a second speech text in dependence upon the second speech utterance;

modifying, by the surface computer, the display text in dependence upon the second speech text; and

rendering, by the surface computer, the modified display text on at least one of the allocated portions of the surface.

10. The surface computer of claim 7 wherein computer memory has disposed within it computer program instructions capable of:

detecting, by the surface computer, a portable computing device placed on the surface; and

transferring, by the surface computer, the display text to the portable computing device for storage.

11. A computer program product for displaying text derived from speech for a user of a surface computer, the surface computer comprising a surface, surface computer capable of receiving multi-touch input through the surface and rendering display output on the surface, the computer program product disposed in a recordable computer readable medium, the computer program product comprising computer program instructions capable of:

registering, by the surface computer, a plurality of users with the surface computer, including selecting a speech engine configuration for each registered user in dependence upon a user profile for that registered user;

allocating, by the surface computer to each registered user, a portion of the surface for interaction between that registered user and the surface computer;

detecting, by the surface computer, a speech utterance from one of the plurality of users;

determining, by the surface computer using a speech engine, speech text in dependence upon the speech utterance, including determining the speech text using the speech engine configuration for at least one of the registered users;

creating, by the surface computer, display text in dependence upon the speech text; and

rendering, by the surface computer, the display text on at least one of the allocated portions of the surface.

12. The computer program product of claim 11 wherein:

the computer program product further comprises computer program instructions capable of determining, by the surface computer, to which particular user of the plurality of users the speech utterance is directed; and

rendering, by the surface computer, the display text on at least one of the allocated portions of the surface further comprises rendering the display text in the portion of the surface allocated to the particular user to which the speech utterance is directed.

13. The computer program product of claim 11 further comprising computer program instructions capable of:

detecting, by the surface computer, a second speech utterance from any of the plurality of users;

determining, by the surface computer using the speech engine, a second speech text in dependence upon the second speech utterance;

modifying, by the surface computer, the display text in dependence upon the second speech text; and

rendering, by the surface computer, the modified display text on at least one of the allocated portions of the surface.

14. The computer program product of claim 11 wherein creating, by the surface computer, display text in dependence upon the speech text further comprises selecting one or more portions of the speech text as the display text.

15. The computer program product of claim 11 wherein creating, by the surface computer, display text in dependence upon the speech text further comprises selecting the display text from a predefined display text repository in dependence upon one or more portions of the speech text.