Method for local registration, enrollment, and interaction with multiple-user information display systems by coordinating voice and optical inputs

• US 7,512,891 B2
• Filed: 03/29/2005
• Issued: 03/31/2009
• Est. Priority Date: 03/18/2002
• Status: Active Grant

• Current Assignee: United States Air Force
• Original Assignee: United States Of America As Represented By The Secretary Of The Air Force
• Inventors: Gnanamgari, Sakunthala, Smith, Jacqueline Dacre
• Primary Examiner(s): BONSHOCK, DENNIS G
• Application Number:
  US11/094,551
• Publication Number:
  US 20050188316A1
• Time in Patent Office: 1,463 Days
• Field of Search: 715/727, 715/728, 715/741, 715/856, 715/754, 345/157, 345/158
• US Class Current: 715/754
• CPC Class Codes: G06F 3/0386 for light pen
• CPC Class Codes: H04L 12/1813 for computer conferences, e.g. chat rooms instant messaging H04L51/04; protocols for multimedia communication H04L65/1101; arrangements for multi-party communication H04L65/403; telephonic conference arrangements H04M3/56; television conference systems H04N7/15

Abstract

This invention provides a method for registering and enrolling multiple users in a interactive information display systems where the untethered multiple users interact with large information displays using laser pointers coordinated with voice commands. A registration program assigns a unique identification to each user that associates a particular user'"'"'s voice and a particular laser pointer pattern chosen by that user, with that particular user. Users may speak voice commands. The system will then perform speech recognition of the user'"'"'s voice command. If the command is recognized, the system performs the speech-recognized command as a window operation.

Claims

1. Method for local registration, enrollment and interaction with multiple-user information display systems at the same location by coordinating voice and optical inputs, comprising the following steps:

said user performing voice logon;

said user performing voiceprint verification;

implementing said verification by identifying an individual user via biometric voice pattern;

said user selecting a unique light pattern to project onto an information display;

said user projecting said unique light pattern onto said information display;

associating said user'"'"'s verified voiceprint with said user'"'"'s projected light pattern, thereby identifying the user, using a specific light pattern, through the user'"'"'s voice;

said association allowing the system to detect which pointer belongs to which user;

determining whether said user'"'"'s command is from said unique light patterns, from said user'"'"'s voice, or from a combination of both,

when accepting a user'"'"'s command from said unique light pattern;

detecting the image of said unique light pattern;

digitizing said detected image;

identifying the pattern of said digitized said detected image;

matching said identified pattern to known templates, outputting template number;

broadcasting said template number and said identified pattern'"'"'s location to all client computers;

associating said template number and said user'"'"'s voiceprint identification;

performing an optically-commanded operation on said user'"'"'s application window; and

returning to said step of determining whether said user'"'"'s command is from said unique light patterns or from said user'"'"'s voice,

when accepting a user'"'"'s command from said user'"'"'s voice;

recognizing said user'"'"'s voice command;

verifying said user'"'"'s voice command from said user'"'"'s voiceprint;

performing a voice-commanded operation on said user'"'"'s application window; and

returning to said step of determining whether said user'"'"'s command is from said unique light patterns or from said user'"'"'s voice,

when accepting a user'"'"'s command as a combination of said unique light patterns and said user'"'"'s voice;

detecting a location of a pointer; and

implementing an action, at the location, via a voice command.