Video user's environment

• US 5,889,506 A
• Filed: 10/25/1996
• Issued: 03/30/1999
• Est. Priority Date: 10/25/1996
• Status: Expired due to Fees

• Current Assignee: Matsushita Electric Industrial Company Limited (Panasonic Holdings Corporation)
• Original Assignee: Matsushita Electric Industrial Company Limited (Panasonic Holdings Corporation)
• Inventors: Ma, Yue, Tomkins, Andrew, Zhou, Jian, Lopresti, Daniel P.
• Primary Examiner(s): Mullen, Thomas
• Assistant Examiner(s): TWEEL JR, JOHN ALEXANDER
• Application Number:
  US08/736,982
• Time in Patent Office: 886 Days
• Field of Search: 345/158, 345/169, 345/173, 345/179, 345/181, 340/825.22, 455/151.1, 455/151.4, 348/734, 348/715, 348/589, 341/176
• US Class Current: 345/158
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: H01H 9/0235 specially adapted for remote control, e.g. of audio or video apparatus
• CPC Class Codes: H03J 9/06 using electromagnetic waves other than radio waves, e.g. light
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/42206 characterized by hardware details
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/47 End-user applications
• CPC Class Codes: H04N 21/472 End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content end-user interfaces for retrieving video data from a database G06F16/739; network services for supporting unicast streaming H04L65/612
• CPC Class Codes: H04N 21/47214 for content reservation or setting reminders; for requesting event notification, e.g. of sport results or stock market stock exchange data over packet-switching network H04L12/1804; push services over packet-switching network H04L12/1859; notification of incoming messages in packet switching networks H04L51/224

Abstract

The user communicates through a digitizing writing surface with the audio/video control apparatus. An on-screen display is generated, providing the user with a user environment in which a wide range of different tasks and functions can be performed. The digitizing writing surface can be incorporated into a hand-held remote control unit and the audio/video control apparatus may likewise be incorporated into existing home entertainment or computer equipment. By tapping on the writing surface a command bar is presented on the screen, allowing the user to select among various functions. Included in these functions is an on-screen programming feature, allowing the user to select programs for viewing or recording by entry of user-drawn annotations or commands via the writing surface.

Claims

1. An audio/video system having an enhanced video user environment, comprising:

an audio/video control apparatus for selectively performing predetermined audio/video control functions in accordance with a user'"'"'s selection, said control apparatus including a port for coupling to a video display apparatus for displaying video material;

a remote control apparatus having a digitizing writing surface for entry of hand-drawn instructions by a user, said remote control apparatus communicating with said audio/video control apparatus;

a processor communicating with at least one of said audio/video control apparatus and said remote control apparatus for controlling operation of said video display apparatus in accordance with said hand-drawn instructions wherein said processor has an associated database of stored annotations and wherein said processor compares said stored annotations with said hand-drawn instructions by peforming an edit distance analysis to account for mismatch between said stored annotations and said hand-drawn instructions.

2. The system of claim 1 wherein said remote control comprises a hand-held push-button remote control structure with said digitizing writing surface incorporated into said structure.

3. The system of claim 1 wherein said remote control communicates with said audio/video control apparatus by infrared signals.

4. The system of claim 1 wherein said remote control communicates bidirectionally with said audio/video control apparatus.

5. The system of claim 1 wherein said remote control includes a microphone for input of speech instructions.

6. The system of claim 1 wherein said digitizing writing surface is responsive to a hand-held stylus.

7. The system of claim 1 wherein said digitizing writing surface is response to the user'"'"'s fingertip.

8. The system of claim 1 wherein said audio/video control apparatus includes at least one control port for coupling to at least one component of audio/video equipment and wherein said audio/video control apparatus includes a control module for issuing control signals through said control port to said component of audio/video equipment.

9. The system of claim 8 wherein said component of audio/video equipment is a component selected from the group consisting of television, video cassette recorder (VCR), audio tape recorder, audio disc player, video disc player, audio amplifier, surround sound processor, video signal processor, camcorder, video telephone, cable television signal selector, satellite antenna controller, computer, CD-ROM player, photo CD player, video game player and information network access device.

10. The system of claim 1 wherein said processor is disposed in said audio/video control apparatus.

11. The system of claim 1 wherein said processor is attached to said audio/video control apparatus.

12. The system of claim 1 wherein said processor is disposed in said remote control apparatus.

13. The system of claim 1 wherein said processor comprises a multiprocessor system having a first portion disposed in said audio/video control apparatus and having a second portion disposed in said remote control.

14. The system of claim 1 wherein said audio/video control apparatus includes an integrated television tuner for tuning a user selected channel carrying program information and providing a video signal representing said program information to said video display apparatus.

15. The system of claim 1 wherein said video display apparatus is a television and wherein said audio/video control apparatus outputs an NTSC video signal through said port.

16. The system of claim 1 wherein said audio/video control apparatus is incorporated into a component of audio/video equipment.

17. The system of claim 16 wherein said component of audio/video equipment is a component selected from the group consisting of television, video cassette recorder (VCR), audio tape recorder, audio disc player, video disc player, audio amplifier, surround sound processor, video signal processor, camcorder, video telephone, cable television signal selector, satellite antenna controller, computer, CD-ROM player, photo CD player, video game player and information network access device.

18. The system of claim 1 wherein said processor includes a speech recognizer module.

19. The system of claim 1 wherein said processor generates at least one menu of user selectable system control options and said audio/video control apparatus issues a signal through said port to display said menu on said video display apparatus coupled to said port.

20. The system of claim 1 wherein said processor is coupled to memory means for storing user input.

21. The system of claim 20 wherein said user input comprises handwritten annotations drawn on said digitizing writing surface.

22. The system of claim 21 including an on-demand video interface whereby said handwritten annotations are used to recall a prerecorded entertainment program for presentation on said video display apparatus.

23. The system of claim 21 wherein said handwritten annotations are translated into a known computer character set for subsequent processing.

24. An audio/video system having an enhanced video user environment, comprising:

an audio/video control apparatus for selectively performing predetermined audio/video control functions in accordance with a user'"'"'s selection, said control apparatus including a port for coupling to a video display apparatus for displaying video material;

a remote control apparatus for communicating with said audio/video control apparatus, said remote control apparatus having a digitizing writing display surface for entry of hand-drawn instructions by a user and for displaying information to said user;

a multiprocessor system having a first portion disposed in said audio/video control apparatus and having a second portion disposed in said remote control, said multiprocessor system communicating between said audio/video control apparatus and said remote control apparatus for controlling operation of said video display apparatus in accordance with said hand-drawn instructions wherein said multiprocessor system has an associated database of stored annotations and wherein said multiprocessor system compares said stored annotations with said hand-drawn instructions by peforming an edit distance analysis to account for mismatch between said stored annotations and said hand-drawn instructions.

25. The system of claim 24 wherein at least one processor of said multiprocessor system generates at least one menu of user-selectable system control operations and said audio/video control apparatus produces a signal through said port to display said menu on said video display apparatus coupled to said port.

26. The system of claim 24 wherein said remote control comprises a hand-held push-button remote control structure with said digitizing writing surface incorporated into said structure.

27. The system of claim 24 wherein said remote control communicates with said audio/video control apparatus by infrared signals.

28. The system of claim 24 wherein said remote control communicates birdirectionally with said audio/video control apparatus.

29. The system of claim 24 wherein said remote control includes a microphone for input of speech instructions.

30. The system of claim 24 wherein said digitizing writing surface is responsive to a hand-held stylus.

31. The system of claim 24 wherein said digitizing writing surface is responsive to the user'"'"'s fingertip.