Video processor system and audio processor system

• US 5,590,252 A
• Filed: 04/28/1993
• Issued: 12/31/1996
• Est. Priority Date: 04/29/1992
• Status: Expired due to Term

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Information Systems Research Australia Pty Limited (Canon Inc.), Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Silverbrook, Kia
• Primary Examiner(s): Nguyen, Phu K.
• Application Number:
  US08/053,569
• Time in Patent Office: 1,343 Days
• Field of Search: 345/115, 345/116, 345/153, 345/150, 395/140, 395/141, 395/142, 395/143, 395/162, 395/133
• US Class Current: 715/203
• CPC Class Codes: G06T 15/50 Lighting effects
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: H04N 19/27 involving both synthetic and natural picture components, e.g. synthetic natural hybrid coding [SNHC]
• CPC Class Codes: H04N 5/262 Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects

Abstract

An inexpensive audio and video processing system (1) for combining animated object images with live video (28) with the addition of a combined audio capability (12) is disclosed. The system (1) includes a video processor system comprising a real-time object (RTO) processor (10) for rendering object-based graphic images, a video input means (30,27) for receiving a first video signal (28), at least one colour mixing and generation device (13) arranged to combine said first video signal (28) with image data (24) rendered from the RTO processor (10) to provide a second video signal and a video output means (38) for outputing same.

Claims

1. A video processor comprising:

a real-time object (RTO) processor for processing object-based graphic image data describing an object-based graphic image to form pixel-based image data representing the object-based graphic image, said RTO processor incorporating memory means for intermediate storage of only said object-based graphic image data and forming pixel-based image data directly from said object-based graphic image data in real-time without using a pixel-based image data storage means, thereby permitting real-time colour mixing and generation of the pixel-based image data with a first video signal so as to form a second video signal;

a video input means for receiving said first video signal;

at least one colour mixing and generation device arranged to combine said first video signal with said pixel-based image data formed by said RTO processor to provide said second video signal; and

a video output means for outputting said second video signal.

2. A video processor system as claimed in claim 1 further comprising a host processor means for composing and editing said object-based graphic image data.

3. A video processor system as claimed in claim 2 further comprising a user controllable input means for selecting and editing said object-based graphic image data to create edited image data.

4. A video processor system as claimed in claim 3 wherein said input means further includes a plurality of memory storage housing means adapted to receive detachable memory storage devices containing said graphic object image data.

5. A video processor system as claimed in claim 4 wherein said detachable memory storage devices are in the form of non-volatile memory cards.

6. A video processor system as claimed in claim 4 wherein said memory storage devices include system code used in the operation of said video processor system.

7. A video processor system as claimed in claim 4 wherein said input means further comprises detection means for determination of the presence or absence of said detachable memory storage device.

8. A video processor system as claimed in claim 1 wherein said object-based graphic image data describes graphic objects using quadratic polynomial fragments.

9. A video processor system as claimed in claim 1 wherein said RTO processor further comprises

edge determination means adapted to determine a current line object edge position data and

a pixel colour determination means adapted to receive said current line object edge position data from said edge determination means and to produce a current pixel colour value for each displayable pixel of said object-based graphic image.

10. A video processor system as claimed in claim 9 wherein said current line edge position data includes object colour information and object transparency information.

11. A video processor system as claimed in claim 9 wherein said pixel colour determination means outputs to said colour mixing and generation device, said device comprising a colour mixing and generation means for each colour component of said second video signal.

12. A video processor system as claimed in claim 11 wherein said colour mixing and generation device is connected to said host processor and setup and control information of said device is alterable by said host processor.

13. A video processor system as claimed in claim 1 further comprising a control means with associated memory means for generating audio output signals in concert with said second video signal.

14. A video processor system as claimed in claim 13 wherein said audio output signals are generated in substantial synchronism with visual events depicted within said second video signal.

15. A video processor system as claimed in claim 13 further comprising a peripheral processor means adapted to operate said control means.

16. A video processor system as claimed in claim 13 wherein said memory means is a first-in first-out queue.

17. A video processor system comprising:

a host processor for compositing a list of graphic objects including graphic object-based data that together form an animated image;

a real-time object processor for receiving said list, said real-time object processor including a storage area for intermediate storage of said graphic object-based data and forming therefrom object level data in pixel-based rasterized format in real-time without the use of a pixel-based memory, thereby permitting real-time colour mixing and generation of the object level data with a first video signal so as to form a second video signal;

video input means for receiving a video input signal of a video image;

colouring means for receiving said object level data in real-time as said object level data is formed by said real-time object processor, for assigning image colour thereto and for combining same with said video input signal to produce a combined signal of said animated image and said video image; and

video output means for outputting said combined signal in a video format for rasterized display.

18. A system as claimed in claim 17 further comprising memory means in which are stored said graphic objects, said memory means being accessible by said host processor for generation of said list.

19. A system as claimed in claim 18 wherein said memory means comprises user alterable memory devices connectable to said system by complementary connecting ports.

20. A system as claimed in claim 17 wherein said list comprises a list of individual curve portions for each said object, said real-time processor manipulating each said portion to produce said animated image.

21. A system as claimed in claim 20 wherein said portions describe curves by means of quadratic polynomial data that can be calculated by said real-time object processor to produce said animated image at real-time data rates suitable for real-time rasterised display.

22. A system as claimed in claim 17 wherein said video input means decodes said video input signal into a plurality of colour components which are input to said colouring means in which each said component is separately combined with said object level data to provide a pixel value for a corresponding combined colour component, said video output means encoding the corresponding combined colour components to provide said video output signal.

23. A system as claimed in claim 22 wherein colouring means comprises a plurality of colour generation and mixing (CGM) devices including at least one said device for each said colour component.

24. A system as claimed in claim 23 wherein said colouring means comprises a further CGM device which receives only said object level data and outputs to the other CGM devices a mixing level that controls the mixing of said video and animated images.

25. A system as claimed in claim 17 further comprising sound means for generating audio signals in substantial synchronism with selected portions of said video output signal.

26. A system as claimed in claim 25 wherein said sound means comprises an audio input means for receiving an audio input signal that can be processed in a sound effects generator which outputs said audio output signal.

27. A video processor comprising:

a real-time object processor (RTO) for processing object-based graphic image data describing an object-based graphic image to form pixel-based image data, said RTO processor processing the object-based graphic image data by receiving object outlines of an image which include object fragments intended for rasterized display, by sorting the object fragments into a rasterization sequence corresponding to a scan line, by storing a rasterization sequence, by reading out in real-time a previously stored rasterization sequence, by calculating object edges, each having a priority level in each display line, and by assigning pixel data values within each display line based on the priority level;

a video input for receiving a first video signal;

at least one colour mixing and generation device arranged to combine the first video signal with the pixel-based image data formed by the RTO processor to provide a second video signal; and

a video output means for outputting the second video signal.