System and method for coding audio information in images
First Claim
Patent Images
1. A system for embedding audio information in image data corresponding to a whole image for display or print, said image data comprising pixels, the system comprising:
- device for characterizing a sub-area in said whole image as a pixel block comprising a predetermined number of pixels, each pixel block including first and second complementary sets of pixels representing respective first and second image sub-feature sets, a first image sub-feature set including pixels comprising whole image content to be displayed or printed; and
, a second image sub-feature including pixels comprising coded audio information; and
, audio-video transcoding device for associating said second image sub-feature set with units of audio information, said transcoding being performed so that image sub-features in the second set satisfy constraints related to visibility of said whole image.
3 Assignments
0 Petitions
Accused Products
Abstract
A system and method for encoding sound information in image sub-feature sets comprising pixels in a picture or video image. Small differences in intensity of pixels in this image set are not detectable by eyes, but are detectable by scanning devices that measure these intensity differences between closely situated pixels in the sub-feature sets. These encoded numbers are mapped into sound representations allowing for the reproduction of sound.
-
Citations
30 Claims
-
1. A system for embedding audio information in image data corresponding to a whole image for display or print, said image data comprising pixels, the system comprising:
-
device for characterizing a sub-area in said whole image as a pixel block comprising a predetermined number of pixels, each pixel block including first and second complementary sets of pixels representing respective first and second image sub-feature sets, a first image sub-feature set including pixels comprising whole image content to be displayed or printed; and
, a second image sub-feature including pixels comprising coded audio information; and
,audio-video transcoding device for associating said second image sub-feature set with units of audio information, said transcoding being performed so that image sub-features in the second set satisfy constraints related to visibility of said whole image. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18)
means for relating video-sub features to number values, an order of sub-features inducing an order of said number values;
means for constructing a sequence of new number values based on sequences of prior ordered number values; and
,table means having entry indexes according to said sequence of new number values.
-
-
13. The system as claimed in claim 12, wherein said new number values are constructed applying algebraic formulae to sequences of prior number values.
-
14. The system as claimed in claim 12, wherein said means for relating video-sub features to number values comprises:
- means for classifying sub-features according to physical quantities represented by said sub-features, and assigning number values to said classes, said number values representing intensity of said classified physical quantity.
-
15. The system as claimed in claim 14, where physical quantities are one of the following:
- color, waveform type, wavelength, frequency, thickness.
-
16. The system as claimed in claim 1, further comprising:
- a video-image processing device for extracting said audio information that is embedded in said second image sub-feature set.
-
17. The system as claimed in claim 14, wherein said extracting means comprises:
-
means for determining said second image sub-feature set areas of said image comprising said coded audio data, said video sub-features in said second sub-feature set being ordered in a predetermined fashion;
means for determining content of video sub-features in video data as indexes to units of audio information and inducing an order on the units of audio information; and
,means for processing units of audio information in the induced order to produce an audio message from an audio playback device.
-
-
18. The system as claimed in claim 16, wherein said audio information includes conversational mark-up language (CML) data accessible via a speech browser for playback therefrom.
-
19. A method for embedding audio information in image data corresponding to a whole image for display or print, said image data comprising pixels, the method steps comprising:
-
characterizing a sub-area in said whole image as a pixel block comprising a predetermined number of pixels, each pixel block including first and second complementary sets of pixels representing respective first and second image sub-feature sets, a first image sub-feature set including pixels comprising whole image content to be displayed or printed; and
, a second image sub-feature including pixels comprising coded audio information; and
,encoding pixels of said first image sub-feature set with whole image content to be displayed or printed and pixels of said second image sub-feature set with coded audio information, said encoding of said audio data performed such that image sub-features in the second set satisfy constraints related to visibility of said whole image. - View Dependent Claims (20, 21, 22, 23, 24, 25, 26, 27, 28, 29)
transforming audio data into video data; and
,inserting said video data as video sub-features in the second set according to said constraints related to visibility of said whole image.
-
-
24. The method as claimed in claim 22, wherein said encoding step includes the steps of:
-
mapping video sub-features of said second image sub-feature set into indexes of units of audio information, said video sub-features being ordered in a predetermined fashion; and
,inducing an order of units of audio information for providing a global audio information content.
-
-
25. The method as claimed in claim 24, wherein said mapping of video sub-features into indexes of units of audio information includes:
-
relating video-sub features to number values, an order of sub-features inducing an order of said number values; and
constructing a sequence of new number values based on sequences of prior ordered number values; and
,entering said sequence of new number values as indexes to a table look-up device.
-
-
26. The method as claimed in claim 25, wherein said new number values are constructed according to algebraic formulae applied to sequences of prior number values.
-
27. The method as claimed in claim 25, wherein said relating step further comprises the steps of:
-
classifying sub-features according to physical quantities represented by said sub-features; and
,assigning number values to said classes, said number values representing intensity of said classified physical quantity, wherein said classified physical quantities include one selected from the following;
color, waveform type, wavelength, frequency, thickness.
-
-
28. The method as claimed in claim 19, further comprising steps of:
-
scanning an image having audio information embedded in said second image sub-feature set; and
,extracting said embedded audio information via a playback device.
-
-
29. The method as claimed in claim 28, wherein said extracting step comprises:
-
determining said second image sub-feature set areas of said image comprising said coded audio data, said video sub-features in said second sub-feature set being ordered in a predetermined fashion;
determining content of video sub-features in video data as indexes to units of audio information and inducing an order on the units of audio information; and
,processing said units of audio information in the induced order to produce an audio message.
-
-
30. A program storage device readable by a machine, tangibly embodying a program of instructions executable by the machine to perform method steps for embedding audio information in image data corresponding to a whole image for display or print, said image data comprising pixels, the method steps comprising:
-
dividing each of one or more image pixels into first and second complementary sets of pixel components representing respective first and second image sub-feature sets;
encoding pixels of said first image sub-feature set with whole image content to be displayed or printed and pixels of said second image sub-feature set with coded audio information, said encoding of said audio data performed such that image sub-features in the second set satisfy constraints related to visibility of said whole image.
-
Specification