Method and apparatus for identifying speakers and emphasizing selected objects in picture and video messages
First Claim
1. A computer-implemented method for emphasizing selected objects in digital data of at least one of pictures and video that is stored in digital messages, the messages including sender addresses and being stored in a memory system of a digital messaging system for a plurality of users, the method comprising:
- identifying, by a processor, picture regions including at least one of faces and persons in the digital data of the messages on the digital messaging system having the same sender address;
determining, by the processor sender-relevant picture regions in the identified picture regions that represent a sender of the message based on at least one of;
a) a comparison with a reference picture of the sender stored on the memory system;
b) a comparison of speech data in the digital data with reference speech data using at least one of speaker recognition methods, speaker verification methods and speaker identification methods, taking into account picture data and speech data in the message; and
c) a frequency of occurrence of the identified picture regions in the messages that have the same sender address; and
modifying, by the processor, the digital data of the messages so as to emphasize the sender-relevant picture region;
wherein the modification of the digital data is performed such that a recipient of the message can undo the modification via a menu dialog.
1 Assignment
0 Petitions
Accused Products
Abstract
A method for emphasizing selected objects in digital data of at least one of pictures and video that is stored in digital messages, the messages including sender addresses and being stored in a memory system of a digital messaging system for a plurality of users, includes the step of identifying picture regions including at least one of faces and persons in the digital data of the messages on the digital messaging system having the same sender address. Sender-relevant picture regions in the identified picture regions that represent a sender of the message are determined based on at least one of: a) a comparison with a reference picture of the sender stored on the memory system; b) a comparison of speech data in the digital data with reference speech data using at least one of speaker recognition methods, speaker verification methods and speaker identification methods, taking into account picture data and speech data in the message; and c) a frequency of occurrence of the identified picture regions in the messages that have the same sender address. The digital data of the messages is then modified so as to emphasize the sender-relevant picture region.
14 Citations
15 Claims
-
1. A computer-implemented method for emphasizing selected objects in digital data of at least one of pictures and video that is stored in digital messages, the messages including sender addresses and being stored in a memory system of a digital messaging system for a plurality of users, the method comprising:
-
identifying, by a processor, picture regions including at least one of faces and persons in the digital data of the messages on the digital messaging system having the same sender address; determining, by the processor sender-relevant picture regions in the identified picture regions that represent a sender of the message based on at least one of; a) a comparison with a reference picture of the sender stored on the memory system; b) a comparison of speech data in the digital data with reference speech data using at least one of speaker recognition methods, speaker verification methods and speaker identification methods, taking into account picture data and speech data in the message; and c) a frequency of occurrence of the identified picture regions in the messages that have the same sender address; and modifying, by the processor, the digital data of the messages so as to emphasize the sender-relevant picture region; wherein the modification of the digital data is performed such that a recipient of the message can undo the modification via a menu dialog. - View Dependent Claims (2, 3, 4)
-
-
5. A computer-implemented method for emphasizing selected objects in digital data of at least one of pictures and video that is stored in digital messages, the messages including sender addresses and being stored in a memory system of a digital messaging system for a plurality of users, the method comprising:
-
identifying, by a processor, picture regions including at least one of faces and persons in the digital data of the messages on the digital messaging system having the same sender address; determining, by the processor, sender-relevant picture regions in the identified picture regions that represent a sender of the message based on at least one of; a) a comparison with a reference picture of the sender stored on the memory system; b) a comparison of speech data in the digital data with reference speech data using at least one of speaker recognition methods, speaker verification methods and speaker identification methods, taking into account picture data and speech data in the message; and c) a frequency of occurrence of the identified picture regions in the messages that have the same sender address; and modifying, by the processor the digital data of the messages so as to emphasize the sender-relevant picture region; wherein the identified picture regions are used to generate a 3D model. - View Dependent Claims (6)
-
-
7. A computer-implemented method for emphasizing selected objects in digital data of at least one of pictures and video that is stored in digital messages, the messages including sender addresses and being stored in a memory system of a digital messaging system for a plurality of users, the method comprising:
-
identifying, by a processor, picture regions including at least one of faces and persons in the digital data of the messages on the digital messaging system having the same sender address; determining, by the processor, sender-relevant picture regions in the identified picture regions that represent a sender of the message based on at least one of; a) a comparison with a reference picture of the sender stored on the memory system; b) a comparison of speech data in the digital data with reference speech data using at least one of speaker recognition methods, speaker verification methods and speaker identification methods, taking into account picture data and speech data in the message; and c) a frequency of occurrence of the identified picture regions in the messages that have the same sender address; modifying, by the processor, the digital data of the messages so as to emphasize the sender-relevant picture region; storing a sender-relevant 2D picture region of the identified picture regions along with the sender address and parameters that characterize a first perspective of the sender image; transferring the sender-relevant 2D picture region and further sender-relevant picture regions from past messages from the memory system to a module for generating 3D picture data; determining, by the processor, the first perspective of the sender-relevant 2D picture region based on imaged body proportions; searching, by the processor for a second 2D image having parameters that characterize a second perspective in the same horizontal plane so as to provide a 3D impression by evaluating ratios of body proportions; adapting, by the processor, a size and color of the second 2D image; and generating, by the processor, at least one 3D image of the sender by supplementing the sender-relevant 2D picture region with a second picture region including a sender image that is copied from the second 2D image, cut out and replaced by a picture from a different perspective. - View Dependent Claims (8)
-
-
9. A digital messaging system having a plurality of person-related messages stored on a memory system, the messages being provided with sender addresses and at least a portion of the messages including digital data of at least one of pictures and video, the digital messaging system comprising a processor and a non-transitory processor-readable medium having processor-executable instructions stored thereon, the processor-executable instructions comprising a plurality of units, the plurality of units comprising:
-
an identifying unit configured to identify picture regions having at least one of faces and persons in the digital data of messages that have the same sender address; at least one calculation unit configured to determine, from the identified picture regions, sender-relevant picture regions that represent a sender of the message based on at least one of; a) reference pictures that are stored on the memory system, b) a comparison of speech data in the digital data with reference speech data using speaker recognition methods and taking into account speech data in the message, and c) a frequency of occurrence of sender-relevant picture regions in the messages that have the same sender address; a modification unit configured to modify the digital data of the messages that are received by emphasizing the sender-relevant picture regions; and an undoing unit configured to undo the modification by the recipient using a menu dialog. - View Dependent Claims (10, 11, 12, 13, 14, 15)
-
Specification