METHOD AND COMMUNICATION SYSTEM FOR CONTINUOUSLY RECORDING SOUNDING INFORMATION

• US 20080057911A1
• Filed: 08/31/2007
• Published: 03/06/2008
• Est. Priority Date: 08/31/2006
• Status: Active Grant

• Current Assignee: InterDigital CE Patent Holdings SAS (InterDigital, Inc.)
• Original Assignee: Swisscom Mobile AG (Government of Switzerland)
• Inventors: Lauper, Eric
• Granted Patent: US 8,571,529 B2
• Time in Patent Office: Days
• US Class Current: 455/412.1
• CPC Class Codes: G06F 16/64 Browsing; Visualisation therefor generation of a list or set of audio data G06F16/638
• CPC Class Codes: G06F 16/68 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/683 using metadata automatically derived from the content
• CPC Class Codes: H04L 67/00 Network arrangements or protocols for supporting network services or applications user-to-user messaging H04L51/00; network arrangements, protocols or services for supporting real-time applications in data packet communications networks H04L65/00
• CPC Class Codes: H04M 1/72451 according to schedules, e.g. using calendar applications
• CPC Class Codes: H04M 1/72457 according to geographic location
• CPC Class Codes: H04M 2250/12 including a sensor for measuring a physical value, e.g. temperature or motion
• CPC Class Codes: H04M 2250/52 including functional features of a camera

Abstract

A method is disclosed for continuously recording surrounding information by a mobile device (11). The mobile device (11) of a user (1) continuously records surrounding information such as surrounding noises or surrounding image data and at least one file (7) is generated from the recording and sent to a remote server (4). Said file or a file derived therefrom (7) is automatically subdivided and/or indexed automatically depending on the contents of the file (7) and/or on metadata (M₁, M₂, M₃) generated from external events (e₁, e₂, e₃) in relation to the mobile device (11) and/or by the user (1). Advantageously, the user (1) searches the subdivided and/or indexed file (7) so that he can easily retrieve the recorded information.

Claims

1. Method for continuously recording surrounding information by a mobile device with the following method steps:

(a) the mobile device of a user continuously recording surrounding information and sending resulting data to a remote server,

(b) the data are classified and/or indexed automatically depending on the content of the data and/or on metadata that are generated from external events in relation to the mobile device and/or by the user,

(c) the classified and/or indexed data are searched.

2. The method of claim 1, wherein, from the recorded information, one or a plurality of files are generated in the mobile device or in the remote server.

3. The method of claim 2, further comprising the step of associating the metadata temporally with the file 7 generated or derived therefrom, according to the external events or this file is subdivided through the metadata in such a manner that the file can be searched according to the associated metadata.

4. The method of claim 2, wherein the mobile device is a mobile telephone connected to a mobile radio network and all recorded surrounding information is sent to a remote server and said file is stored there together with the metadata in a memory area allocated to the user.

5. The method of claim 1, wherein the external events are recorded automatically, are preprogrammed and/or are set individually by the user.

6. The method of claim 1, wherein the content of the data and the external events include the location or changes of the location of the mobile device, features in the room, data, time, events within the mobile device or data from sensors connected to the mobile device, predetermined noises within the file that are to be detected in the vicinity and/or recorded conversations or interlocutors of the user.

7. The method of claim 1, wherein the mobile device is in a sleep mode if no useful wanted signals is received.

8. The method of claim 1, wherein the mobile device records, converts digitally and analyzes all data and if these are not recognized as meaningful, they are not transmitted to the remote server.

9. The method of claim 1, wherein the mobile device records all data and if they are recognized as being meaningless before the digital conversion, the device switches to a sleep mode.

10. The method of claim 1, wherein a sleep mode of the recording function is independent of the sleep mode of the mobile device.

11. The method of claim 1, wherein switching to a sleep mode or awakening from the sleep mode can also be initiated automatically by a noise or an image, or automatically depending on said events, or by the user, or automatically periodically or by the remote server.

12. The method of claim 1, wherein events can also be transmitted by the mobile device to the remote server when the mobile device is in sleep mode.

13. The method of claim 1, further comprising the step of local buffering of received signals or file parts in the memory of the mobile device before transmission to the remote server takes place.

14. The method of claim 1, wherein a voice recognition system converts the recorded data into a text file and the metadata are associated temporally to the generated text file according to the external events.

15. The method of claim 1, wherein a voice recognition system converts the recorded data into a text file and recognizes different conversation parts of a conversation and the participation of at least one interlocutor is used as metadata.

16. The method of claim 14, wherein the used voice recognition system uses user-dependent language models.

17. The method of claim 14, wherein new language models are established through new conversations for the individual interlocutors.

18. The method of claim 14, wherein the voice recognition occurs locally in the mobile device or in the remote server.

19. The method of claim 14, wherein the recorded data and/or the text file are stored.

20. The method of claim 1, wherein the audio, video or text data transmitted to the remote server are signed by means of a certificate by the mobile device in order to guarantee the authenticity of the data.

21. The method of claim 1, wherein the user adds further data to said recorded data.

22. The method of claim 1, wherein the recorded data are marked by the user at a later stage after the recording with metadata.

23. The method of claim 1, wherein different persons have access rights to different parts of the data that are marked with certain metadata.

24. The method of claim 1, wherein the user has access to the recorded data from his mobile device, over an Internet site or over a calendar program and searches these data according to contents or according to metadata.

25. The method of claim 1, wherein the search is performed over a voice command.

26. The method of claim 1, wherein a program or applet is provided on the mobile device that performs the continuous recording and the processing of the recorded data.

27. The method of claim 1, wherein a service provider offers a user of a mobile device such a method and bills a corresponding service to the user.

28. The method of claim 1, wherein a video recording is made permanently by the mobile device or by a device connected to the mobile device and the data are also sent to the remote server.

29. The method of claim 1, wherein the subdividing and/or indexing of the recorded data occurs through conversion into a markup language file, which performs a subdivision in different files, where each file is connected with metadata or by adding a marked index in an audio file.

30. The method of claim 1, wherein the search results are reproduced as text or as synthetic voice.

31. Communication system including:

(a) a mobile device for continuously recording surrounding information and sending resulting data to a remote server,

(b) means for automatically classifying and/or indexing the data depending on the content of the data and/or on metadata that are generated from external events in relation to the mobile device and/or by the user, and

(c) means for searching the classified and/or indexed data.

32. The communication system of claim 31, characterized by means in the mobile device or in the remote server for generating from the recorded data one or a plurality of files.

33. The communication system of claim 32, characterized by means for temporally associating the metadata with the file 7 generated or derived therefrom, according to the external events or for subdividing this file through the metadata in such a manner that the file can be searched according to the associated metadata.

34. The communication system of claim 31, wherein the mobile device is a mobile telephone connected to a mobile radio network and a remote server is connected to the mobile radio network and said data can be stored in the remote server together with the metadata in a memory area allocated to the user.

35. The communication system of claim 31, characterized by a voice recognition system that converts the recorded data into a text file, means being provided for temporally associating the metadata with the generated text file according to the external event.

36. The communication system of claim 31, wherein the used voice recognition system uses user-dependent language models.

37. The communication system of claim 31, characterized by access rights for different people to different portions of the data that are marked with certain metadata.

38. Mobile device, characterized by:

means for continuously recording surrounding information and means for sending resulting data to a remote server and

means for switching the mobile device into a sleep mode, where no surrounding information is recorded, when no useful wanted signal is received in the surrounding data.