Image networks for mobile communication

• US 8,483,754 B2
• Filed: 01/30/2004
• Issued: 07/09/2013
• Est. Priority Date: 01/30/2004
• Status: Expired due to Term

• Current Assignee: Viewlogic Wireless LLC
• Original Assignee: IP Holdings Incorporated (IP Holdings LLC)
• Inventors: Rao, Sunil K., Rao, Raman K.
• Primary Examiner(s): Pan, Yuwen
• Assistant Examiner(s): AYOTUNDE, AYODEJI O
• Application Number:
  US10/769,621
• Publication Number:
  US 20080146272A1
• Time in Patent Office: 3,448 Days
• Field of Search: 455/556.1, 455/424, 455/425, 455/456.5, 455/456.1, 455/561, 455/550.1, 455/575.1, 455/403, 455/556.2, 455/557, 455/414.4, 455/422.1, 455/426.2, 455/423.3, 455/517, 455/344, 455/566, 455/73, 455/74, 455/456.6, 455/410, 455/414.1, 379/93, 379/23, 379/354, 340/990, 340/995.12, 340/995.1, 340/995.18, 340/995.26, 348/211.99, 348/231.8, 348/362, 348/375, 348/374, 348/14.02, 348/14.11, 348/14.13, 348/64, 348/333.05
• US Class Current: 455/556.1
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/953 Querying, e.g. by the use of web search engines
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 3/023 Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
• CPC Class Codes: G06F 40/40 Processing or translation of natural language natural language analysis G06F40/20; semantic analysis G06F40/30
• CPC Class Codes: G06Q 30/06 Buying, selling or leasing transactions
• CPC Class Codes: G06Q 30/0611 Request for offers or quotes
• CPC Class Codes: G06Q 30/0625 Directed, with specific intent or strategy
• CPC Class Codes: G06Q 30/0641 Shopping interfaces
• CPC Class Codes: G06Q 30/0643 Graphical representation of items or shoppers
• CPC Class Codes: G06Q 50/12 Hotels or restaurants
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 40/30 Writer recognition; Reading and verifying signatures
• CPC Class Codes: G07C 13/00 Voting apparatus
• CPC Class Codes: G08C 17/02 using a radio link
• CPC Class Codes: G09B 19/0092 Nutrition
• CPC Class Codes: H04B 1/0057 using diplexing or multiplexing filters for selecting the desired band
• CPC Class Codes: H04B 10/11 Arrangements specific to free-space transmission, i.e. transmission through air or vacuum
• CPC Class Codes: H04B 7/04 using two or more spaced independent antennas
• CPC Class Codes: H04B 7/0404 the mobile station comprising multiple antennas, e.g. to provide uplink diversity
• CPC Class Codes: H04B 7/0413 : MIMO systems
• CPC Class Codes: H04B 7/15 : Active relay systems
• CPC Class Codes: H04L 12/1827 : Network arrangements for conference optimisation or adaptation
• CPC Class Codes: H04L 12/1831 : Tracking arrangements for later retrieval, e.g. recording contents, participants activities or behavior, network status
• CPC Class Codes: H04L 12/2867 : Physical combinations
• CPC Class Codes: H04L 45/00 : Routing or path finding of packets in data switching networks routing or path finding in wireless networks H04W40/00
• CPC Class Codes: H04L 5/08 : each combination of signals in different channels being represented by a fixed frequency
• CPC Class Codes: H04L 63/083 : using passwords cryptographic mechanisms or cryptographic arrangements for entity authentication using a predetermined code H04L9/3226
• CPC Class Codes: H04L 63/0861 : using biometrical features, e.g. fingerprint, retina-scan cryptographic mechanisms or cryptographic arrangements for entity authentication using biological data H04L9/3231
• CPC Class Codes: H04L 63/12 : Applying verification of the received information cryptographic mechanisms or cryptographic arrangements for data integrity or data verification H04L9/32
• CPC Class Codes: H04L 67/06 : specially adapted for file transfer, e.g. file transfer protocol [FTP]
• CPC Class Codes: H04L 67/1097 : for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 69/16 : Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
• CPC Class Codes: H04M 1/0202 : Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets constructional features of telephone transmitters or receivers, e.g. of speakers or microphones H04M1/03
• CPC Class Codes: H04M 1/026 : Details of the structure or mounting of specific components
• CPC Class Codes: H04M 1/724 : User interfaces specially adapted for cordless or mobile telephones
• CPC Class Codes: H04M 1/72403 : with means for local support of applications that increase the functionality
• CPC Class Codes: H04M 1/72409 : by interfacing with external accessories hands-free H04M1/60
• CPC Class Codes: H04M 1/72412 : using two-way short-range wireless interfaces
• CPC Class Codes: H04M 1/72436 : for text messaging, e.g. short messaging services [SMS] or e-mails
• CPC Class Codes: H04M 1/72463 : to restrict the functionality of the device
• CPC Class Codes: H04M 1/72466 : with selection means, e.g. keys, having functions defined by the mode or the status of the device
• CPC Class Codes: H04M 2250/58 : including a multilanguage function
• CPC Class Codes: H04M 2250/74 : with voice recognition means voice activated dialling H04M1/271; voice recognition algorithms G10L15/00
• CPC Class Codes: H04N 2007/145 : Handheld terminals
• CPC Class Codes: H04N 21/2353 : specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata
• CPC Class Codes: H04N 21/41407 : embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/43637 : involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11] arrangements for wireless networking or broadcasting of information in indoor or near-field type systems H04B10/114
• CPC Class Codes: H04N 21/6131 : involving transmission via a mobile phone network wireless downlink channel access H04W74/006
• CPC Class Codes: H04N 7/14 : Systems for two-way working H04N7/12, H04N7/173 take precedence
• CPC Class Codes: H04Q 11/0005 : Switch and router aspects
• CPC Class Codes: H04Q 11/0062 : Network aspects
• CPC Class Codes: H04W 12/069 : using certificates or pre-shared keys
• CPC Class Codes: H04W 12/65 : Environment-dependent, e.g. using captured environmental data
• CPC Class Codes: H04W 12/68 : Gesture-dependent or behaviour-dependent
• CPC Class Codes: H04W 16/26 : Cell enhancers or enhancement, e.g. for tunnels, building shadow
• CPC Class Codes: H04W 36/22 : for handling the traffic
• CPC Class Codes: H04W 4/00 : Services specially adapted for wireless communication networks; Facilities therefor
• CPC Class Codes: H04W 4/16 : Communication-related supplementary services, e.g. call-transfer or call-hold
• CPC Class Codes: H04W 40/02 : Communication route or path selection, e.g. power-based or shortest path routing
• CPC Class Codes: H04W 80/04 : Network layer protocols, e.g. mobile IP [Internet Protocol]
• CPC Class Codes: H04W 84/04 : Large scale networks; Deep hierarchical networks
• CPC Class Codes: H04W 84/12 : WLAN [Wireless Local Area Networks]
• CPC Class Codes: H04W 88/06 : adapted for operation in multiple networks or having at least two operational modes, e.g. multi-mode terminals
• CPC Class Codes: H04W 88/10 : adapted for operation in multiple networks, e.g. multi-mode access points
• CPC Class Codes: H04W 92/02 : Inter-networking arrangements

Abstract

A mobile communication system based on images, enabling communication between a plurality of mobile devices and servers, wherein the images have associated additional properties in the nature of voice, audio, data and other information. The system further enabling the formation of one or more image networks wherein the images are stored, organized, connected and linked to each other by one or more methods inclusive of one to one connection between images, a hierarchical connection between images and or other methods of connection between images to facilitate efficient image based communication between mobile devices, stationary devices and servers based on the mobile device identification, mobile device specific profiles and user specific profiles. The imaged base network system further having the ability to learn and form intelligent association between objects, people and other entities; between images and the associated data relating to both animate and inanimate entities for intelligent image based communication in a network.

Claims

1. A mobile communications system for image networks comprising:

a mobile device configured to communicate via at least one communications network, the mobile device further configurable to perform one or more of computing functions or voice communication functions, the mobile device configured with a display, and configurable to acquire and process a plurality of images, wherein the plurality of images comprise still images and video images, and wherein at least one image of the plurality of images is displayed on the mobile device display, and wherein a function is configured to automatically display information which corresponds to an object represented in the at least one image, wherein the object is a physical object separate from the mobile device, wherein the image is linked through a relationship to related data defined by a user or past user behavior stored on a server or the mobile device, wherein the mobile device acquires the images via a camera or image sensor in real time; and

,

at least one network server the server configurable to store the plurality of images the server configured to receive an image from the mobile device, the server configured to associate each received image with a plurality of data comprising one or more of text data, voice data, mobile device profile data, user profile data, or location data.

2. The mobile communications system of claim 1 further comprising a executable function, wherein the executable function is displayed on the mobile device display, wherein the executable function comprises a function selected from the group consisting essentially of an application that renders at least one image of the plurality of images, and a routing process that transmits at least one image of the plurality of images through the communications network to a different mobile device or network element.

3. The mobile communications system of claim 1 wherein an executable function comprises a command sequence that is transmitted over a second network of the at least one communication network and that causes a physical change in the physical object corresponding to an object represented in the at least one image of the plurality of images.

4. The mobile communications system of claim 1 wherein each image of the plurality of images is encrypted with a security level and a compression format.

5. The mobile communications system of claim 1 wherein the plurality of images comprises a hierarchically organized set of images that are linked through the defined relationship to form the image network.

6. The mobile communications system of claim 5 wherein each image of the hierarchically organized set of images is encrypted with a respective security level, the security level configured to define a class of users privileged to access an associated image.

7. The mobile communications system of claim 5 wherein the defined relationship is learned by a software process based on past user behavior patterns and potential user behavior patterns.

8. The mobile communications system of claim 2 wherein the server is configurable to analyze the object recognized within the at least one image and determine the embedded executable function from a plurality of possible embedded functions associated with the at least one image to automatically actuate the process.

9. The mobile communications system of claim 8 wherein the object within the at least one image includes a user of the system, and further wherein the server is configurable to correlate the at least one image with the user profile data for the user of the system.

10. The mobile communications system of claim 2 further comprising:

a user interface coupled to the at least one server, and configurable to enable a user to interact with the at least one image, including launching an application to perform a function that physically affects the object represented in the at least one image.

11. The mobile communications system of claim 10 wherein the object is physically affected through a network connected intelligent device that is proximate the object.

12. The mobile communications system of claim 10 wherein the user interface comprises a touch screen display device of a client computer coupled to the at least one server over a third network of the at least one communications network.

13. The mobile communications system of claim 2 further comprising an image switch and router component configured to perform a pattern recognition process on at least one object in the at least one image and transmit the at least one image of the plurality of images through the communications network to a different mobile device of network element.

14. The mobile communications system of claim 13 wherein the embedded executable function includes a function to retrieve a corresponding image from a data source coupled to the at least one communications network, wherein the corresponding image contains one of the at least one object and an object related to the at least one object through a defined relationship.

30. The mobile communications system of claim 1, wherein the mobile device includes a touch screen display, wherein at least a portion or subset of an image on the screen can be touched to launch one or more applications, control functions or actuation functions related to other intelligent devices.

31. The mobile communications system of claim 1, wherein the image network is propagated across a network of users based upon a profile of the mobile device user and one or more social, professional, personal or other network of the mobile device user is updated.

15. A mobile communications system for image networks comprising:

a mobile device having a communications component to process voice or digital data and communicate over at least one communications network, and an image acquisition component to acquire and process a plurality of images, wherein each image is associated with multimedia information including image data, associated text data, audio data, or security information, and a function that automatically displays information which corresponds to an object represented in the image entity, wherein the object is a physical object separate from the mobile device, wherein the mobile device acquires the images via a camera or image sensor in real time; and

a network server, the server configurable to store the plurality of images, the server configured to receive an image from the mobile device, the server configured to associate each received image with mobile device profile data, user profile data, or location data, the server further configurable to link an image through a relationship to related data defined by a user or past user behavior stored on a server or the mobile device.

16. The mobile communications system of claim 15 wherein sub images of the image network comprise a plurality of images organized by a defined relationship based on the presence of an object represented in at least of the first image or the one or more sub images.

17. The mobile communications system of claim 16 wherein the defined relationship is provided by a process resident on the mobile device and is stored in a look-up table to enable dynamic look-up by a routing process that transmits the image network through the at least one communications network to one or more other network entities.

18. The mobile communications system of claim 16 wherein the defined relationship is provided by a process resident on the server and is stored in a look-up table to enable dynamic look-up by a routing process that transmits the image network through the at least one communications network to one or more other network entities.

19. The mobile communications system of claim 16 wherein the security information for each image of the image network defines user access privileges, and wherein the hierarchy provided by the defined relationship associates a different security level to at least some images of the image network.

20. The mobile communications system of claim 15 wherein the executable function comprises a function selected from the group consisting essentially of:

an application that renders at least one image of the plurality of images; and

a routing process that transmits at least one image of the plurality of images through the communications network to a different mobile device or network element.

21. The mobile communications system of claim 15 wherein the executable function comprises a command sequence that is transmitted over a second network of the at least one communications network and that causes a physical change in an object represented by at least one image of the plurality of images.

22. The mobile communications system of claim 21 wherein the server comprises an image recognition component to recognize an object in the at least one image and execute the embedded executable function to automatically actuate the process, and an image switch and router component configured to perform a pattern recognition process on at least one object in the at least one image and transmit the at least one image of the image network through the communications network to a different network element.

23. The mobile communications system of claim 21 wherein the multimedia information of the image network and the hierarchical relationship forming the image network are processed through a software process and associated databases resident on one of the mobile device and the server computer.

24. The mobile communications system of claim 15 wherein the image acquisition component comprises a digital camera resident within the mobile device, and wherein the plurality of image data comprises at least one of still images and video images.

25. A mobile communications system for image networks comprising:

a mobile device having a communications component to process voice or digital data and communicate over at least one communications network, and an image acquisition component to acquire and process a plurality of images, each image is associated with multimedia information including image data, associated text data, or audio data, or security information, and a function that automatically displays information which corresponds to an object represented in the image entity, wherein the object is a physical object separate from the mobile device, and wherein the image is linked through a relationship to related data defined by a user or past user behavior stored on a server or the mobile device, wherein the mobile device acquires the images via a camera or image sensor in real time; and

a network server wherein the server is configured to store the plurality of images the server configured to receive an image from the mobile device, and the server further having an image switch and router component configured to perform a pattern recognition process on at least one object in the at least one image and transmit the at least one image of the image network through the communications network to a different network element.

26. The mobile communications system of claim 25 wherein the server is further configured to link the plurality of images with one another according to a hierarchical relationship of a first image and one or more sub images to form the image network, and wherein the sub images of the image network comprise a plurality of images organized by a defined relationship based on the presence of an object represented in at least of the first image or the one or more sub images.

27. The mobile communications system of claim 26 wherein the defined relationship is provided by a process resident on either of the server or the mobile device and is stored in a look-up table to enable dynamic look-up by the image switch and router component that transmits the image network through the at least one communications network to one or more other network entities.

28. The mobile communications system of claim 27 wherein the executable function comprises a function selected from the group consisting essentially of:

an application that renders at least one image of the plurality of images; and

a routing process that transmits at least one image of the plurality of images through the communications network to a different mobile device or network element.

29. The mobile communications system of claim 27 wherein the executable function comprises a command sequence that is transmitted over a second network of the at least one communication network and that causes a physical change in an object represented by at least one image of the plurality of images.

32. A mobile communications system for images comprising:

a mobile device comprising a processor, camera, and wireless transmit and receive component;

wherein the mobile device is configured to communicate via at least one wireless communications network;

wherein the mobile device acquires an image using the camera or an image sensor;

wherein the image is displayed on the screen of the mobile device;

wherein an object represented in the image is identified by the mobile device;

wherein the object is recognized using an image recognition program;

wherein the recognized object corresponds to a physical object separate from the mobile device; and

wherein the mobile device displays text related to the recognized object on the display of the mobile device.

33. The system of claim 32, wherein the text related to the recognized object is received from a server.

34. The system of claim 32, wherein the image recognition is performed on a server.

35. The system of claim 32, wherein the image recognition is performed by a processor on the mobile device.

36. The system of claim 32, wherein the text displayed on the mobile device display is dynamically generated by a server in response to the acquired image and identified object.

37. The system of claim 32, wherein the mobile device executes a function in response to the selection of a specified image area corresponding to the identified object and wherein the function controls the physical object.

38. The system of claim 37, wherein the control function comprises an on/off command.

39. The system of claim 37, wherein the recognized object is a garage door and wherein the control function controls a physical garage door.

40. The system of claim 37, wherein the pattern matching software is executed to identify objects in the acquired image on a server.

41. A system for interaction with virtual and physical items using a mobile device comprising:

a mobile device further comprising a display and a camera, wherein the mobile device acquires an image using the camera, wherein the mobile device presents the images on the display of the device, wherein the function sends to an Internet server the acquired image, wherein the server performs image recognition on the image, wherein the server sends to the mobile device information related to the image, wherein the mobile device displays the information and the acquired image on the display of the mobile device.

42. The system of claim 41, wherein a user may touch a selected image area, wherein the mobile device executes a function in response to the selection of the specified image area.

43. A mobile image recognition system comprising:

a mobile device, wherein the mobile device has a touch enabled display and processor;

a display area on the mobile device;

wherein the mobile device acquires images via camera and performs pattern recognition using the processor on the images to create a function, wherein the mobile device sends the images to a server;

a server, wherein the server receives the images from a mobile device, wherein the server performs pattern recognition of said images; and

an interface on the mobile device which interacts with the display area through light, wherein the act of pointing at an image on the display area launches an application on the mobile device.