Location-based communication method and system

• US 8,185,596 B2
• Filed: 02/22/2010
• Issued: 05/22/2012
• Est. Priority Date: 02/22/2010
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Toledano, Eyal, Bregman-Amitai, Orna, Shaham, Amir, Oks, Eduard
• Primary Examiner(s): Hamza, Faruk
• Application Number:
  US12/709,612
• Publication Number:
  US 20110208817A1
• Time in Patent Office: 820 Days
• Field of Search: 709204-207, 709217-219
• US Class Current: 709/206
• CPC Class Codes: H04W 4/026 using orientation information, e.g. compass
• CPC Class Codes: H04W 4/029 Location-based management or tracking services
• CPC Class Codes: H04W 4/12 Messaging; Mailboxes; Announcements
• CPC Class Codes: H04W 4/33 for indoor environments, e.g. buildings
• CPC Class Codes: H04W 4/80 Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication

Abstract

A method for providing location-based messages comprises locating a suitable placeholder for a message within a physical surrounding using a handheld device provided with image acquisition apparatus, and associating a written or visual or audio message, or a combination of two or more of them, with an image that identifies said placeholder, said association being carried out in a server adapted to communicate with said handheld device.

Claims

1. A method for providing location-based messages, comprising the steps of:

(a) searching among a plurality of world object for a suitable placeholder for a virtual message by using a handheld device provided with image acquisition apparatus;

(b) selecting one of said plurality of world objects as a placeholder by filtering world objects which are not visually isolated from their surroundings and which are not planar and by applying predetermined classification tests; and

(c) attaching one or more virtual messages to an image that identifies said selected placeholder;

wherein the step of selecting one of said plurality of world objects as a placeholder is carried out by performing the following operations;

(i) acquiring an image of a world object;

(ii) pre-processing said acquired image;

(iii) extracting image derivatives from said pre-processed image;

(iv) determining segments within said pre-processed image of a sufficiently high image gradient that are indicative that said acquired image is visually isolated from its surroundings; and

(v) applying validation tests to said determined segments for verifying compliance with predetermined constraints;

wherein a region of the sufficiently high image gradient is identified by projecting gradient image content on two orthogonal axes and analyzing said projected gradient image content with respect to compliance with the predetermined classification tests.

2. The method according to claim 1, further comprising the steps of:

(a) identifying the selected placeholder using image acquisition apparatus provided in a handheld device;

(b) receiving one or more of the attached messages by said handheld device.

3. The method according to claim 2, wherein each of the attached messages is associated with the image that identifies the selected placeholder, said association being carried out in a computing device communicatable with the handheld device.

4. The method according to claim 3, wherein the step of receiving the one or more attached messages is carried out by communicating with the computing device, selecting one of more of the attached messages, and retrieving said one or more selected messages from the computing device.

5. The method according to claim 2, wherein the one or more attached messages is received or transmitted directly from the selected placeholder.

6. The method according to claim 5, wherein the one or more attached messages is transmittable from one mobile phone to a second mobile phone.

7. The method according to claim 1, wherein the predetermined constraints are selected from one or more of the group consisting of shape constraints, size constraints, image frame location constraints, and textural information constraints.

8. The method according to claim 1, wherein the predetermined classification tests are performed on a region of the pre-processed image and are selected from one or more of the group consisting of a repeatability test, a statistical test, and a feature content test.

9. The method according to claim 8, wherein an object planarity test is performed with respect to the pre-processed image following performance of the classification tests.

10. The method according to claim 9, wherein the object planarity test verifies whether world object points have been transformed to image points by a plane to plane projection.

11. The method according to claim 1, further comprising the step of adding an observable virtual frame around a region of the acquired image selected to be the placeholder.

12. The method according to claim 1, wherein the selected placeholder is identified by searchable location characteristics and image related information and corresponding placeholder data is stored in a database of a computing device.

13. The method according to claim 1, wherein the virtual message is a textual or visual or audio message, or a combination of two or more of them.

14. A system for managing location-based messages, comprising:

(a) one or more handheld devices for acquiring world object images, for selecting one of said world objects as a placeholder for a virtual message, for attaching a virtual message to an image that identifies said selected placeholder, and for receiving a virtual message attached to said selected placeholder;

(b) a database in which is stored placeholder data and data related to one or more attached messages, each of said one or more attached messages being associated with a corresponding placeholder; and

(c) a computing device for managing inputs and outputs of said placeholder and said message data with respect to said database and for locating and forwarding one or more of said attached messages;

wherein each of said one or more handheld devices is operable to select said placeholder by filtering world objects which are not visually isolated from their surroundings and which are not planar and by applying predetermined classification tests;

wherein selecting one of said world objects as the placeholder requires;

(i) an image of a world object;

(ii) a pre-processed image of the world object image;

(iii) image derivatives extracted from said pre-processed image;

(iv) segments within said pre-processed image having a sufficiently high image gradient that are indicative that the world object image is visually isolated from its surroundings; and

(v) said segments comply with predetermined constraints as determined through applied validation tests;

wherein a region of the sufficiently high image gradient is identified by projecting gradient image content on two orthogonal axes and analyzing said projected gradient image content with respect to compliance with the predetermined classification tests.

15. The system according to claim 14, wherein each of the one or more handheld devices comprises a filtering module for defining types of placeholder worthy world objects, and a search engine for searching for and identifying one of said types of placeholder worthy world objects.