Method and system for creating virtual message onto a moving object and searching the same

• US 10,264,207 B2
• Filed: 04/28/2017
• Issued: 04/16/2019
• Est. Priority Date: 12/23/2016
• Status: Active Grant

• Current Assignee: Framy, Inc.
• Original Assignee: Yu-Hsien Li
• Inventors: Li, Yu-Hsien
• Primary Examiner(s): Hannett, James M
• Application Number:
  US15/581,851
• Publication Number:
  US 20180184038A1
• Time in Patent Office: 718 Days
• Field of Search: None
• CPC Class Codes: G06F 16/532 Query formulation, e.g. graphical querying
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2207/20084 Artificial neural networks [ANN]
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06V 10/50 by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis
• CPC Class Codes: G06V 10/758 Involving statistics of pixels or of feature values, e.g. histogram matching
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 5/44504 Circuit details of the additional information generator, e.g. details of the character or graphics signal generator, overlay mixing circuits
• CPC Class Codes: H04W 88/02 Terminal devices

Abstract

The disclosure is related to a system and a method for creating a virtual message on a moving object, and for searching the virtual message. Under a data-construction mode, a user manipulates a mobile device to select a virtual message, and to capture a moving object. The mobile device allows the user to position the virtual message on the moving object. The system then receives data of the virtual message, the image information extracted from the moving object, and a viewable range for the virtual message relative to the moving object. The image information is employed to be the reference for the position of the virtual message. Under a search mode, the system renders a service for searching the virtual message over a specific moving object according to the image information of the moving object and the location of the mobile device.

Claims

1. A method for creating a virtual message onto a moving object, comprising:

under a data-construction mode, receiving the virtual message selected using a mobile device;

receiving image information relating to a position where the virtual message is set onto the moving object by the mobile device, wherein the image information is analyzed from an image of the moving object, and the image information of the moving object includes color block and line data used for positioning the virtual message through an image processing process; and

transmitting data of the virtual message and positioning information of the virtual message to a server so as to establish a database provided for searching for the virtual message.

2. The method as recited in claim 1, wherein the image information of the moving object includes information for recognizing a human face.

3. The method as recited in claim 1, wherein, in the server, an image recognition process applying an artificial intelligence is used to process the image information of the moving object.

4. The method as recited in claim 1, wherein, after the virtual message is set onto the moving object, a viewable range of the virtual message is defined, the viewable range including a distance range measured from the moving object and being uploaded to the server accompanied with the virtual message.

5. The method as recited in claim 4, wherein, in the step of uploading the virtual message, a time period and/or a user segment for viewing the virtual message is set.

6. The method as recited in claim 1, wherein the moving object indicates a second person who holds a second mobile device and the server obtains positioning information generated by the second mobile device so as to acquire a distance between the second mobile device that is associated with the virtual message and the mobile device that is used to create the virtual message.

7. A method for searching a virtual message associated to a moving object, comprising:

under a search mode, obtaining positioning information related to a mobile device, and the mobile device obtaining an image of the moving object;

computing image information of the moving object;

uploading the image information of the moving object and the positioning information to a server; and

receiving a viewable range for the moving object and a search result that matches the image information from the server, wherein the viewable range includes a distance range measured from the moving object;

wherein, the server has a database that records multiple virtual messages and their corresponding viewable ranges and image information uploaded by users using their mobile devices;

wherein the viewable range and image information corresponding to every virtual message are compared against the database through a computation in the server, so as to obtain the search result that matches the viewable range and image information of every virtual message.

8. The method as recited in claim 7, wherein the positioning information generated by the mobile device includes a ground-position data that is generated by a ground-positioning unit of the mobile device.

9. The method as recited in claim 7, wherein the image information of the moving object includes color block and line data obtained through an image processing process.

10. The method as recited in claim 7, wherein the image information of the moving object is information for recognizing a human face.

11. The method as recited in claim 7, wherein the computation in the server is an image recognition process applying an artificial intelligence.

12. The method as recited in claim 7, wherein the server receives the positioning and the image information, and determines if the positioning information falls within the viewable range associated to the moving object.

13. The method as recited in claim 12, wherein, in the step of comparison against the database in the server, a time period and/or a user segment of the virtual message is also included to perform the comparison.

14. The method as recited in claim 12, wherein the moving object indicates a second person holding a second mobile device, and the server obtains positioning information generated by the mobile device so as to acquire a distance from the mobile device that is associated with the virtual message, so as to determine if the positioning information falls within the viewable range associated to the moving object.

15. An application system, comprising:

a server, including a database;

an instruction set stored in a non-transitory computer-readable medium of a mobile device, wherein the instruction set is executed by a processor of the mobile device for performing a process of creating and searching a virtual message of a moving object, and the instruction set includes;

an image-retrieving instruction for retrieving an image of the moving object that is displayed on the mobile device;

a virtual message processing instruction for processing the virtual message associated with the moving object in the mobile device, and forming a data of the virtual message transmitted to the server;

a position data generating instruction for obtaining positioning information generated by a ground-positioning unit of the mobile device;

an image information generating instruction for processing the image of the moving object, and generating image information used to position the virtual message;

a search processing instruction for obtaining the positioning and the image information generated by the mobile device under a search mode, transmitting the positioning and the image information to the server, and receiving a search result that matches a searching criteria from the server;

a data transmitting and receiving instruction for establishing a connection between the mobile device and the server for transmitting and receiving signals there-between;

a virtual message display instruction for displaying the virtual message based on the search result.

16. The system as recited in claim 15, wherein the database includes a virtual message database used to record data of the virtual message, and a search database used to record image information associated to the virtual message and searching criteria with respect to the virtual message.

17. The system as recited in claim 15, wherein the image of the moving object is used to generate color block and line data with respect to the virtual message, or used for searching the virtual message.

18. The system as recited in claim 15, wherein the moving object is a human face, and the image information includes information for recognizing the human face.

19. The system as recited in claim 15, wherein the searching criteria is a viewable range, a time period and/or a user segment used for searching the virtual message.