User interface operating method and electronic device with the user interface and program product storing program for operating the user interface

• US 9,330,098 B2
• Filed: 12/26/2012
• Issued: 05/03/2016
• Est. Priority Date: 10/09/2012
• Status: Active Grant

• Current Assignee: Industrial Technology Research Institute
• Original Assignee: Industrial Technology Research Institute
• Inventors: Shiue, De-Hui, Lin, Kuei-Hong, Tseng, Hsiang-Pei
• Primary Examiner(s): HICKS, MICHAEL J
• Application Number:
  US13/727,513
• Publication Number:
  US 20140101188A1
• Time in Patent Office: 1,224 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 16/43 Querying
• CPC Class Codes: G06F 16/438 Presentation of query results
• CPC Class Codes: G06F 16/44 Browsing; Visualisation therefor
• CPC Class Codes: G06F 16/447 Temporal browsing, e.g. timeline
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually

Abstract

A user interface operating method, an electronic device with the user interface and a program product storing a program for operating the user interface are disclosed. A user interface operating method includes steps of displaying a time image, a multimedia object corresponding to a time point in the time image, and first information of the multimedia object corresponding to the time point on a user interface of an electronic device; triggering a search process if the time image and the multimedia object corresponding to the time point in the time image overlap with each other on the user interface, the search process including searching for, based on the first information, multimedia objects corresponding to other time points in the time image related to the first information; and displaying on the user interface the multimedia objects corresponding to other time points in the time image and found in the search process.

Claims

1. A user interface operating method, comprising the following steps of:

by a user interface of an electronic device a time line, a frame in a video corresponding to a time point in the time line, and first information of an object in the frame;

triggering, by a processor, a search process when at least one of the time line and the frame is dragged to be in contact with one another on the user interface, wherein the search process includes searching for, based on the first information, other frames in the video corresponding to other time points in the time line, each of the other frames having a same object as the object in the frame; and

displaying, by the user interface, the other frames in the video having the same object and corresponding to the other time points in the time line.

2. The user interface operating method of claim 1, wherein the search process further includes searching for, based on the first information, second information related to the first information.

3. The user interface operating method of claim 2, further comprising displaying the second information found in the search process on the user interface.

4. The user interface operating method of claim 1, further comprising the step of, before displaying on the user interface the other frames in the video corresponding to the other time points in the time line, checking bandwidth or communication quality of the electronic device in order to determine the number of the other frames to be displayed on the user interface.

5. The user interface operating method of claim 1, wherein the user interface displays a switch object.

6. The user interface operating method of claim 5, further comprising the step of, when the frame has a plurality of objects, switching between the first information of different objects in the frame displayed on the user display through the switch object.

7. The user interface operating method of claim 1, wherein the frame is a picture, a picture combined with texts, a picture combined with audio or a video clip in the video.

8. A program product, stored on a non-transitory computer-readable medium, storing instructions for operating a user interface, when being loaded and executed by a processor, the processor performing the user interface operating method of claim 1.

9. An electronic device, comprising:

configured to display a time line, a frame in a video corresponding to a time point in the time line, and first information of an object in the frame; and

a processor configured to trigger a search process when at least one of the time line and the frame is dragged to be in contact with one another on the user interface, wherein the search process includes searching for, based on the first information, other frames in the video corresponding to other time points in the time line each of the other frames having a same object as the object in the frame; and

a display module for displaying the user interface configured to display the other frames in the video having the same object and corresponding to the other time points in the time line.

10. The electronic device of claim 9, wherein the search process further includes searching for, based on the first information, second information related to the first information, and the user interface further displays on the user interface the second information found in the search process.

11. The electronic device of claim 9, wherein the user interface further displays a switch object.

12. The electronic device of claim 11, further comprising a switch module for, when the frame has a plurality of objects and the switch object is operated, switching between the first information of different objects in the frame displayed on the user display through the switch object.

13. The electronic device of claim 9, further comprising an inspection module for checking the bandwidth or communication quality of the electronic device in order to determine the number of the other frames to be displayed on the user interface.

14. A user interface operating method, comprising the following steps of:

displaying, by a user interface, a time line and a video;

by a processor, a frame in the video corresponding to a time point of the time line when a touch on the user interface is detected, wherein the frame has an object; and

triggering, by the processor, a search process when at least one of the time line and the frame is dragged to be in contact with one another on the user interface, the search process including searching for other frames in the video corresponding to other time points in the time line, wherein each of the other frames has a same object as the object in the frame.

15. A program product, stored on a non-transitory computer-readable medium, storing instructions a for operating a user interface, when being loaded and executed by a processor, the processor performing the user interface operating method of claim 14.