Repetitive event analysis system

• US 5,414,644 A
• Filed: 11/24/1993
• Issued: 05/09/1995
• Est. Priority Date: 11/24/1993
• Status: Expired due to Fees

• Current Assignee: Ethnographics,Inc.
• Original Assignee: Ethnographics,Inc.
• Inventors: Williams, Homer F., Seaman, Gary W., Mascha, Michael
• Primary Examiner(s): Voeltz, Emanuel T.
• Assistant Examiner(s): Tran, Alan
• Application Number:
  US08/158,010
• Time in Patent Office: 531 Days
• Field of Search: 364/551.01, 364/419.11, 364/419.13, 364/225.4, 395/600, 395/159, 382/56, 369/48, 369/49
• US Class Current: 702/183
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing
• CPC Class Codes: Y10S 707/99948 Application of database or data structure, e.g. distributed, multimedia, or image
• CPC Class Codes: Y10S 715/961 Operator interface with visual structure or function dictated by intended use
• CPC Class Codes: Y10S 715/978 Audio interaction as part of an operator interface

Abstract

A method of observing and comparing the visual record of repetitive or related events in nature, such as behavioral activities, recorded on a viewable media, which includes converting the visual record into a digital format, storing the digital record in a database at an identifiable location, establishing and storing a textual database comprising written descriptions of the visual record and a glossary of key words identifying repetitive events, the stored information constituting an information library. The library is stored in a microprocessor system, the microprocessor being programmed so that a user can search and retrieve multiple images of a selected event, precursor visual images of events prior to the event in time, responsive activity showing events subsequent to the selected event and contemporaneous events, all retrieved visual images including textual information. The method includes the ability of the user to update, reorder, supplement, and expand the information library as desired.

Claims

1. A method for observing and comparing repetitive behavioral activities during the life span of a life form, said life span being recorded in a series of visual records of the behavioral activities, each visual record of the behavioral activity constituting a segment of the life span, comprising:

a) converting each visual record in the series of visual records into a series of digitized images each digitized image having a location with a specific address and storing a time based identity for each digitized image,

b) establishing a textual database and storing in the textual data base written descriptions of the digitized images and a glossary of key words describing each behavioral activity exhibited in the digitized image, each key word being associated with at least one exemplary digitized image representative of said key word, each written description being associated with at least one digitized image the digital images, the location of each digitized image the address of each digitized image and the associated written descriptions and key words forming an information library which is stored in a microprocessor system, the microprocessor being programmed so that a user can search and retrieve from the information library,

1) multiple digitized images of a selected behavioral activity,

2) precursor digitized images showing precursor behavior occurring at a time prior to each digitized image of the selected behavioral activity,

3) digitized images showing responsive behavior occurring at a time following each digitized image of the selected behavioral activity, and

4) digitized images of contemporary events occurring at the same time as the selected behavioral activity,

such that each retrieved digitized image of selected, precursor, responsive and contemporary behavioral activity can be compared and contrasted.

15. The method of claim 1 wherein said audio/visual record is selected from the group consisting of still and motion images, series of images, videotaped records, film, notes, maps, photographs, videoclips, individual video frames and video frame sequences.

16. The method of claim 15 wherein said audio/visual record is delivered from the group of media consisting of CD-ROM, laser disc, video file server, video ethernet and data delivery network.

17. The method of claim 1 wherein the microprocessor is further programmed for creation of a second textual database containing written descriptions of the digitized images and a second glossary of keywords describing selected behavioral activities;

whereby each keyword in the second glossary can be different than previously established keywords such that a customized user specific database is established.

18. The method of claim 1 wherein the textual database and written descriptions can be modified and supplemented by a user so that said user can rearrange the visual records and classify the rearranged records with a unique coding selected by the user.

19. The method of claim 1 wherein a user can add new textual input to said textual database.

20. The method of claim 1 wherein a source tag can be assigned to said visual records along with the time based identity to allow a user to view visual records organized alternatively by information source and by said time based identity number.

21. The method of claim 1 further incorporating means to compare behavior activities at different times, different activities at the same time, different views of the same activity, activities concerning different subjects at the same or different activities concerning different subjects at the same time.-

22. The method of claim 1 further including the step of displaying a series of visual records relating to a selected behavioral activity beginning at a selected period of time prior to the activity and displaying each successive record related thereto, whereby the visual records are viewed in the same manner as a motion picture.

23. The method of claim 1 wherein textual information regarding an observed incident is viewed.

24. The method of claim 1 wherein information regarding an observed lifeform, the parentage, siblings and offspring of the observed lifeform and descriptive text related thereto can be viewed along with the visual record.

25. The method of claim 1 wherein different visual records showing the same behavior can be viewed.

26. The method of claim 25 wherein each different visual record can be identified by discrete addresses and time based identity within the data base and textual information relating thereto can be displayed.

27. The method of claim 25 wherein each different visual record can be viewed as a collection of screen frames displaying the behavioral activity along with textual descriptions for each sequence.

28. The method of claim 27 wherein the textual descriptions regarding a visual sequence is accessible separate from the visual record.

2. A computer based system to analyze a time based visual record of defined events comprising:

a) means for storing, in a numerical order, audio/visual information regarding defined events and related textual information,

b) a plurality of software defined entry paths for searching and retrieving the stored audio/visual information and related textual information including;

1) a first software defined entry path means for searching and retrieving selected audio/visual information, precursor, audio/visual information, responsive audio/visual information, concurrent audio/visual information, and related textual information regarding a selected event,

2) a second software defined entry path for searching a glossary of key words and for retrieving, audio/visual information and textual information related thereto,

3) a third software defined entry path for searching a relationship chart and for retrieving audio/visual images and textual information related thereto, and

4) a fourth entry path means for searching sequentially through audio/visual records, and

c) output means for generating a set of displays of the retrieved audio/visual and textual information, whereby the display generated using the entry path allows the analysis, comparison and contrasting of the displayed audio/visual and textual information.

4. The computer based system of claim 2 wherein the defined activity is a repeated event of a selected subject wherein the subject is chosen from the group consisting of one or more species, living subject, organism, lifeform, living or non-living systems, organic or inorganic reaction and physical phenomena.

5. The computer based system of claim 2 wherein said numerical order can be alternatively chosen from a time based numbering system and a straight sequential numbering system.

6. The computer based system of claim 4 wherein the defined activities are different events related to each other, the relationship being shown on a relationship chart.

7. The computer based system of claim 6 wherein the relationship chart can be changed, amended or deleted.

8. The computer based system of claim 6 wherein the relationship chart is based on genealogical information.

9. The computer based system of claim 2 further having means to access additional records of activities and to add new information relating to the previously collected audio/visual records.

3. A method of analyzing behavior of one or more subjects of a living species comprising the steps of:

a) collecting audio/visual records illustrating portions of the life of a subject, said portion of the life of the subject including an activity, and optionally, events preceding the activity and events following the activity;

b) creating text describing the audio/visual record of each said portions, activity or events;

c) storing said audio/visual records;

d) indexing said audio/visual records using a sequential coding;

e) associating said text with said audio/visual records;

f) associating said keywords with said audio/visual records;

g) recording said association between said audio/visual records and said text;

h) recording the association between said audio/visual records and keywords;

i) searching said audio/visual records, keywords and text to locate desired visual records;

j) retrieving the audio/visual record, associated keywords and associated text; and

k) comparing and contrasting the audio/visual records having the same keywords associated therewith,

so that the same event recorded for different subjects can be contrasted and the preceding activity and following activity related thereto can be contrasted.

10. The method of claim 3 wherein said audio/visual records, keywords and text are displayed in an observable manner such that one or more audio/visual records, keywords and textual description can be concurrently viewed for one or more subjects and for one or more behaviors.

11. The method of claim 3 wherein said audio/visual records, keywords and text can be modified and supplemented and the associations between the audio/visual records, keywords and text can be changed.

12. The method of claim 10 wherein said displayed audio/visual records, keywords and textual descriptions can be compared, analyzed and contrasted.

13. The method of claim 3 wherein the recorded audio/visual records and associated text include more than one subject and records of similar behaviors of each subject is observable concurrently by selecting a behavior which is common to each subject.

14. The method of claim 13 wherein a subject is chosen from the list consisting of one or more species, living subject, organism, lifeform, living or nonliving systems, organic or inorganic reaction and physical phenomena.