Multi-dimensional user interface

• US 5,148,154 A
• Filed: 12/04/1990
• Issued: 09/15/1992
• Est. Priority Date: 12/04/1990
• Status: Expired due to Term

• Current Assignee: Sony Electronics Inc. (Sony Group Corp.)
• Original Assignee: Sony Corporation Of America (Sony Group Corp.)
• Inventors: Berger, Robert J., Duffy, Robert, MacKay, Michael T., Langford, Ted E.
• Primary Examiner(s): Brier, Jeffery A.
• Assistant Examiner(s): Chin, Jick
• Application Number:
  US07/622,821
• Time in Patent Office: 651 Days
• Field of Search: 340/729, 340/721, 340/712, 340/723, 364/522, 364/521, 395/154, 395/159
• US Class Current: 715/782
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G11B 2220/41 Flat as opposed to hierarchical combination, e.g. library of tapes or discs, CD changer, or groups of record carriers that together store one title
• CPC Class Codes: G11B 2220/90 Tape-like record carriers
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: G11B 27/36 Monitoring, i.e. supervising the progress of recording or reproducing for digital recording G11B20/00 and s.gr.; for monitoring, testing or measuring of TV recorders of the type covered by H04N5/76 and subgroups, see H04N17/06
• CPC Class Codes: H04N 5/222 Studio circuitry; Studio devices; Studio equipment cameras or camera modules comprising electronic image sensors, or control thereof H04N23/00

Abstract

The present invention provides apparatus and methods for a multi-dimensional user interface for use in audio visual production. A display system including a central processing unit (CPU) is coupled through appropriate input/output (I/O) circuitry to input devices, such as a keyboard, digital pad and/or track ball as well as a display device. The CPU is further coupled to a hard disk drive for the storage of programs and data, and is also coupled to a network through which the CPU may communicate with a variety of system resource devices such as editors, music synthesizers, graphics generators, scheduling resources, audio enhancement resources, etc. A user viewing the interface on the display may utilize one of the input devices, such as by way of example, the keyboard, to select, incorporate or otherwise integrate the various system resources to develop a unified multi-media production. The user interface of the present invention includes a control frame which in practice substantially fills all of the display screen of the display and is consistent for all user applications. The control frame is comprised of control panels which surround a variety of subwindows and acts as a consistent control area for all users of the interface. Once defined, elements may be selectively placed on an event horizon bar in the control frame. The placement of an element on the event horizon results in the display of timing data for the element, relative to other elements on the event horizon.

Claims

1. A computer controlled display system including at least one Central Processing Unit (CPU), said CPU coupled to a display for displaying data, and user input means, said display system further coupled to a plurality of system resources having defined attributes, said display system comprising:

a user interface for display by said display means, said user interface for displaying representations of resources coupled to said display system with which a user interacts through said user input means;

said representations of said resources comprising at least three dimensions and being arranged in a venue of at least three dimensions, each of said dimensions corresponding to an attribute of said resources, said venue may be viewed using said interface from a plurality of view ports, such that viewing said representations of said resources from different view ports results in the display of different attributes of said resources;

said representations of said resources being arranged in said venue such that each of said representations is disposed relative to one another in time and space within said venue;

manipulation means coupled to said user input means for selectively positioning said representations of said resources within said venue.

2. The display system as defined by claim 1 wherein said venue is three dimensions and each of said representations of said resources comprise three dimensions.

3. The display system as defined by claim 2 wherein said venue may be viewed from six view ports, namely, a top, left, right, rear, bottom and front view port.

4. The display system as defined by claim 3 wherein viewing said venue from a top view port reveals the relative positions of each of said three dimensional representations of said resources relative in time to one another.

5. The display system as defined by claim 4 wherein viewing said venue from a front view port reveals an icon identifying the type of resource each of said representations represent.

6. The display system as defined by claim 5 wherein viewing said venue from a side view port reveals versions of said resource and the lengths of said versions relative to one another.

7. The display system as defined by claim 6 wherein viewing said venue from a front view port further reveals version activation buttons, one of said buttons for each of said versions, such that said user, using said user input means may selectively activate said versions.

8. The display system as defined by claim 7 wherein in the event said user activates one of said versions, said version is executed within said representation of said resource, and may viewed through said front view port of said venue on said display.

9. The display system as defined by claim 6 wherein said user interface includes interface generation means coupled to said CPU for generating and displaying a control frame using said display means to display selected view ports of a venue, said control frame including a plurality of command options which may be selected by said user using said user input means.

10. The display system as defined by claim 9 wherein said control frame further includes a first area for defining said attributes of said resources and displaying said representations of said resources once said attributes are defined.

11. The display system as defined by claim 10 wherein said first area displays said representations of said resources in a venue initially from a first view port.

12. The display system as defined by claim 11 wherein said user may selectively change view ports from said first view port by selecting one of said command options.

13. The display system as defined by claim 10 wherein said control frame further includes a second area for displaying said top view port of said venue, such that timing data representing relative time associated with said resources is displayed in said second area.

14. The display system as defined by claim 13 wherein said control frame further includes a event horizon bar, such that the placement of a representation of a resource on said bar results in said timing data being displayed in said second area of said control frame.

15. The display system as defined by claim 14 wherein selecting an Element command option results in the display of an element attribute box for defining said resource attributes.

16. The display system as defined by claim 15 wherein said representations of said resources may be selectively placed on said event horizon bar, thereby altering the relative placement of said representations in said venue in time and space.

17. The display system as defined by claim 16 wherein said command options of said control frame further includes a plurality of mode specific action options on the periphery of said control frame.

18. The display system as defined by claim 17 wherein said command options of said control frame further includes a plurality of major mode options on the periphery of said control frame.

19. The display system as defined by claim 18 wherein said first view port initially displayed comprises the front view port.

20. A computer controlled display system including at least one Central Processing Unit (CPU), said CPU coupled to display means for displaying data on a screen of a display, and user input means, said display system further coupled to a plurality of system resources having defined attributes, said display system comprising:

a user interface on said screen of said display for displaying representations of resources coupled to said display system with which a user interacts through said user input means;

said user interface including interface generation means coupled to said CPU for generating and displaying a control frame on said display, said control frame including a plurality of command options which may be selected by said user using said user input means, and further including a event horizon bar, such that the placement of a representation of a resource on said bar using said user input means results in predetermined data being displayed in said control frame and said representations of said resources being disposed relative to one another in time;

said representations of said resources comprising at least three dimensions and being arranged in a venue of at least three dimensions which may be viewed using said user interface from a plurality of view ports, such that viewing said representations of said resources from different view ports results in the display on said screen of different attributes of said resources.

21. The display system as defined by claim 20 wherein said control frame further includes a first area for defining said attributes of said resources and displaying representations of said resources once said attributes are defined.

22. The display system as defined by claim 21 wherein selecting an Element command option results in the display of an element attribute box for defining said resource attributes.

23. The display system as defined by claim 22 wherein said command options of said control frame further includes a plurality of mode specific action options on the periphery of said control frame.

24. The display system as defined by claim 23 wherein said representations of said resources are arranged in said venue such that each of said resources is disposed relative to one another in time and space within said venue.

25. The display system as defined by claim 24 further including manipulation means coupled to said user input means for selectively positioning said representations of said resources within said venue.

26. The display system as defined by claim 24 wherein said venue is three dimensions and each of said representations of said resources comprise three dimensions.

27. The display system as defined by claim 26 wherein said venue may be viewed from six viewports, namely, a top, left, right, rear, bottom and front view port.

28. The display system as defined by claim 27 wherein viewing said venue from a top view port reveals the relative positions of each of said three dimensional representations of said resources relative in time to one another.

29. The display system as defined by claim 28 wherein viewing said venue from a front view port reveals an icon identifying the type of resource each of said representations represent.

30. The display system as defined by claim 29 wherein viewing said venue from a side view port reveals versions of said resource and the lengths of said versions relative to one another.

31. The display system as defined by claim 30 wherein viewing said venue from a front view port further reveals version activation buttons, one of said buttons for each of said versions, such that said user, using said user input means may selectively activate said versions.

32. The display system as defined by claim 31 wherein in the event said user activates one of said versions, said version is executed within said representation of said resource, and may viewed through said front view port of said venue on said display.

33. The display system as defined by claim 32 wherein said first area displays said representations of said resources in a venue initially from a first view port.

34. The display system as defined by claim 33 wherein said user may selectively change view ports from said first view port by selecting one of said command options.

35. The display system as defined by claim 34 wherein said control frame further includes a second area for displaying said top view port of said venue, such that timing data representing relative time associated with said resources is displayed in said second area.

36. The display system as defined by claim 35 said representations of said resources may be selectively placed on said event horizon, thereby altering the relative placement of said representations in said venue in time and space.

37. The display system as defined by claim 36 wherein said command options of said control frame further includes a plurality of major mode options on the periphery of said control frame.

38. The display system as defined by claim 37 wherein said first view port initially displayed comprises the front view port.

39. In a computer controlled display system including at least one Central Processing Unit (CPU), said CPU coupled to a display for displaying data on a screen of said display, and user input means, said display system further coupled to a plurality of system resources having defined attributes, a method for manipulating and displaying representations of said resources on said display, comprising the steps of:

providing a user interface on said screen of said display for displaying representations of resources coupled to said display system with which a user interacts through said user input means;

generating and displaying a control frame on said display using interface generation means coupled to said CPU, said control frame including a plurality of command options which may be selected by said user using said user input means, and further including a event horizon bar, such that the placement of a representation of a resource on said bar using said user input means results in predetermined data being displayed in said control frame, and said representations of said resources being disposed relative to one another in time;

said representations of said resources comprising at least three dimensions and being arranged in a venue comprising at least three dimensions which may be viewed using said user interface from a plurality of view ports, such that viewing said representations of said resources from different view ports results in the display on said screen of different attributes of said resources.

40. The method as defined by claim 39 wherein said control frame further includes a first area for defining said attributes of said resources and displaying representations of said resources once said attributes are defined.

41. The method as defined by claim 40 further including the step of selecting an Element command option and displaying an element attribute box for defining said resource attributes.

42. The method as defined by claim 41 wherein said command options of said control frame further includes a plurality of mode specific action options on the periphery of said control frame.

43. The method as defined by claim 42 wherein said representations of said resources are arranged in said venue such that each of said resources is disposed relative to one another in time and space within said venue.

44. The method as defined by claim 43 wherein said venue is three dimensions and each of said representations of said resources comprise three dimensions.

45. The method as defined by claim 44 further including the step of selectively viewing said venue from one of six viewports, namely, a top, left, right, rear, bottom and front view port.

46. The method as defined by claim 45 wherein viewing said venue from a top view port reveals the relative positions of each of said three dimensional representations of said resources relative in time to one another.

47. The method as defined by claim 46 wherein viewing said venue from a front view port reveals an icon identifying the type of resource each of said representations represent.

48. The method as defined by claim 47 wherein viewing said venue from a side view port reveals versions of said resource and the lengths of said versions relative to one another.

49. The method as defined by claim 48 wherein viewing said venue from a front view port further reveals version activation buttons, one of said buttons for each of said versions, such that said user, using said user input means may selectively activate said versions.

50. The method as defined by claim 49 further including the step of said user activating one of said versions, said version then being executed within said representation of said resource, viewed through said front view port of said venue on said display.

51. The method as defined by claim 50 wherein said first area displays said representations of said resources in a venue initially from a first view port.

52. The method as defined by claim 51 further including the step of said user selectively changing view ports from said first view port by selecting one of said command options.

53. The method as defined by claim 52 wherein said control frame further includes a second area for displaying said top view port of said venue, such that timing data representing relative time associated with said resources is displayed in said second area.

54. The method as defined by claim 53 further including the step of selectively placing said representations of said resources on said event horizon, thereby altering the relative placement of said representations in said venue in time and space.

55. The method as defined by claim 54 wherein said command options of said control frame further includes a plurality of major mode options on the periphery of said control frame.

56. The method as defined by claim 55 wherein said first view port initially displayed comprises the front view port.