System and method for video choreography

• US 9,114,320 B2
• Filed: 02/26/2013
• Issued: 08/25/2015
• Est. Priority Date: 10/24/2002
• Status: Expired due to Term

• Current Assignee: Sony Interactive Entertainment LLC (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment America LLC (Sony Group Corp.)
• Inventors: Annunziata, Ed
• Primary Examiner(s): Nguyen, Kimbinh T
• Application Number:
  US13/778,084
• Publication Number:
  US 20130237321A1
• Time in Patent Office: 910 Days
• Field of Search: 345/473, 345/474, 345/475
• US Class Current: 1/1
• CPC Class Codes: A63F 13/10 Control of the course of the game, e.g. start, progess, end
• CPC Class Codes: A63F 13/45 Controlling the progress of the video game
• CPC Class Codes: A63F 13/525 Changing parameters of virtual cameras
• CPC Class Codes: A63F 13/54 involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
• CPC Class Codes: A63F 13/63 by the player, e.g. authoring using a level editor
• CPC Class Codes: A63F 2300/6009 for importing or creating game content, e.g. authoring tools during game development, adapting content to different platforms, use of a scripting language to create content
• CPC Class Codes: A63F 2300/6018 where the game content is authored by the player, e.g. level editor or by game device at runtime, e.g. level is created from music data on CD
• CPC Class Codes: A63F 2300/6063 for sound processing
• CPC Class Codes: A63F 2300/63 for controlling the execution of the game in time
• CPC Class Codes: A63F 2300/6661 for changing the position of the virtual camera
• CPC Class Codes: A63F 2300/6692 using special effects, generally involving post-processing, e.g. blooming
• CPC Class Codes: A63F 2300/8076 Shooting
• CPC Class Codes: G10H 1/00 Details of electrophonic musical instruments
• CPC Class Codes: G10H 1/368 displaying animated or moving pictures synchronized with the music or audio part
• CPC Class Codes: G10H 2210/026 for games, e.g. videogames
• CPC Class Codes: G10H 2240/085 Mood, i.e. generation, detection or selection of a particular emotional content or atmosphere in a musical piece
• CPC Class Codes: G10H 2240/091 Info, i.e. juxtaposition of unrelated auxiliary information or commercial messages with or between music files metadata G10H2240/075
• CPC Class Codes: G10H 2240/285 USB, i.e. either using a USB plug as power supply or using the USB protocol to exchange data
• CPC Class Codes: G10H 2240/315 Firewire, i.e. transmission according to IEEE1394
• CPC Class Codes: Y10S 345/96 Iterative display of preconfigured images

Abstract

An electronic entertainment system for creating a video sequence by executing video game camera behavior based upon a video game sound file includes a memory configured to store an action event/camera behavior (AE/CB) database, game software such as an action generator module, and one or more sound files. In addition, the system includes a sound processing unit coupled to the memory for processing a selected sound file, and a processor coupled to the memory and the sound processing unit. The processor randomly selects an AE pointer and a CB pointer from the AE/CB database. Upon selection of the CB pointer and the AE pointer, the action generator executes camera behavior corresponding to the selected CB pointer to view an action event corresponding to the selected AE pointer.

Claims

1. A sound track stored in a non-transitory tangible medium, the sound track comprising:

a plurality of time-defined segments, wherein each time-defined segment of the plurality of time-defined segments includes;

one or more bytes representative of a music data stream, and

at least one marker bit, wherein each marker bit is associated with a “

1”

state or a “

0”

state; and

one or more characteristic points associated with one or more musical events, wherein each of the one or more musical events is associated with an emotion experienced by a game user, and wherein each of the one or more musical events corresponds to a marker bit in a “

1”

state.

2. The sound track of claim 1, wherein each marker bit is “

on”

if it is associated with a “

1”

state and “

off”

if it is associated with a “

0”

state.

3. The sound track of claim 1, wherein each of the one or more musical events corresponds to a marker bit in a “

0”

state.

4. The sound track of claim 1, wherein the at least one marker bit of each time-defined segment collectively form a plurality of marker bits across the plurality of time-defined segments, and wherein the plurality of marker bits are embedded in the sound track at regular intervals.

5. The sound track of claim 1, wherein each marker bit is preprogrammed to be associated with either an “

on”

or “

off”

state to define a musical event.

6. The sound track of claim 1, wherein each marker bit is embedded into the sound track based on predefined music-emotion criteria.

7. The sound track of claim 1, wherein each marker bit is associated with an action event and a camera behavior.

8. The sound track of claim 7, wherein the action event is associated with an action location, wherein the action location is a determined location of the action event in a game world.

9. The sound track of claim 8, wherein the camera behavior may be used to view the action location.

10. The sound track of claim 7, wherein the action event is a character interaction in a game world.

11. The sound track of claim 10, wherein the character interaction is an individual or group fight, healing, retreat, or exploration.

12. The sound track of claim 7, wherein the action event is a discovery of a game object in a game world.

13. The sound track of claim 7, wherein the camera behavior is a camera movement.

14. The sound track of claim 13, wherein the camera movement is a tilt, orbit, or tracking of a group or character.

15. The sound track of claim 7, wherein the camera behavior is an application of a camera special effect.

16. The sound track of claim 15, wherein the camera special effect is a zoom, wide-angle view, pan, blur, slow-motion view, or a stop-time view.

17. The sound track of claim 15, wherein the camera special effect is a camera view from a perspective of a first character directed at a second character.

18. The sound track of claim 1, wherein each of the one or more musical events is an emotionally critical musical event.

19. The sound track of claim 1, wherein the each of the one or more musical events corresponds to an accelerando, addolorato, allegro, agitato, decrescendo, or fermata.

20. The sound track of claim 1, wherein the emotion experienced by a game user corresponds to a feeling of fear, rage, happiness, sympathy, or hope.