System and Method for Video Choreography

• US 20100302256A1
• Filed: 07/22/2010
• Published: 12/02/2010
• Est. Priority Date: 10/24/2002
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment LLC (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment America LLC (Sony Group Corp.)
• Inventors: Annunziata, Ed
• Granted Patent: US 8,184,122 B2
• Time in Patent Office: Days
• US Class Current: 345/473
• CPC Class Codes: A63F 13/10 Control of the course of the game, e.g. start, progess, end
• CPC Class Codes: A63F 13/45 Controlling the progress of the video game
• CPC Class Codes: A63F 13/525 Changing parameters of virtual cameras
• CPC Class Codes: A63F 13/54 involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
• CPC Class Codes: A63F 13/63 by the player, e.g. authoring using a level editor
• CPC Class Codes: A63F 2300/6009 for importing or creating game content, e.g. authoring tools during game development, adapting content to different platforms, use of a scripting language to create content
• CPC Class Codes: A63F 2300/6018 where the game content is authored by the player, e.g. level editor or by game device at runtime, e.g. level is created from music data on CD
• CPC Class Codes: A63F 2300/6063 for sound processing
• CPC Class Codes: A63F 2300/63 for controlling the execution of the game in time
• CPC Class Codes: A63F 2300/6661 for changing the position of the virtual camera
• CPC Class Codes: A63F 2300/6692 using special effects, generally involving post-processing, e.g. blooming
• CPC Class Codes: A63F 2300/8076 Shooting
• CPC Class Codes: G10H 1/00 Details of electrophonic musical instruments
• CPC Class Codes: G10H 1/368 displaying animated or moving pictures synchronized with the music or audio part
• CPC Class Codes: G10H 2210/026 for games, e.g. videogames
• CPC Class Codes: G10H 2240/085 Mood, i.e. generation, detection or selection of a particular emotional content or atmosphere in a musical piece
• CPC Class Codes: G10H 2240/091 Info, i.e. juxtaposition of unrelated auxiliary information or commercial messages with or between music files metadata G10H2240/075
• CPC Class Codes: G10H 2240/285 USB, i.e. either using a USB plug as power supply or using the USB protocol to exchange data
• CPC Class Codes: G10H 2240/315 Firewire, i.e. transmission according to IEEE1394
• CPC Class Codes: Y10S 345/96 Iterative display of preconfigured images

Abstract

An electronic entertainment system for creating a video sequence by executing video game camera behavior based upon a video game sound file includes a memory configured to store an action event/camera behavior (AE/CB) database, game software such as an action generator module, and one or more sound files. In addition, the system includes a sound processing unit coupled to the memory for processing a selected sound file, and a processor coupled to the memory and the sound processing unit. The processor randomly selects an AE pointer and a CB pointer from the AE/CB database. Upon selection of the CB pointer and the AE pointer, the action generator executes camera behavior corresponding to the selected CB pointer to view an action event corresponding to the selected AE pointer.

Claims

1. A method for creating randomly generated video based upon sound file data through the execution of instructions stored in memory by a processor, the method comprising:

detecting a marker bit associated with the sound file data, wherein the marker bit defines a musical event and is located at a predetermined reference location in the sound file;

selecting an action event in a game to occur in response to detection of the marker bit;

randomly selecting a camera behavior from a database of camera behaviors associated with the selected action event; and

executing the selected camera behavior to view the selected action event at an action location, wherein execution of the camera behavior creates a randomly generated video sequence corresponding to the selected action event.

2. The method of claim 1, further comprising determining the action location for the selected action event.

3. The method of claim 1, wherein processing the sound file data to detect a marker bit includes detecting a marker bit in an ‘

on’

state.

4. The method of claim 3, wherein the ‘

on’

state corresponds to a musical event associated with a user-felt emotion.

5. The method of claim 1, wherein each detected marker bit corresponds to a location in the sound file data of a musical event.

6. The method of claim 4, wherein the detected marker bit is one of a plurality of marker bits, the marker bits located in the sound file data at regularly set intervals.

7. The method of claim 4, wherein the musical event is an emotionally critical musical event.

8. The method of claim 1, wherein the sound file is a director track.

9. The method of claim 1, wherein the action event is an interaction between at least two characters.

10. The method of claim 1, wherein the action event is an interaction between a character and an object in an environment about the character.

11. The method of claim 1, wherein execution of the camera behavior includes application of a camera filter to the randomly generated video sequence to generate a color, black and white, or grainiess effect.

12. The method of claim 1, wherein execution of the camera behavior includes application of a camera movement to the randomly generated video sequence, the camera movement including tilt, orbit, or character tracking.

13. The method of claim 1, wherein execution of the camera behavior includes application of a camera special effect to the randomly generated video sequence.

14. A non-transitory computer-readable storage medium having embodied thereon a program, the program being executable by a computer to perform a method for creating a randomly generated video sequence based upon sound file data, the method comprising:

detecting a marker bit associated with the sound file data, wherein the marker bit defines a musical event and is located at a predetermined reference location in the sound file;

selecting an action event in a game to occur in response to detection of the marker bit;

randomly selecting a camera behavior from a database of camera behaviors associated with the selected action event; and

executing the selected camera behavior to view the selected action event at an action location, wherein execution of the camera behavior creates a randomly generated video sequence corresponding to the selected action event.

15. The computer-readable storage medium of claim 14, further comprising determining the action location for the selected action event.

16. The computer-readable storage medium of claim 14, wherein each detected marker bit marks a location in the sound file data of a musical event and wherein processing the sound file data to detect each marker bit includes detecting a marker bit in an ‘

on’

state.

17. A system for creating randomly generated video based upon sound file data, the system comprising:

a memory to store;

a sound file;

an action event; and

a camera behavior associated with a selected action event;

a processor that executes instructions stored in memory to;

detect a marker bit associated with the sound file data, wherein the marker bit defines a musical event and is located at a predetermined reference location in the sound file;

select an action event in a game to occur in response to detection of the marker bit;

randomly select a camera behavior from a database of camera behaviors associated with the selected action event; and

execute the selected camera behavior to view the selected action event at an action location, wherein execution of the camera behavior creates a randomly generated video sequence corresponding to the selected action event.

18. The system of claim 17, wherein the processor further executes instructions stored in memory to determine the action location for the selected action event.

19. The system of claim 17, further comprising an action generator module stored in memory and executable by a processor to produce the action event.