System and method for video choreography

• US 8,384,721 B2
• Filed: 05/22/2012
• Issued: 02/26/2013
• Est. Priority Date: 10/24/2002
• Status: Expired due to Term

• Current Assignee: Sony Interactive Entertainment LLC (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment America LLC (Sony Group Corp.)
• Inventors: Annunziata, Ed
• Primary Examiner(s): Nguyen, Kimbinh T
• Application Number:
  US13/478,093
• Publication Number:
  US 20120293517A1
• Time in Patent Office: 280 Days
• Field of Search: 345473-475
• US Class Current: 345/473
• CPC Class Codes: A63F 13/10 Control of the course of the game, e.g. start, progess, end
• CPC Class Codes: A63F 13/45 Controlling the progress of the video game
• CPC Class Codes: A63F 13/525 Changing parameters of virtual cameras
• CPC Class Codes: A63F 13/54 involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
• CPC Class Codes: A63F 13/63 by the player, e.g. authoring using a level editor
• CPC Class Codes: A63F 2300/6009 for importing or creating game content, e.g. authoring tools during game development, adapting content to different platforms, use of a scripting language to create content
• CPC Class Codes: A63F 2300/6018 where the game content is authored by the player, e.g. level editor or by game device at runtime, e.g. level is created from music data on CD
• CPC Class Codes: A63F 2300/6063 for sound processing
• CPC Class Codes: A63F 2300/63 for controlling the execution of the game in time
• CPC Class Codes: A63F 2300/6661 for changing the position of the virtual camera
• CPC Class Codes: A63F 2300/6692 using special effects, generally involving post-processing, e.g. blooming
• CPC Class Codes: A63F 2300/8076 Shooting
• CPC Class Codes: G10H 1/00 Details of electrophonic musical instruments
• CPC Class Codes: G10H 1/368 displaying animated or moving pictures synchronized with the music or audio part
• CPC Class Codes: G10H 2210/026 for games, e.g. videogames
• CPC Class Codes: G10H 2240/085 Mood, i.e. generation, detection or selection of a particular emotional content or atmosphere in a musical piece
• CPC Class Codes: G10H 2240/091 Info, i.e. juxtaposition of unrelated auxiliary information or commercial messages with or between music files
• CPC Class Codes: G10H 2240/285 USB, i.e. either using a USB plug as power supply or using the USB protocol to exchange data
• CPC Class Codes: G10H 2240/315 Firewire, i.e. transmission according to IEEE1394
• CPC Class Codes: Y10S 345/96 Iterative display of preconfigured images

Abstract

An electronic entertainment system for creating a video sequence by executing video game camera behavior based upon a video game sound file includes a memory configured to store an action event/camera behavior (AE/CB) database, game software such as an action generator module, and one or more sound files. In addition, the system includes a sound processing unit coupled to the memory for processing a selected sound file, and a processor coupled to the memory and the sound processing unit. The processor randomly selects an AE pointer and a CB pointer from the AE/CB database. Upon selection of the CB pointer and the AE pointer, the action generator executes camera behavior corresponding to the selected CB pointer to view an action event corresponding to the selected AE pointer.

Claims

1. A method for choreographing a video sequence, comprising:

receiving a sound file, the sound file selected from a sound file database;

executing instructions stored in memory, wherein execution of the instructions by a processor;

processes the selected sound file to generate a director'"'"'s track, the director'"'"'s track including one or more marker bits that each define a musical event and is located at a predetermined location in the sound file,

detecting the marker bit in the sound file,

selects an action event in a game to occur in response to the detected marker bit,

selects a camera behavior associated with the selected action event, and

implements the selected camera behavior to view the selected action event at an action location, wherein the implemented camera behavior creates a video sequence corresponding to the action event.

2. The method of claim 1, wherein the detected marker bit is in the ‘

on’

state.

3. The method of claim 2, wherein the ‘

on’

state corresponds to the musical event associated with a user felt emotion.

4. The method of claim 1, wherein the one or more marker bits are located in the sound file at regularly set intervals.

5. The method of claim 1, wherein the action event is an interaction between at least two characters.

6. The method of claim 1, wherein the action event is an interaction between a character and an object in an environment about the character.

7. The method of claim 1, wherein implementing the camera behavior includes application of a camera filter to the video sequence to generate a color, black and white, or graininess effect.

8. The method of claim 1, wherein the camera behavior includes application of a camera movement to the video sequence, the camera movement including tilt, orbit, or character tracking.

9. The method of claim 1, wherein the camera behavior includes application of a camera special effect to the video sequence.

10. A system for choreographing a video sequence, comprising:

memory to store;

a sound file,

an action event, and

a camera behavior associated with a selected action event; and

a processor that executes instructions stored in memory to;

generate a director'"'"'s track, the director'"'"'s track including one or more marker bits that each define a musical event and is located at a predetermined location in the sound file,

detect the marker bit in the sound file,

selects the action event in a game to occur in response to the detected marker bit,

selects a camera behavior associated with the selected action event, and

implement the selected camera behavior to view the selected action event at an action location, wherein the implemented camera behavior creates a video sequence corresponding to the action event.

11. The system of claim 10, wherein the processor further executes instructions stored in memory to determine the action location for the selected action event.

12. The system of claim 10, further comprising an action generator module stored in memory and executable by the processor to produce the action event.

13. A non-transitory computer-readable storage medium having embodied thereon a program, the program being executable by a computer to perform method for choreographing a video sequence, the method comprising:

receiving a sound file;

processes the selected sound file to generate a director'"'"'s track, the director'"'"'s track including one or more marker bits that each define a musical event and is located at a predetermined location in the sound file,

detecting the marker bit in the sound file,

selecting an action event in a game to occur in response to the detected marker bit,

selecting a camera behavior associated with the selected action event, and

implementing the selected camera behavior to view the selected action event at an action location, wherein the implemented camera behavior creates a video sequence corresponding to the action event.