METHOD AND APPARATUS FOR COMBINING A REAL WORLD EVENT AND A COMPUTER SIMULATION

• US 20100271367A1
• Filed: 04/22/2009
• Published: 10/28/2010
• Est. Priority Date: 04/22/2009
• Status: Abandoned Application

• Current Assignee: Sony Interactive Entertainment America LLC (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment America (Sony Group Corp.)
• Inventors: Vaden, Mark, Prakash, Ramana B.
• Application Number:
  US12/428,423
• Publication Number:
  US 20100271367A1
• Time in Patent Office: Days
• US Class Current: 345/420
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/5255 according to dedicated instructions from a player, e.g. using a secondary joystick to rotate the camera around a player's character
• CPC Class Codes: A63F 13/56 Computing the motion of game characters with respect to other game characters, game objects or elements of the game scene, e.g. for simulating the behaviour of a group of virtual soldiers or for path finding
• CPC Class Codes: A63F 13/57 Simulating properties, behaviour or motion of objects in the game world, e.g. computing tyre load in a car race game A63F13/56 takes precedence
• CPC Class Codes: A63F 13/65 automatically by game devices or servers from real world data, e.g. measurement in live racing competition
• CPC Class Codes: A63F 13/803 Driving vehicles or craft, e.g. cars, airplanes, ships, robots or tanks
• CPC Class Codes: A63F 13/812 Ball games, e.g. soccer or baseball
• CPC Class Codes: A63F 2300/69 Involving elements of the real world in the game world, e.g. measurement in live races, real video
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

A method for use in a computer simulation includes receiving data obtained from a real-world event that takes place over a period of time and that includes a plurality of moving bodies, wherein the data includes position data and at least one other attribute for each moving body in the plurality of moving bodies with the data being measured at a plurality of points in the period of time, generating a representation of the real-world event using the data, wherein the representation of the real-world event comprises representations of the plurality of moving bodies, and rendering the representation of the real-world event on a display. Another method includes obtaining data for each of a plurality of moving bodies in a real-world event, and providing the data to an apparatus that is configured to use the data to generate a representation of the real-world event and render the representation of the real-world event on a display. A computer readable storage medium stores a computer program adapted to cause a processor based system to execute one or more of the above or similar steps. An apparatus is configured to generate and render a representation of the real-world event using data obtained from the real-world event.

Claims

1. A method for use in a computer simulation, comprising:

receiving data obtained from a real-world event that takes place over a period of time and that includes a plurality of moving bodies, wherein the data includes position data and at least one other attribute for each moving body in the plurality of moving bodies with the data being measured at a plurality of points in the period of time;

generating a representation of the real-world event using the data, wherein the representation of the real-world event comprises representations of the plurality of moving bodies; and

rendering the representation of the real-world event on a display.

2. The method of claim 1, further comprising:

providing a floating camera view of the representation of the real-world event; and

allowing a user to control the floating camera view so that the user can choose a view of the representation of the real-world event that is displayed on the display.

3. The method of claim 2, wherein:

the plurality of moving bodies comprises a plurality of vehicles;

the data further comprises data relating to at least one of fuel level, tire pressure, and tachometer reading for each vehicle in the plurality of vehicles; and

the allowing the user to control the floating camera view further comprises allowing the user to view alternative views of the representation of each vehicle in the plurality of vehicles.

4. The method of claim 1, further comprising:

receiving control input from a user; and

modifying the representation of the real-world event to include a representation of a first moving body that is responsive to the control input received from the user.

5. The method of claim 4, further comprising:

allowing the user to define a point in time of the representation of the real-world event at which the representation of the first moving body starts being responsive to the control input received from the user.

6. The method of claim 4, wherein:

the representation of the first moving body does not correspond to a moving body in the real-world event.

7. The method of claim 4, wherein:

the representation of the first moving body corresponds to a moving body in the real-world event.

8. The method of claim 4, wherein:

the representation of the first moving body does not cause the representations of the other moving bodies to deviate from movements dictated by the data obtained from the real-world event.

9. The method of claim 4, wherein:

the modifying the representation of the real-world event further comprises modifying the representation of the real-world event so that one or more of the representations of the other moving bodies are responsive to the representation of the first moving body; and

in responding to the representation of the first moving body, the representations of the other moving bodies are allowed to deviate from movements dictated by the data obtained from the real-world event.

10. The method of claim 9, wherein:

the responsiveness of the representations of the other moving bodies to the representation of the first moving body is controlled by an artificial intelligence (AI) of the computer simulation.

11. The method of claim 10, wherein:

the AI of the computer simulation is driven by a combination of the control input received from the user and the data obtained from the real-world event.

12. The method of claim 9, wherein:

the representation of the first moving body corresponds to a moving body in the real-world event; and

the modifying the representation of the real-world event further comprises modifying the representation of the real-world event so that the representations of the other moving bodies substantially track the movements dictated by the data obtained from the real-world event if the user controls the representation of the first moving body so that it substantially tracks the movements dictated by the data obtained from the real-world event.

13. The method of claim 9, wherein:

the representation of the first moving body corresponds to a moving body in the real-world event; and

the modifying the representation of the real-world event further comprises modifying the representation of the real-world event so that the representations of one or more of the other moving bodies deviate from the movements dictated by the data obtained from the real-world event if the user controls the representation of the first moving body so that it deviates from the movements dictated by the data obtained from the real-world event.

14. The method of claim 9, further comprising:

allowing the user to define a point in the representation of the real-world event at which the one or more of the representations of the other moving bodies start being responsive to the representation of the first moving body.

15. A computer readable storage medium storing a computer program adapted to cause a processor based system to execute steps comprising:

receiving data obtained from a real-world event that takes place over a period of time and that includes a plurality of moving bodies, wherein the data includes position data and at least one other attribute for each moving body in the plurality of moving bodies with the data being measured at a plurality of points in the period of time;

generating a representation of the real-world event using the data, wherein the representation of the real-world event comprises representations of the plurality of moving bodies; and

rendering the representation of the real-world event on a display.

16. A method, comprising:

obtaining position data for each of a plurality of moving bodies in a real-world event that takes place over a period of time and that is broadcast on television to at least some viewers, wherein the position data is obtained at a plurality of points in the period of time; and

providing the position data to an apparatus that is configured to use the position data to generate a representation of the real-world event and render the representation of the real-world event on a display, wherein the representation of the real-world event comprises representations of the plurality of moving bodies.

17. The method of claim 16, wherein the obtaining position data comprises:

tracking each moving body in the plurality of moving bodies by using at least one tracking means attached to each moving body.

18. The method of claim 17, wherein:

at least one of the plurality of moving bodies comprises a human being; and

the at least one tracking means attached to the human being comprises a tracking device.

19. The method of claim 18, wherein the tracking device is attached to an item worn by the human being.

20. The method of claim 18, wherein a plurality of tracking devices are attached to the human being.

21. The method of claim 17, wherein:

at least one of the plurality of moving bodies comprises a human being; and

the at least one tracking means attached to the human being comprises a mark used for tracking purposes.

22. The method of claim 21, wherein the mark is tracked using infrared tracking.

23. The method of claim 16, wherein the obtaining position data comprises:

analyzing one or more videos of the real-world event; and

generating the position data based on the analyzing the one or more videos of the real-world event.

24. The method of claim 23, wherein the obtaining position data further comprises:

analyzing a plurality of videos of the real-world event.

25. The method of claim 16, wherein at least one of the plurality of moving bodies comprises an object being used in the real world event.

26. The method of claim 16, wherein:

the apparatus comprises a game console; and

the configuring of the game console comprises running a video game application.

27. A computer readable storage medium storing a computer program adapted to cause a processor based system to execute steps comprising:

receiving data obtained from a real-world event that includes a plurality of moving bodies;

wherein the real-world event takes place over a period of time and is broadcast on television to at least some viewers; and

wherein the data includes position data for each moving body in the plurality of moving bodies with the data being obtained at a plurality of points in the period of time;

generating a representation of the real-world event using the data, wherein the representation of the real-world event comprises representations of the plurality of moving bodies; and

rendering the representation of the real-world event on a display.

28. The computer readable storage medium of claim 27, wherein:

the position data includes position data obtained by tracking each moving body in the plurality of moving bodies by using at least one tracking means attached to each moving body;

at least one of the plurality of moving bodies comprises a human being; and

the at least one tracking means attached to the human being comprises a tracking means attached to an item worn by the human being.

29. The computer readable storage medium of claim 28, wherein a plurality of tracking means are attached to the human being.

30. The computer readable storage medium of claim 27, wherein the position data includes position data obtained by analyzing one or more videos of the real-world event.

31. A computer readable storage medium storing a computer program adapted to cause a processor based system to execute steps comprising:

receiving data obtained from a real-world event that takes place over a period of time and that includes a plurality of moving bodies;

wherein the data includes position data for each moving body in the plurality of moving bodies with the data being obtained at a plurality of points in the period of time; and

wherein the data includes data obtained by analyzing one or more videos of the real-world event;

generating a representation of the real-world event using the data, wherein the representation of the real-world event comprises representations of the plurality of moving bodies; and

rendering the representation of the real-world event on a display.

32. The computer readable storage medium of claim 31, wherein the data includes data obtained by analyzing a plurality of videos of the real-world event.

33. The computer readable storage medium of claim 31, wherein at least one of the plurality of moving bodies comprises a human being.