Information processing apparatus

• US 7,643,096 B2
• Filed: 07/31/2003
• Issued: 01/05/2010
• Est. Priority Date: 05/11/1999
• Status: Expired due to Fees

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Kokubo, Tetsushi, Okumura, Yuji, Teshigawara, Satoshi, Kondo, Tetsujiro
• Primary Examiner(s): RAO, ANAND SHASHIKANT
• Application Number:
  US10/631,348
• Publication Number:
  US 20040023718A1
• Time in Patent Office: 2,350 Days
• Field of Search: 348699-701, 37524008-24017
• US Class Current: 348/700
• CPC Class Codes: G09B 19/00 Teaching not covered by other main groups of this subclass teaching or practice apparatus for gun-aiming or gun-laying F41G3/26
• CPC Class Codes: G09B 9/00 Simulators for teaching or training purposes for the use of weapons F41; computing aspects G06; protocols for games, networked simulations or virtual reality H04L67/131
• CPC Class Codes: G09B 9/05 the view from a vehicle being simulated G09B9/052, G09B9/058 take precedence
• CPC Class Codes: G09B 9/12 Motion systems for aircraft simulators

Abstract

Relationship information is previously generated and stored by learning based on camera motion estimation information expressing motion of a video camera, which is detected by a desired image signal picked up by the video camera, and camera motion information expressing physical motion of the video camera, which was obtained by a sensor for detecting physical motion at the same time when the desired image signal was picked up by the video camera. Camera motion estimation information with respect to an inputted image signal is detected from the inputted image signal. Camera motion prediction information with respect to the inputted image signal is generated, based on the camera motion estimation information detected and the relationship information. Based on the camera motion prediction information, a vibration signal for vibrating an object is generated. As a result, vibration data can be easily generated at low costs, based on existing video assets.

Claims

1. An apparatus comprising:

memory means for storing relationship information generated by;

learning based on camera motion estimation information for learning expressing motion of a video camera, which is detected by a desired image signal picked up by the video camera;

camera motion information for learning expressing physical motion of the video camera, which was obtained by a sensor for detecting physical motion at the same time when the desired image signal was picked up by the video camera;

camera motion estimation information detection means for detecting camera motion estimation information with respect to an inputted image signal, from the inputted image signal;

and camera motion prediction information generation means for generating camera motion prediction information with respect to the inputted image signal, based on the camera motion estimation information of the inputted image signal detected by the camera motion estimation information detection means and the relationship information;

wherein the desired image signal is a signal obtained for learning processing that is performed automatically by a learning section of said apparatus.

2. The apparatus according to claim 1, further comprising vibration signal generation means for generating a vibration signal for vibrating an object.

3. The apparatus according to claim 2, further comprising drive means for driving the object, based on the vibration signal.

4. The apparatus according to claim 2, further comprising a chair as the object.

5. The apparatus according to claim 4, further comprising display means for displaying the input image signal in synchronization with the drive means.

6. The apparatus according to claim 1, wherein the camera motion estimation includes a motion vector detection section for detecting a motion vector from the inputted image signal, a motion center detection section for detecting a motion center, based on the motion vector, and a camera motion estimation information detection section for detecting the camera motion estimation information, based on the motion vector and the motion center.

7. The apparatus according to claim 6, wherein the motion vector detection section detects the motion vector, with respect to a plurality of preset representative points of the inputted image signal.

8. The apparatus according to claim 1, comprising an acceleration sensor as the sensor.

9. The apparatus according to claim 1, comprising an angular speed sensor as the sensor.

10. The apparatus according to claim 1,

wherein the camera motion estimation information detection means generates the camera motion estimation information which is constructed by information of plural kinds of motions.

11. The apparatus according to claim 1, wherein the camera motion prediction information generation means generates the camera motion prediction information corresponding to the inputted image signal, by a linear combination of the camera motion estimation information and the relationship information.

12. An information processing method executable by a processor, the method comprising the steps of:

generating relationship information generated by;

learning based on camera motion estimation information for learning expressing motion of a video camera, which is detected by a desired image signal picked up by the video camera;

camera motion information for learning expressing physical motion of the video camera, which was obtained by a sensor for detecting physical motion at the same time when the desired image signal was picked up by the video camera;

detecting camera motion estimation information with respect to an inputted image signal, from the inputted image signal;

and generating camera motion prediction information with respect to the inputted image signal, based on the camera motion estimation information of the inputted image signal detected and the relationship information;

wherein the desired image signal is a signal obtained for learning processing that is performed automatically by a learning section of a learning apparatus.

13. The method according to claim 12, further comprising a step of generating a vibration signal for vibrating an object.

14. The method according to claim 13, further comprising a step of driving the object, based on the vibration signal.

15. The method according to claim 14, wherein a chair is used as the object in the step of driving the object.

16. The method according to claim 14, further comprising a step of displaying the input image signal in synchronization with the driving.

17. The method according to claim 12, wherein the step of detecting the camera motion estimation information includes a step of detecting a motion vector from the inputted image signal, a step of detecting a motion center, based on the motion vector, and a step of detecting the camera motion estimation information, based on the motion vector and the motion center.

18. The method according to claim 17, wherein in the step of detecting the motion vector, the motion vector is detected with respect to a plurality of preset representative points of the inputted image signal.

19. The method according to claim 12, wherein in the step of generating the relationship information, the relationship information is generated, based on camera motion information expressing physical motion of the video camera, which was obtained by an acceleration sensor as the sensor.

20. The method according to claim 12, wherein in the step of generating the relationship information, the relationship information is generated, based on camera motion information expressing physical motion of the video camera, which was obtained by an angular speed sensor as the sensor.

21. The method according to claim 12,

wherein in the step of detecting the camera motion estimation information, the camera motion estimation information which is constructed by information of plural kinds of motions.

22. The method according to claim 12, wherein in the step of generating the camera motion prediction information, the camera motion prediction information corresponding to the inputted image signal is generated by a linear combination of the camera motion estimation information and the relationship information.

23. A computer-readable storage medium storing a program that when executed by a computer causes the computer to execute information processing, the program comprising the steps of:

generating relationship information generated by;

learning based on camera motion estimation information for learning expressing motion of a video camera, which is detected by a desired image signal picked up by the video camera;

camera motion information for learning expressing physical motion of the video camera, which was obtained by a sensor for detecting physical motion at the same time when the desired image signal was picked up by the video camera;

detecting camera motion estimation information with respect to an inputted image signal, from the inputted image signal;

generating camera motion prediction information with respect to the inputted image signal, based on the camera motion estimation information of the inputted image signal detected and the relationship information;

wherein the desired image signal is a signal obtained for learning processing that is performed automatically by a learning section of a learning apparatus.

24. The medium according to claim 23, wherein the program further comprises

a step of generating a vibration signal for vibrating an object.

25. The medium according to claim 24, wherein the program further comprises a step of driving the object, based on the vibration signal.

26. The medium according to claim 25, wherein a chair is used as the object in the step of driving the object.

27. The medium according to claim 25, wherein the program further comprises a step of displaying the input image signal in synchronization with the driving.

28. The medium according to claim 23, wherein the step of detecting the camera motion estimation information includes a step of detecting a motion vector from the inputted image signal, a step of detecting a motion center, based on the motion vector, and a step of detecting the camera motion estimation information, based on the motion vector and the motion center.

29. The medium according to claim 28, wherein in the step of detecting the motion vector, the motion vector is detected with respect to a plurality of preset representative points of the inputted image signal.

30. The medium according to claim 23, wherein in the step of generating the relationship information, the relationship information is generated, based on camera motion information expressing physical motion of the video camera, which was obtained by an acceleration sensor as the sensor.

31. The medium according to claim 23, wherein in the step of generating the relationship information, the relationship information is generated, based on camera motion information expressing physical motion of the video camera, which was obtained by an angular speed sensor as the sensor.

32. The medium according to claim 23,

wherein in the step of detecting the camera motion estimation information, the camera motion estimation information which is constructed by information of plural kinds of motions.

33. The medium according to claim 23, wherein in the step of generating the camera motion prediction information, the camera motion prediction information corresponding to the inputted image signal is generated by a linear combination of the camera motion estimation information and the relationship information.

34. An information processing method executable by a processor, the method comprising the steps of:

detecting from an inputted image signal camera motion information with respect to the inputted image signal;

detecting camera motion prediction information with respect to the inputted image signal, based on the detected camera motion information and relationship information generated by;

learning based on camera motion estimation information for learning that expresses motion of a video camera, which is detected by a desired image signal picked up by the video camera;

camera motion information for learning that expresses physical motion of the video camera, obtained by a sensor for detecting physical motion at the same time that the desired image signal was picked up;

wherein the desired image signal is a signal obtained for learning processing that is performed automatically by a learning section of a learning apparatus.

35. The method according to claim 34, wherein the relationship information is generated based on the camera motion information that expresses physical motion of the video camera, obtained by an acceleration sensor.

36. The method according to claim 34, wherein the relationship information is generated based on the camera motion information that expresses physical motion of the video camera, obtained by an angular speed sensor.

37. A computer-readable storage medium for storing a program that when executed by a computer processes information, the program comprising the steps of:

detecting from an inputted image signal camera motion information with respect to the inputted image signal;

and detecting camera motion prediction information with respect to the inputted image signal, based on the detected camera motion information and relationship information generated by;

learning based on camera motion estimation information for learning that expresses motion of a video camera, which is detected by a desired image signal picked up by the video camera;

camera motion information for learning that expresses physical motion of the video camera, obtained by a sensor for detecting physical motion at the same time that the desired image signal was picked;

wherein the desired image signal is a signal obtained for learning processing that is performed automatically by a learning section of a learning apparatus.

38. The medium according to claim 37, wherein the relationship information is generated based on the camera motion information that expresses physical motion of the video camera, obtained by an acceleration sensor.

39. The medium according to claim 37, wherein the relationship information is generated based on the camera motion information that expresses physical motion of the video camera, obtained by an angular speed sensor.