Semantic gaming and application transformation including movement processing equations based on inertia

• US 8,795,079 B2
• Filed: 03/15/2012
• Issued: 08/05/2014
• Est. Priority Date: 11/23/2004
• Status: Active Grant

• Current Assignee: DRNC Holdings, Inc. (InterDigital, Inc.)
• Original Assignee: Hillcrest Laboratories Incorporated (CEVA Incorporated)
• Inventors: Penzias, Arno III
• Primary Examiner(s): BREWSTER, WILLIAM M
• Application Number:
  US13/421,132
• Publication Number:
  US 20120178533A1
• Time in Patent Office: 873 Days
• Field of Search: 463/37, 463/38
• US Class Current: 463/37
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/215 comprising means for detecting acoustic signals, e.g. using a microphone
• CPC Class Codes: A63F 13/235 using a wireless connection, e.g. infrared or piconet
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: A63F 13/57 Simulating properties, behaviour or motion of objects in the game world, e.g. computing tyre load in a car race game A63F13/56 takes precedence
• CPC Class Codes: A63F 13/837 Shooting of targets
• CPC Class Codes: A63F 2300/10 characterized by input arrangements for converting player-generated signals into game device control signals
• CPC Class Codes: A63F 2300/1006 having additional degrees of freedom
• CPC Class Codes: A63F 2300/1031 using a wireless connection, e.g. Bluetooth, infrared connections
• CPC Class Codes: A63F 2300/105 using inertial sensors, e.g. accelerometers, gyroscopes
• CPC Class Codes: A63F 2300/1081 Input via voice recognition
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands
• CPC Class Codes: A63F 2300/64 for computing dynamical parameters of game objects, e.g. motion determination or computation of frictional forces for a virtual car
• CPC Class Codes: A63F 2300/8076 Shooting
• CPC Class Codes: G06F 3/01 Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 3/033 Pointing devices displaced or positioned by the user , e.g. mice, trackballs, pens or joysticks; Accessories therefor digitisers characterised by the transducing means G06F3/041
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0354 : with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
• CPC Class Codes: G06F 3/03543 : Mice or pucks G06F3/03541 takes precedence

Abstract

A gaming system comprises a handheld user input device, a processor for receiving input data from the handheld user input device and a gaming application for receiving data from the processor based on the received input data from the handheld user input device. The handheld user input device emulates one of a plurality of different devices associated with the gaming application. Each of the plurality of different devices have a set of input commands associated therewith. The set of input commands associated with the one of a plurality of different devices includes a command based on one of motion and orientation of the handheld device.

Claims

1. A system comprising:

a processor for receiving input data; and

an application configured to execute on the processor and to receive data from said processor based on said input data,

wherein said data is used by the application to emulate one of a plurality of different devices,

wherein said processor is configured to apply different sets of movement processing equations for said plurality of different devices such that a set of movement processing equations for one of a plurality of different devices is applied based on an inertia associated with said one of a plurality of different devices, and

wherein said input data is generated by a user input device comprising an accelerometer for detecting an acceleration of said user input device and at least one other sensor for detecting a rotational motion of said user input device.

2. The system of claim 1, wherein said user input device is a free-space pointing device.

3. The system of claim 1, wherein said system is a gaming system.

4. The system of claim 1, wherein said application corresponds to a training program for evaluating a user undergoing therapy.

5. The system of claim 1, further comprising:

a display for reflecting motion and orientation of said user input device.

6. The system of claim 5, wherein said display comprises a plurality of displays being positioned surrounding a user.

7. The system of claim 5, wherein a particular motion associated with the user input device results in moving a corresponding cursor from one display to a second display.

8. The system of claim 1, wherein said input data is communicated to the processor over a wireless data link.

9. The system of claim 8, wherein said wireless data link is a Bluetooth link.

10. The system of claim 8, wherein said wireless data link is an IR link.

11. The system of claim 1, further comprising a second user input device.

12. The system of claim 11, wherein said second user input device communicates with the processor over a second wireless link.

13. The system of claim 1, wherein said processor is further configured to compensate said detected motion of said user input device by transforming said detected motion from the body frame of reference associated with said user input device into an inertial frame of reference.

14. The system of claim 1, wherein said at least one other sensor is a camera.

15. The system of claim 1, wherein said at least one other sensor is an optical sensor.

16. The system of claim 1, wherein said accelerometer is a multi-axis accelerometer and wherein said at least one second output includes a value y generated by said multi-axis accelerometer associated with acceleration of said user input device in a y-axis direction and a value z generated by said multi-axis accelerometer associated with acceleration of said user input device in a z-axis direction.

17. The system of claim 16, wherein said multi-axis accelerometer is a 3-axis accelerometer.

18. The system of claim 1, wherein said input data is generated at a sampling rate of 200 samples/second.

19. A method for emulating one of a plurality of different devices, said method comprising:

executing an application program on a processor;

receiving, by the processor, input data; and

emulating one of a plurality of different devices based on said application program and the input data by applying different sets of movement processing equations for said plurality of different devices such that a set of movement processing equations for said one of a plurality of different devices is applied based on an inertia of said one of a plurality of different devices,

wherein said input data is generated by a user input device and further comprising;

generating raw data by an accelerometer and at least one other sensor based on a motion of said user input device, wherein the raw data describes the motion of said user input device and the raw data includes acceleration data and rotational motion data generated by the accelerometer and the at least one other sensor;

receiving the raw data from said user input device including the acceleration data from the accelerometer and the rotational motion data from the at least one other sensor, said acceleration data and said rotational motion data being associated with an acceleration and a rotational motion of said user input device;

processing the raw data from the accelerometer and the at least one other sensor to produce compensated data; and

receiving the compensated data by the application program based on the received acceleration data and the rotational motion data.

20. The method of claim 19, wherein the application program is a gaming application.

21. The method of claim 19, wherein the raw data is received by the processor over a wireless data link.

22. The method of claim 19, wherein the user input device is a free-space pointing device.

23. The method of claim 19, wherein said sensor is a camera.

24. The method of claim 19, wherein said at least one other sensor is an optical sensor.

25. The method of claim 19, wherein said accelerometer is a multi-axis accelerometer and wherein said at least one second output includes a value y generated by said multi-axis accelerometer associated with acceleration of said user input device in a y-axis direction and a value z generated by said multi-axis accelerometer associated with acceleration of said user input device in a z-axis direction.

26. The method of claim 25, wherein said multi-axis accelerometer is a 3-axis accelerometer.

27. The method of claim 19, wherein said user input data is generated at a sampling rate of 200 samples/second.

28. The method of claim 19, wherein said processing of said raw data for orientation of said user input device further comprises:

compensating detected motion of said user input device by transforming said detected motion from a body frame of reference associated with said user input device into an inertial frame of reference.