Pointing system, pointing device, and pointing control method

• US 9,880,639 B2
• Filed: 05/22/2012
• Issued: 01/30/2018
• Est. Priority Date: 05/31/2011
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Ito, Osamu, Kawabe, Hideo, Maeda, Takeshi, Seki, Kousuke
• Primary Examiner(s): Mengistu, Amare
• Assistant Examiner(s): Figueroa-Gibson, Gloryvid
• Application Number:
  US14/118,590
• Publication Number:
  US 20140085200A1
• Time in Patent Office: 2,079 Days
• Field of Search: 345 56-167, 345179-184
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/033 Pointing devices displaced or positioned by the user , e.g. mice, trackballs, pens or joysticks; Accessories therefor digitisers characterised by the transducing means G06F3/041
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects

Abstract

[Object] To provide a pointing system capable of presenting an intuitive operational feeling to a user.

[Solving Means] A pointing device includes a casing, a tactile sense presentation section, and a sensor section. The sensor section detects an operation for the casing and outputs an operation signal for controlling a movement of a pointer on a screen. The control apparatus includes an area setting section and a signal generation section. The area setting section sets a first area that belongs to an inside of a display area of an object on the screen, a second area that belongs to an outside of the display area of the object, and a third area that belongs to a boundary portion between the first area and the second area. The signal generation section calculates a position of the pointer based on the operation signal to generate, when the pointer is located in the first area, a control signal by which the tactile sense presentation section is driven in a first drive mode and generates, when the pointer is located in the third area, a control signal by which the tactile sense presentation section is driven in a second drive mode.

Claims

1. A pointing system, comprising:

a pointing device, wherein the pointing device is a spatial operation type input apparatus, the pointing device including;

a casing,

a tactile sense presentation section including a plurality of vibrating bodies, each of which is configured to generate a vibration in an arbitrary axis direction by being individually driven, wherein the tactile sense presentation section is configured to present a tactile sense having tactile characteristics to the casing, and

a sensor section configured to detect an operation for the casing and output an operation signal for controlling a movement of a pointer on a screen; and

at least one processor programmed to;

set a first area that belongs to an inside of a display area of an object on the screen, a second area that belongs to an outside of the display area of the object, and a third area that belongs to a boundary portion between the first area and the second area;

calculate a position of the pointer on the screen based on the operation signal;

generate, in response to determining that the pointer has entered the first area, a first control signal by which the tactile sense presentation section is driven in a first drive mode;

generate, when the pointer is located in the third area, a second control signal by which the tactile sense presentation section is driven in a second drive mode, wherein the tactile characteristics of a first tactile sense presented by the tactile sense presentation section to the casing when driven in the first drive mode are different than the tactile characteristics of a second tactile sense presented by the tactile sense presentation section to the casing when driven in the second drive mode;

determine that the pointer is moving toward the object by an operation of the casing; and

generate, in response to determining that the pointer is moving toward the object, a third control signal by which the tactile sense presentation section is driven toward a moving direction of the casing.

2. The pointing system according to claim 1, wherein

the at least one processor is further programmed to generate, when determining that the pointer is moving away from the object by the operation of the casing, a fourth control signal by which the tactile sense presentation section is driven toward a direction opposite to the moving direction of the casing.

3. The pointing system according to claim 1, wherein

the at least one processor is further programmed to:

calculate a moving speed of the casing; and

change a drive force of the tactile sense presentation section in accordance with the calculated moving speed.

4. The pointing system according to claim 1, wherein the object is an icon.

5. The pointing system according to claim 1, wherein

the object is a three-dimensional video, and

the first area is a three-dimensional area associated with the three-dimensional video.

6. The pointing system according to claim 1, wherein

the sensor section includes an inertial sensor configured to detect a movement of the casing and generate a signal associated with the movement.

7. The pointing system according to claim 1, wherein:

the at least one processor is further programmed to generate, when the pointer is located in the second area, a fifth control signal by which the tactile sense presentation section is driven in a third drive mode.

8. The pointing system according to claim 1, wherein when the screen displays a plurality of objects,

the at least one processor is further programmed to:

set, for each object of the plurality of objects, a first area that belongs to the inside of a display area of each object; and

generate a different control signal when the pointer is located in the first area of a first object of the plurality of objects than when the pointer is located in the first area of a second object of the plurality of objects, wherein the tactile characteristics of the tactile sense presented by the tactile sense presentation section to the casing, when driven in response to the different control signals, are different.

9. The pointing system according to claim 1, wherein:

the at least one processor is further programmed to change a width of the third area based on an operation of the user.

10. The pointing system according to claim 1, wherein:

the tactile characteristics of the first tactile sense and/or the second tactile sense comprise a plurality of vibrating patterns.

11. The pointing system according to claim 1, wherein:

the at least one processor is incorporated within the casing of the pointing device.

12. A pointing device, wherein the pointing device is a spatial operation type input apparatus, the pointing device comprising:

a casing;

a tactile sense presentation section including a plurality of vibrating bodies each of which is configured to generate a vibration in an arbitrary axis direction by being individually driven, wherein the tactile sense presentation section is configured to present a tactile sense having tactile characteristics to the casing;

a sensor section configured to detect a movement of the casing within a space and output an operation signal for controlling a movement of a pointer on a screen; and

at least one processor programmed to;

generate, in response to determining that the pointer has entered an inside of a display area of an object on the screen, a first control signal by which the tactile sense presentation section is driven in a first drive mode;

generate, when the pointer is located in a predetermined area around the object, a second control signal by which the tactile sense presentation section is driven in a second drive mode, wherein the tactile characteristics of a first tactile sense presented by the tactile sense presentation section to the casing when driven in the first drive mode are different than the tactile characteristics of a second tactile sense presented by the tactile sense presentation section to the casing when driven in the second drive mode;

determine that the pointer is moving toward the object by an operation of the casing; and

generate, in response to determining that the pointer is moving toward the object, a third control signal by which the tactile sense presentation section is driven toward a moving direction of the casing.

13. A pointing control method, comprising:

setting a first area that belongs to an inside of a display area of an object on a screen, a second area that belongs to an outside of the display area of the object, and a third area that belongs to a boundary portion between the first area and the second area;

calculating a position of a pointer on the screen based on an operation signal output from a pointing device that moves the pointer on the screen;

presenting, in response to determining that the pointer has entered the first area, a first tactile sense having tactile characteristics to the pointing device in a first drive mode;

presenting, when the pointer is located in the third area, a second tactile sense having tactile characteristics to the pointing device in a second drive mode, wherein the tactile characteristics of the first tactile sense in the first drive mode are different than the tactile characteristics of the second tactile sense in the second drive mode;

determining that the pointer is moving toward the object by an operation of the casing of the pointing device; and

presenting, in response to determining that the pointer is moving toward object, a third tactile sense having tactile characteristics toward a moving direction of the casing to the pointing device in a third drive mode.

14. The pointing control method according to claim 13, further comprising:

presenting, in response to determining that the pointer is moving away from the object by the operation of the casing, a fourth tactile sense having tactile characteristics indicating a direction opposite to the moving direction of the casing.

15. The pointing control method according to claim 13, further comprising:

calculating a moving speed of the casing; and

changing a drive force of the first tactile sense, the second tactile sense, or the third tactile sense in accordance with the calculated moving speed.

16. The pointing control method according to claim 13, further comprising:

presenting, when the pointer is located in the second area, a fifth tactile sense having tactile characteristics to the pointing device in a third drive mode.

17. The pointing control method according to claim 13, wherein when the screen displays a plurality of objects, the method further comprises:

setting, for each object of the plurality of objects, a first area that belongs to the inside of a display area of each object; and

presenting a different tactile sense when the pointer is located in the first area of a first object of the plurality of objects than when the pointer is located in the first area of a second object of the plurality of objects.

18. The pointing control method according to claim 13, further comprising changing a width of the third area based on an operation of the user.

19. The pointing control method according to claim 13, wherein the tactile characteristics of the first tactile sense and/or the second tactile sense comprise a plurality of vibrating patterns.