System and method for identifying imminent dropping of a device and providing a warning of the imminent dropping

• US 10,431,054 B2
• Filed: 05/22/2018
• Issued: 10/01/2019
• Est. Priority Date: 05/24/2017
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Interactive Entertainment Europe Limited (Sony Group Corp.)
• Inventors: Benson, Simon Mark, Raghoebardajal, Sharwin Winesh, Connor, Patrick John
• Primary Examiner(s): Bee, Andrew W
• Application Number:
  US15/986,298
• Publication Number:
  US 20180342135A1
• Time in Patent Office: 497 Days
• CPC Class Codes: A63F 13/21 characterised by their sensors, purposes or types
• CPC Class Codes: A63F 13/214 for locating contacts on a surface, e.g. floor mats or touch pads
• CPC Class Codes: A63F 13/218 using pressure sensors, e.g. generating a signal proportional to the pressure applied by the player
• CPC Class Codes: A63F 13/98 Accessories, i.e. detachable arrangements optional for the use of the video game device, e.g. grip supports of game controllers
• CPC Class Codes: A63F 2300/8082 Virtual reality
• CPC Class Codes: G06F 3/01 Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/02 Input arrangements using manually operated switches, e.g. using keyboards or dials
• CPC Class Codes: G06F 3/0219 Special purpose keyboards
• CPC Class Codes: G06F 3/023 Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
• CPC Class Codes: G06F 3/03 Arrangements for converting the position or the displacement of a member into a coded form
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G08B 1/08 using electric transmission ; transformation of alarm signals to electrical signals from a different medium, e.g. transmission of an electric alarm signal upon detection of an audible alarm signal
• CPC Class Codes: G08B 21/18 Status alarms G08B21/02 takes precedence
• CPC Class Codes: G08B 23/00 Alarms responsive to unspecified undesired or abnormal conditions

Abstract

A processing system adapted for use in a gaming environment is configured to detect when a user might accidentally drop an input device, such as a handheld game controller. The processing system includes an input device, a processing unit and a warning unit. The input device has one or more pressure sensors operable to sense pressure inputs from a user. The processing unit is operable to identify an imminent dropping of the input device from measurements obtained by the pressure sensors. And the warning unit is operable to provide a warning to the user when the processing unit identifies an imminent drop of the input device.

Claims

1. A processing system comprising:

an input device comprising one or more pressure sensors operable to sense pressure inputs from a user; and

a processing unit operable to identify an imminent dropping of the input device from measurements obtained by the one or more pressure sensors, and to affect a warning to the user when the processing unit identifies an imminent drop.

2. A processing system according to claim 1, wherein the warning comprises one or more of an audible, a visual and a tactile component.

3. A processing system according to claim 2, wherein the processing system is configured to cause an audible warning as the audible component to be output by one or more of the input device, the processing device or a display device.

4. A processing system according to claim 1, wherein the input device is operable to perform an action to reduce a risk of damage being sustained by the input device in response to an identification of an imminent drop.

5. A processing system according to claim 1, wherein the processing system is configured to cause the warning to be shown when a condition is met, the condition including one or more criteria selected from the list consisting of:

i. when pressure inputs fall below a threshold amount;

ii. when pressure inputs change by at least a threshold amount; and

iii. when pressure inputs change at a rate greater than a threshold amount.

6. A processing system according to claim 1, further comprising a camera arranged to capture images of the input device and the user.

7. A processing system according to claim 1, wherein the processing system is configured to cause the warning to be provided to the user in response to the user performing a predetermined motion in conjunction with a change in pressure inputs.

8. A processing system according to claim 1, wherein the processing system is configured to cause the warning to be provided to the user only if the input device is greater than a threshold distance from a surface.

9. A processing system according to claim 1, further comprising a head-mountable display.

10. A processing system according to claim 9, wherein the warning comprises video content obtained using a camera associated with the head-mountable display.

11. A processing system according to claim 1, in which the processing system further comprises a communication unit operable to receive inputs from the input device, the inputs corresponding to operation of the one or more pressure sensors, and

wherein the processing unit comprises a processor operable to generate, in dependence upon the received inputs, a warning to be provided to the user when a change in the sensed pressure is identified as being indicative of an imminent dropping of the input device.

12. The processing system of claim 11, in which:

the communication unit is operable to receive inputs from the input device indicating an orientation of the input device; and

the processor is operable to generate the warning responsive to both the sensed pressure and the orientation of the input device.

13. A pressure-sensing method for use with an input device comprising one or more pressure sensors operable to sense pressure inputs from a user, the method comprising:

receiving, at a processing device, one or more inputs from the input device, the inputs corresponding to operation of the one or more pressure sensors;

identifying an imminent dropping of the input device from measurements obtained by the one or more pressure sensors; and

generating, in response to an imminent drop being identified, a warning to be provided to the user.

14. The pressure sensing method of claim 13, further comprising:

receiving, at the processing device, one or more orientation inputs from the input device, the orientation inputs corresponding to the orientation of the input device;

wherein the identifying step comprises identifying the imminent dropping of the input device responsive to both measurements obtained by the pressure sensors and the orientation of the input device.

15. A non-transitory computer-readable recording medium having instructions stored thereon, the instructions, when executed by a computer, causing the computer to perform a method comprising:

receiving, at a processing device, one or more inputs from the input device, the inputs corresponding to operation of the one or more pressure sensors;

identifying an imminent dropping of the input device from measurements obtained by the one or more pressure sensors; and

generating, in response to an imminent drop being identified, a warning to be provided to the user.

16. The non-transitory computer-readable recording medium of claim 15, wherein the method further comprises:

receiving, at the processing device, one or more orientation inputs from the input device, the orientation inputs corresponding to the orientation of the input device;

wherein the identifying step comprises identifying the imminent dropping of the input device responsive to both measurements obtained by the pressure sensors and the orientation of the input device.