Gesture fusion

• US 9,086,732 B2
• Filed: 01/31/2013
• Issued: 07/21/2015
• Est. Priority Date: 05/03/2012
• Status: Active Grant

• Current Assignee: LNW Gaming Incorporated
• Original Assignee: WMS Gaming Incorporated (Scientific Games Corporation)
• Inventors: Gagner, Mark B., Kelly, Sean, Massing, Scott A., Pacey, Larry J., Smith, Jesse, Velu, Muthu
• Primary Examiner(s): Liddle, Jay
• Assistant Examiner(s): RADA, ALEX P
• Application Number:
  US13/755,856
• Publication Number:
  US 20130296057A1
• Time in Patent Office: 901 Days
• US Class Current: 1/1
• CPC Class Codes: A63F 13/00 Video games, i.e. games using an electronically generated display having two or more dimensions gaming systems which provide a financial reward G07F17/32
• CPC Class Codes: A63F 13/2145 the surface being also a display device, e.g. touch screens
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

“Fusion” gestures that transition from air to surface or surface to air and interactions with graphical objects displayed on one or more display devices. Surface-to-air gestures are captured on a surface of a touch-based sensing device, and the gesture leaves the surface and enters a volumetric space adjacent to the surface, where a 3D gesture sensing system captures the gesture in 3D space. One or more objects displayed on the display device(s) are graphically shown to be manipulated by the gesture. Air-to-surface gestures are captured in the reverse manner. Different devices housed in separate housings can detect the different types of gestures. For example, a gaming terminal can detect surface gestures made on a single- or multi-touch sensitive surface while a portable electronic device in communication with the gaming terminal can detect air gestures made in a volumetric space in front of the gaming terminal.

Claims

1. A method of manipulating a visual object being displayed on a gaming machine primarily dedicated to playing at least one casino wagering game, the gaming machine including a gaming cabinet, one or more electronic display devices coupled to the gaming cabinet, and a gesture-sensing system including a touch-sensitive surface and a motion sensor, the method comprising:

generating one or more random elements with a random element generator;

determining, by at least one of one or more controllers, an outcome of the casino wagering game based, at least in part, on the one or more random elements;

sensing, by the gesture-sensing system, a continuous gesture that includes a contact component and a non-contact component, the contact component including contact with the touch-sensitive surface, the non-contact component including motion within the designated volumetric space, the contact and non-compact components transitioning directly from one to the other;

in response to sensing the contact component, visually modifying, by at least one of the one or more controllers, a characteristic of at least a first object displayed on at least one of the one or more electronic display devices;

in response to sensing the non-contact component, visually modifying, by at least one of the one or more controllers, at least one of a characteristic of the first object and a characteristic of a second object displayed on at least one of the one or more electronic display devices; and

awarding, by at least one of the one or more controllers, an award in response to the outcome and the visual modifications meeting a predetermined award criteria.

2. The method of claim 1, wherein the contact component visually modifies a characteristic of the first object and the non-contact component visually modifies the same characteristic of the first object in a different way.

3. The method of claim 1, wherein the contact component of the continuous gesture precedes the non-contact component.

4. The method of claim 1, wherein the non-contact component of the continuous gesture precedes the contact component.

5. The method of claim 1, wherein either the contact or the non-contact component causes the first object to visually separate from a plurality of objects and the other of the contact or non-contact components causes the first object to visually move in a particular direction.

6. The method of claim 1, wherein the one or more electronic display devices include a primary display device and a secondary display device, the primary display device including a touch-sensitive surface, and wherein either the contact component or the non-contact component causes the first object to move about the primary display device and the other of the contact or non-contact component causes the first object to move about the secondary display device.

7. The method of claim 1, wherein either the contact component or the non-contact component causes a plurality of objects, including the first object, to visually disperse across at least one of the one or more electronic display devices, and wherein the other of the contact or the non-contact component causes the first object to visually move in a particular direction.

8. The method of claim 1, wherein at least one of the one or more electronic display devices includes an plurality of mechanical reels, wherein the contact component visually modifies the plurality by at least one of starting and stopping spinning of the plurality, and wherein the non-contact component visually modifies some but not all of the plurality by at least one of starting and stopping the some but not all of the plurality.

9. The method of claim 1, wherein either the contact or the non-contact component launches an avatar to pursue a goal in the casino wagering game, and wherein the other of the contact or the non-contact component directs further action by the avatar in pursuit of the goal.

10. The method of claim 1, wherein the contact component causes a first movement of the first object and the non-contact component causes a second movement of the first object that is different from the first movement.

11. The method of claim 1, wherein visually modifying the characteristic of the first object causes a corresponding visual modification of a second object.

12. The method of claim 1, wherein either the contact or non-contact component visually modifies a velocity of the first object, and wherein the other of the contact or non-contact component visually modifies a direction of the first object.

13. The method of claim 1, wherein the contact component includes contact by a hand or finger and the non-contact component includes movement of another body part or of a device worn or held by a user.

14. A gaming machine primarily dedicated to playing at least one casino wagering game, the gaming machine comprising:

a gaming cabinet;

one or more electronic display devices;

an electronic gesture-sensing system coupled to the gaming cabinet, the gesture-sensing system configured to sense a continuous gesture that includes a contact component and a non-contact component, the contact component including contact with a touch-sensitive surface, the non-contact component including motion within a designated volumetric space, the contact and non-compact components transitioning directly from one to the other;

a random element generator configured to generate one or more random elements; and

one or more controllers configured to;

determine an outcome of the casino wagering game based, at least in part, on the one or more random elements;

in response to sensing, by the gesture-sensing system, the contact component of the continuous gesture, visually modify a characteristic of at least a first object displayed on at least one of the one or more display devices;

in response to sensing, by the gesture-sensing system, the non-contact component of the continuous gesture, visually modify at least one of a characteristic of the first object and a characteristic of a second object displayed on at least one of the one or more electronic display devices; and

award an award in response to the outcome and the visual modifications meeting a predetermined award criteria.

15. The gaming machine of claim 14, wherein the contact component causes a first movement of the first object and the non-contact component causes a second movement of the first object that is different from the first movement.

16. The gaming machine of claim 14, wherein the gesture-sensing system includes a portable electronic device having a controller configured to sense the non-contact component in the designated volumetric space, and to communicate coordinate information corresponding to the non-contact component to at least one of the one or more controllers.

17. The gaming machine of claim 14, wherein the one or more electronic display devices include a primary display device and a secondary display device, the primary display device including the touch-sensitive surface, and wherein the contact component causes the first object to move about the primary display device and the non-contact component causes the first object to move about the secondary display device.

18. The gaming machine of claim 14, wherein the visual modification of the characteristic of the first object causes a corresponding visual modification to a second object.

19. The gaming machine of claim 14, wherein the first object is a first symbol and the one or more controllers are further configured to cause the one or more electronic display devices to display an array of symbol positions, wherein either the contact or non-contact component causes the first symbol to move towards the array and wherein the other of the contact or non-contact component causes the first symbol to move to a selected symbol position in the array.

20. The gaming machine of claim 14, wherein either the contact component or the non-contact component causes a plurality of objects, including the first object, to visually disperse across at least one of the one or more electronic display devices, and wherein the other of the contact or the non-contact component causes the first object to visually move in a particular direction.

21. The gaming machine of claim 14, wherein either the contact or non-contact component visually modifies a velocity of the first object, and wherein the other of the contact or non-contact component visually modifies a direction of the first object.

22. The gaming machine of claim 14, wherein the designated volumetric space is bounded on at least one border by the one or more display devices.

23. The gaming machine of claim 14, wherein the touch-sensitive surface is a multi-touch sensing surface configured to sense multiple touches to the sensing surface simultaneously, and wherein gesture-sensing system further includes at least one imaging device configured to sense gestures made within the designated volumetric space.

24. A gaming system primarily dedicated to playing at least one casino wagering game, the gaming system comprising:

a gaming machine including a gaming cabinet, one or more electronic display devices coupled to the gaming cabinet, and a gesture-sensing system including a touch-sensitive surface and a motion sensor, the gesture-sensing system being configured to sense a continuous gesture and to distinguish between a contact component and a non-contact component of the continuous gesture, the contact component including contact with the touch-sensitive surface, the non-contact component including motion within a designated volumetric space sensed by the motion sensor, the gesture-sensing system being coupled to the gaming cabinet;

a random element generator configured to generate one or more random elements;

one or more controllers configured to;

determine an outcome of the casino wagering game based, at least in part, on the one or more random elements;

in response to sensing, by the gesture-sensing system, the contact component of the continuous gesture, visually modify a characteristic of at least a first object displayed on at least one of the one or more display devices;

in response to sensing, by the gesture-sensing system, the non-contact component of the continuous gesture, visually modify at least one of a characteristic of the first object and a characteristic of a second object displayed on at least one of the one or more electronic display devices; and

award an award in response the outcome and the visual modifications meeting a predetermined award criteria.

25. The gaming system of claim 24, wherein the gesture-sensing system includes a portable electronic device having a controller configured to sense the non-contact component in the designated volumetric space, and to communicate coordinate information corresponding to the non-contact component to at least one of the one or more controllers.

26. The gaming system of claim 25, wherein the portable electronic device includes an imaging device that images gestures in the designated volumetric space.

27. The gaming system of claim 24, wherein the gesture-sensing system includes a portable electronic device connected for communication to a remote server via a communications network, the remote server downloading three-dimensional gesture-sensing software to the portable electronic device and the portable electronic device executing the three-dimensional gesture-sensing software to process and communicate coordinate information corresponding to the non-contact component within the designated volumetric space to at least one of the one or more controllers.

28. The gaming system of claim 24, wherein the non-contact component causes the first object to visually separate from a plurality of objects and the contact component causes the first object to visually move in a particular direction.

29. The gaming system of claim 24, wherein the contact component causes a plurality of objects, including the first object, to visually disperse across at least one of the one or more electronic display devices, and wherein the non-contact component causes the first object to visually move in a particular direction.

30. The gaming system of claim 24, wherein at least one of the one or more electronic display devices includes an plurality of mechanical reels, wherein the contact component visually modifies the plurality by at least one of starting and stopping spinning of the plurality, and wherein the non-contact component visually modifies some but not all of the plurality by at least one of starting and stopping the some but not all of the plurality.

31. The gaming system of claim 24, wherein either the contact or the non-contact component launches an avatar to pursue a goal in the casino wagering game, and wherein the other of the contact or the non-contact components directs further action by the avatar in pursuit of the goal.

32. The gaming system of claim 24, wherein the touch-sensitive surface is a multi-touch sensing surface configured to sense multiple touches to the sensing surface simultaneously, and wherein the gesture-sensing system further includes at least one imaging device configured to sense gestures made within the designated volumetric space.