×

Vibrotactile system to augment 3D input systems

  • US 9,798,388 B1
  • Filed: 10/25/2013
  • Issued: 10/24/2017
  • Est. Priority Date: 07/31/2013
  • Status: Active Grant
First Claim
Patent Images

1. An image processing system, configured to conduct three-dimensional (3D) gesture based interactive sessions, that provides haptic feedback comprising:

  • a memory containing an image processing application; and

    a processor configured via the image processing application to;

    receive captured image data and process the captured image data to detect a target object, the target object being a human hand, the captured image being captured by at least one camera,detect, based upon locations and poses of the detected target object, a 3D initialization gesture,define, based upon a detection of the initialization gesture, a 3D interaction zone having an interior and a boundary, the boundary of the 3D interaction zone being defined based on spatial regions occupied by the target object during the initialization gesture, the 3D interaction zone corresponding to a portion of the captured image data smaller than a field of view of the at least one camera,detect, constrained to the portion of the captured image data corresponding to the interior of the 3D interaction zone, a 3D gesture comprising a plurality of 3D spatial positions of the target object in the 3D interaction zone from the portion of the captured image data,determine a spatial position of the 3D spatial positions of the target object in the 3D interaction zone during the 3D gesture;

    determine whether the target object has moved from a location in the interior of the 3D interaction zone to a location proximate the boundary of the 3D interaction zone during the 3D gesture from the spatial position of the 3D spatial positions of the target object in the 3D interaction zone, the portion of the captured image data corresponding to the 3D interaction zone being constant during the 3D gesture,determine a haptic feedback response based on a determination that the target object is proximate the boundary of the 3D interaction zone,generate a haptic response signal that indicates the determined haptic feedback response, andprovide the haptic response signal to a haptic feedback device, wherein the haptic feedback device is a vibrotactile ring comprising a plurality of vibrating motors and a controller is configured to receive the haptic response signal and generate signals that selectively drive the plurality of vibrating motors to generate the determined haptic feedback response.

View all claims
  • 5 Assignments
Timeline View
Assignment View
    ×
    ×