Apparatus and method for haptic rendering

• US 8,571,628 B2
• Filed: 12/27/2006
• Issued: 10/29/2013
• Est. Priority Date: 03/06/2002
• Status: Active Grant

• Current Assignee: MAKO Surgical Corporation (Stryker Corporation)
• Original Assignee: MAKO Surgical Corporation (Stryker Corporation)
• Inventors: Kang, Hyosig, Quaid, Arthur E., Moses, Dennis
• Primary Examiner(s): Le, Long V.
• Assistant Examiner(s): IMPINK, BRADLEY GERALD
• Application Number:
  US11/646,204
• Publication Number:
  US 20070142751A1
• Time in Patent Office: 2,498 Days
• Field of Search: None
• US Class Current: 600/407
• CPC Class Codes: A61B 17/1675 for the knee
• CPC Class Codes: A61B 17/1677 for the patella
• CPC Class Codes: A61B 17/1695 Trepans or craniotomes, i.e. specially adapted for drilling thin bones such as the skull
• CPC Class Codes: A61B 17/17 Guides or aligning means for drills , mills, pins or wires
• CPC Class Codes: A61B 17/1703 using imaging means, e.g. by X-rays
• CPC Class Codes: A61B 17/1739 specially adapted for particular parts of the body
• CPC Class Codes: A61B 17/1764 for the knee
• CPC Class Codes: A61B 17/1767 for the patella
• CPC Class Codes: A61B 2017/00115 with audible or visual output
• CPC Class Codes: A61B 2017/00119 alarm; indicating an abnormal situation
• CPC Class Codes: A61B 2017/00725 Calibration or performance testing
• CPC Class Codes: A61B 2034/102 Modelling of surgical devices, implants or prosthesis
• CPC Class Codes: A61B 2034/105 Modelling of the patient, e.g. for ligaments or bones
• CPC Class Codes: A61B 2034/107 Visualisation of planned trajectories or target regions
• CPC Class Codes: A61B 2034/108 Computer aided selection or customisation of medical implants or cutting guides
• CPC Class Codes: A61B 2034/2048 using an accelerometer or inertia sensor
• CPC Class Codes: A61B 2034/2051 Electromagnetic tracking systems
• CPC Class Codes: A61B 2034/2055 Optical tracking systems
• CPC Class Codes: A61B 2034/2059 Mechanical position encoders
• CPC Class Codes: A61B 2034/2068 using pointers, e.g. pointers having reference marks for determining coordinates of body points
• CPC Class Codes: A61B 2034/207 : Divots for calibration
• CPC Class Codes: A61B 2034/252 : indicating steps of a surgical procedure
• CPC Class Codes: A61B 2034/254 : being adapted depending on the stage of the surgical procedure
• CPC Class Codes: A61B 2034/305 : Details of wrist mechanisms at distal ends of robotic arms
• CPC Class Codes: A61B 2090/08021 : of the patient or his organs
• CPC Class Codes: A61B 2090/365 : augmented reality, i.e. correlating a live optical image with another image
• CPC Class Codes: A61B 2090/3937 : Visible markers
• CPC Class Codes: A61B 2090/3983 : Reference marker arrangements for use with image guided surgery
• CPC Class Codes: A61B 34/10 : Computer-aided planning, simulation or modelling of surgical operations
• CPC Class Codes: A61B 34/20 : Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
• CPC Class Codes: A61B 34/25 : User interfaces for surgical systems
• CPC Class Codes: A61B 34/30 : Surgical robots
• CPC Class Codes: A61B 34/35 : for telesurgery
• CPC Class Codes: A61B 34/37 : Master-slave robots A61B34/35 takes precedence
• CPC Class Codes: A61B 34/70 : Manipulators specially adapted for use in surgery
• CPC Class Codes: A61B 34/71 : Manipulators operated by drive cable mechanisms
• CPC Class Codes: A61B 34/74 : Manipulators with manual electric input means
• CPC Class Codes: A61B 34/76 : Manipulators having means for providing feel, e.g. force or tactile feedback
• CPC Class Codes: A61B 5/1127 : using markers
• CPC Class Codes: A61B 5/745 : using a holographic display
• CPC Class Codes: A61B 90/14 : Fixators for body parts, e.g. skull clamps; Constructional details of fixators, e.g. pins
• CPC Class Codes: A61B 90/36 : Image-producing devices or illumination devices not otherwise provided for
• CPC Class Codes: A61B 90/361 : Image-producing devices, e.g. surgical cameras
• CPC Class Codes: A61B 90/37 : Surgical systems with images on a monitor during operation
• CPC Class Codes: A61F 2/30942 : for designing or making customized prostheses, e.g. using templates, CT or NMR scans, finite-element analysis or CAD-CAM techniques
• CPC Class Codes: A61F 2/38 : for elbows or knees
• CPC Class Codes: A61F 2002/4632 : using computer-controlled surgery, e.g. robotic surgery
• CPC Class Codes: A61F 2002/4633 : for selection of endoprosthetic joints or for pre-operative planning
• CPC Class Codes: A61N 1/0534 : Electrodes for deep brain stimulation
• CPC Class Codes: A61N 1/3605 : Implantable neurostimulators for stimulating central or peripheral nerve system
• CPC Class Codes: A61N 1/372 : Arrangements in connection with the implantation of stimulators
• CPC Class Codes: G05B 2219/36432 : By putting some constraints on some DOF, move within limited volumes, areas, planes, limits motion in x, y or z planes, virtual reality constraints
• CPC Class Codes: G05B 2219/39196 : Use of passive joint, no actuator but brake, brake on or off
• CPC Class Codes: G05B 2219/40478 : Graphic display of work area of robot, forbidden, permitted zone
• CPC Class Codes: G05B 2219/45117 : Medical, radio surgery manipulator
• CPC Class Codes: G05B 2219/45171 : Surgery drill
• CPC Class Codes: G06F 3/016 : Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G16H 20/40 : relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• CPC Class Codes: G16H 40/63 : for local operation
• CPC Class Codes: G16Z 99/00 : Subject matter not provided for in other main groups of this subclass

Abstract

In one aspect, the invention relates to a method for generating a haptic penalty force, including in one embodiment, the steps of: defining a primary proxy position; defining a secondary proxy position; defining a HIP position; generating a first force in response to the primary proxy position and the HIP position and generating a second force in response to the secondary proxy position and the HIP position.

Claims

1. A method for generating a haptic force comprising the steps of:

defining a haptic interaction point (HIP) position in virtual space, the HIP position corresponding to a physical point associated with a surgical tool;

defining a primary proxy position on a primary proxy surface;

defining a secondary proxy position on a secondary proxy surface, wherein the secondary proxy surface is positioned at a predetermined distance from the primary proxy surface and between the primary proxy surface and an expected cutting surface of a bone;

generating a first haptic force, by a haptic device, based on the primary proxy position and the HIP position when the HIP position is located between the primary proxy surface and the secondary proxy surface at a distance less than or equal to the predetermined distance from the primary proxy position, wherein the first haptic force is directed toward the primary proxy position; and

generating a second haptic force, by a haptic device, based on the secondary proxy position and the HIP position when the HIP position is located between the secondary proxy surface and the expected cutting surface at a distance greater than the predetermined distance from the primary proxy position, wherein the second haptic force is directed toward the secondary proxy position.

2. The method of claim 1 wherein the predetermined distance is a desired offset distance.

3. The method of claim 1 wherein the second haptic force is a function of a distance between the secondary proxy position and the HIP position.

4. The method of claim 1 wherein the first haptic force is determined based, at least in part, on a distance between the primary proxy position and the HIP position.

5. The method of claim 1 wherein the secondary proxy position is determined based, at least in part, on interactions between the HIP and a virtual haptic object.

6. The method of claim 1 wherein the first haptic force is a non-zero constant value.

7. The method of claim 1 wherein the second haptic force is linearly proportional to the distance between the secondary proxy and a virtual haptic object.

8. The method of claim 7 wherein the virtual haptic object corresponds to the expected cutting surface of the bone.

9. The method of claim 1 wherein the first and second haptic forces are each non-zero.

10. An apparatus for generating a haptic force on a user comprising:

a computer system comprising a processor configured to execute a series of steps to determine and generate the haptic force, the steps comprising;

defining a haptic interaction point (HIP) position in virtual space, the HIP position corresponding to a physical point associated with a surgical tool;

defining a primary proxy position on a primary proxy surface;

defining a secondary proxy position on a secondary proxy surface, wherein the secondary proxy surface is positioned at a predetermined distance from the primary proxy surface and between the primary proxy surface and an expected cutting surface of a bone;

generating a first haptic force, by a haptic device, based on the primary proxy position and the HIP position when the HIP position is located between the primary proxy surface and the secondary proxy surface at a distance less than or equal to the predetermined distance from the primary proxy position, wherein the first haptic force is directed toward the primary proxy position; and

generating a second haptic force, by a haptic device, based on the secondary proxy position and the HIP position when the HIP position is located between the secondary proxy surface and the expected cutting surface at a distance greater than the predetermined distance from the primary proxy position, wherein the second haptic force is directed toward the secondary proxy position.

11. The apparatus of claim 10 wherein the second haptic force is determined, at least in part, in response to a distance between the secondary proxy position and the HIP position.

12. The apparatus of claim 10 wherein the first haptic force is determined based, at least in part, on a distance between the primary proxy position and the HIP position.

13. The apparatus of claim 10 wherein the secondary proxy position is determined based, at least in part, on interactions between the HIP and a virtual haptic object.

14. The apparatus of claim 10 wherein the first haptic force is a non-zero constant value.

15. The apparatus of claim 10 wherein the second haptic force is linearly proportional to the distance between the secondary proxy and a virtual haptic object.

16. The apparatus of claim 15 wherein the virtual haptic object corresponds to the expected cutting surface of the bone.

17. The apparatus of claim 10 wherein the first and second haptic forces are each non-zero.