Input device and method for interacting with motion pictures incorporating content-based haptic feedback

• US 5,816,823 A
• Filed: 10/09/1996
• Issued: 10/06/1998
• Est. Priority Date: 08/18/1994
• Status: Expired due to Term

• Current Assignee: Vintell Applications NY LLC (Intellectual Ventures LLC)
• Original Assignee: Interval Research Corporation
• Inventors: Gessel, David J., Saunders, Steven E., Naimark, Michael, Adams, Robert L., Alkire, Robert D., Dohrmann, Christoph
• Primary Examiner(s): CHENG, JOE H
• Application Number:
  US08/728,102
• Time in Patent Office: 727 Days
• Field of Search: 434/247, 434/307 R, 434/308, 434/309, 434/350, 434/365, 434/112-114, 348/14, 348/121, 348/123, 345/7-9, 345/121, 345/156, 345/157, 345/161, 345/163, 345/167, 345/427, 345/435, 345/302, 340/686, 73/379.01, 463/30, 463/37, 463/38
• US Class Current: 434/307.00R
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0362 with detection of 1D translations or rotations of an operating part of the device, e.g. scroll wheels, sliders, knobs, rollers or belts
• CPC Class Codes: G11B 2220/2587 Laser Discs; Optical disc using analog recording
• CPC Class Codes: G11B 27/02 Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
• CPC Class Codes: G11B 27/026 on discs G11B27/028, G11B27/029 take precedence
• CPC Class Codes: G11B 27/028 with computer assistance
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: H01H 2003/008 with a haptic or a tactile feedback controlled by electrical means, e.g. a motor or magnetofriction

Abstract

An input device and method for interacting with motion pictures incorporating content-based haptic response is provided. Content data relating to the motion picture is stored in a content data storage device while motion picture data is stored in a prerecorded image data storage device. A viewer input device is provided so that a viewer (end-user) can move forwards and backwards through the frames on a display screen while substantially simultaneously, the content data is accessed and braking commands are sent to the viewer input device. The result is that the viewer is provided with haptic responses to the viewer'"'"'s input through the viewer input device.

Claims

1. A system for interactively displaying a plurality of frames of prerecorded visual data, the system incorporating content-based haptic feedback, comprising:

means for storing a plurality of frames of the prerecorded visual data;

means for generating content data corresponding to a characteristic of the prerecorded visual data;

means for storing the content data;

means for processing the content data to generate a haptic feedback control signal corresponding to the characteristic of the prerecorded visual data;

a viewer input device for manually controlling the display on a display device of frames of the prerecorded visual data;

means for producing a display control signal in response to operation of the viewer input device;

means for generating a haptic feedback force based on the haptic feedback control signal, the haptic feedback force being correlated to the prerecorded visual data being displayed; and

means for providing the haptic feedback force to the viewer input device.

2. A system as in claim 1, wherein the content data generating means comprises means for manually generating the content data.

3. A system as in claim 1, further comprising means for ascertaining the physical strength of a viewer, and wherein the processing means is adapted to produce the haptic feedback control signal in response to the ascertained strength of the viewer.

4. A system as in claim 1, wherein the content data generating means comprises means for automatically analyzing the prerecorded visual data and generating said content data based upon the analysis.

5. A system as in claim 1, wherein the haptic feedback force generating means comprises a brake.

6. A system as in claim 1, wherein the haptic feedback force generating means comprises a motor.

7. A system as in claim 1, wherein the haptic feedback force providing means comprises:

attachment means coupled to the viewer input device such that movement of at least or a part of the viewer input device corresponds to movement of the attachment means; and

means for coupling the haptic feedback force generating means to the attachment means.

8. A system as in claim 7, wherein

the attachment means comprises a shaft, such that movement of at least a part of the viewer input device corresponds to rotation of the shaft.

9. A system as in claim 7, wherein the coupling means comprises a flex coupling apparatus.

10. A system as in claim 7, wherein the coupling means comprises a slacked chain link apparatus.

11. A system as in claim 7, wherein the display control signal producing means comprises an optical encoder in communication with the attachment means.

12. A system as in claim 7, wherein the processing means further comprises a pseudo random number generator for use in generating the haptic feedback control signal.

13. A method for interactively displaying a plurality of frames of prerecorded visual data, the method incorporating content-based haptic feedback, comprising the steps of:

storing a plurality of frames of the prerecorded visual data;

generating content data corresponding to a characteristic of the prerecorded visual data;

storing the content data;

processing the content data to generate a haptic feedback control signal corresponding to the characteristic of the prerecorded visual data;

manually controlling the display on a display device of frames of the prerecorded visual data with a viewer input device;

producing a display control signal in response to operation of the viewer input device;

generating a haptic feedback force based on the haptic feedback control signal, the haptic feedback force being correlated to the prerecorded visual data being displayed; and

providing the haptic feedback force to the viewer input device.