Haptic correlated graphic effects

• US 10,296,088 B2
• Filed: 01/26/2016
• Issued: 05/21/2019
• Est. Priority Date: 01/26/2016
• Status: Active Grant

• Current Assignee: Futurewei Technologies Incorporated (Huawei Investment & Holding Co., Ltd.)
• Original Assignee: Futurewei Technologies Incorporated (Huawei Investment & Holding Co., Ltd.)
• Inventors: Mazzola, Anthony
• Primary Examiner(s): Mushambo, Martin
• Application Number:
  US15/006,888
• Publication Number:
  US 20170212592A1
• Time in Patent Office: 1,211 Days
• Field of Search: None
• CPC Class Codes: G06F 2203/04803 Split screen, i.e. subdividing the display area or the window area into separate subareas
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06T 13/20 3D [Three Dimensional] animation
• CPC Class Codes: G06T 13/80 2D [Two Dimensional] animation, e.g. using sprites
• CPC Class Codes: G06T 3/18 Image warping, e.g. rearranging pixels individually
• CPC Class Codes: G09G 2340/14 Solving problems related to the presentation of information to be displayed
• CPC Class Codes: G09G 5/00 Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T

Abstract

A method includes dividing a display of an electronic device into multiple regions defined by vertices, calculating time varying positions for each vertex relative to a z dimension, and composing a screen for the display that includes the varying positions for each vertex to create an animated display distortion. The distortion may occur in association with haptic effects.

Claims

1. A method comprising:

dividing a display of an electronic device into multiple regions defined by vertices, each vertex corresponding to a screen pixel position of the display;

calculating time varying positions for each vertex using a noise function;

composing a screen for the display that includes the time varying positions for each vertex to create an animated display distortion; and

transitioning the animated display distortion on and off in accordance with an intensity value.

2. The method of claim 1 wherein composing the screen comprises adding the time varying positions for each vertex to a surface generated by an application running on the electronic device.

3. The method of claim 1 wherein the time varying positions for each vertex are calculated to provide a visual wave effect in association with haptic effects.

4. The method of claim 1 wherein the varying positions vary between enlarged and shrunken, creating a distortion in the display.

5. The method of claim 4, wherein the calculating of the time varying positions utilizes a piston rod for each vertex.

6. The method of claim 5, further comprising varying lengths of the piston rods over time.

7. The method of claim 6 wherein the varying of the lengths of the piston rods comprises varying the lengths of the piston rods in accordance with a Perlin noise pattern using a turbulence function calculated from four frequencies of noise.

8. The method of claim 7 wherein a mapping between pistons and the Perlin noise pattern shifts across the screen to create a wave effect.

9. A machine readable storage device having instructions for execution by a processor to cause the machine to perform operations comprising:

dividing a display of an electronic device into multiple regions defined by vertices, each vertex corresponding to a screen pixel position of the display;

calculating time varying positions for each vertex using a noise function; and

composing a screen for the display that includes the time varying positions for each vertex to create an animated display; and

transitioning the animated display distortion on and off in accordance with an intensity value.

10. The machine readable storage device of claim 9 wherein the operations for composing the screen comprise adding the varying positions for each vertex to a surface generated by an application running on the electronic device.

11. The machine readable storage device of claim 9 wherein the time varying positions for each vertex are calculated to provide a visual wave effect in association with haptic effects.

12. The machine readable storage device of claim 9 wherein the varying positions vary between enlarged and shrunken, creating a distortion in the display in association with haptic effects.

13. The machine readable storage device of claim 12 wherein the creating of the varying positions utilizes a piston rod for each vertex.

14. The machine readable storage device of claim 13, wherein the operations for calculating time varying positions for each vertex further comprise varying lengths of the piston rods over time in accordance with a Perlin noise pattern using a turbulence function calculated from four frequencies of noise.

15. A device comprising:

a processor;

a display coupled to the processor; and

a memory device coupled to the processor and having a program stored thereon for execution by the processor to perform operations comprising;

dividing the display into multiple regions defined by vertices, each vertex corresponding to a screen pixel position of the display;

calculating time varying positions for each vertex using a noise function;

composing a screen for the display that includes the time varying positions for each vertex to create an animated display distortion; and

transitioning the animated display distortion on and off in accordance with an intensity value.

16. The device of claim 15 wherein composing the screen comprises adding the time varying positions for each vertex to a surface generated by an application running on the device.

17. The device of claim 15 wherein the varying positions vary between enlarged and shrunken, creating a distortion in the display in association with haptic effects.

18. The device of claim 15, wherein the calculating of the varying positions utilizes a piston rod sine function for each vertex.

19. The device of claim 18, further comprising varying lengths of the piston rods over time in accordance with a Perlin noise pattern using a turbulence function calculated from four frequencies of noise.