Audio obstruction effects in 3D parallax user interfaces

• US 9,720,645 B2
• Filed: 12/27/2013
• Issued: 08/01/2017
• Est. Priority Date: 12/27/2013
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Isherwood, David
• Primary Examiner(s): TRAN, THANG V
• Application Number:
  US14/368,700
• Publication Number:
  US 20160291930A1
• Time in Patent Office: 1,313 Days
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G09G 3/003 to produce spatial visual effects

Abstract

Various systems and methods for providing audio obstruction effects in 3D parallax user interfaces are described herein. An apparatus comprises: a presentation module to present a 3D parallax user interface on an electronic device, the 3D parallax user interface including a foreground layer and a background layer, the foreground layer having a foreground user interface component and the background layer having a background user interface component, the foreground user interface component obstructing at least a portion of the background user interface component; a receiving module to receive a signal to generate an audio notification for the background user interface component; and an audio effect module to: determine an audio effect to apply to the audio notification, the audio effect based on the position of the background user interface component in relation to the foreground user interface component; and apply the audio effect to the audio notification.

Claims

1. A non-transitory machine-readable medium including instructions for providing audio obstruction effects in 3D parallax user interfaces, which when executed by a machine, cause the machine to:

present a 3D parallax user interface on an electronic device, the 3D parallax user interface including a foreground layer and a background layer, the foreground layer having a foreground user interface component and the background layer having a background user interface component, the foreground user interface component obstructing at least a portion of the background user interface component;

receive a signal to generate an audio notification for the background user interface component;

determine an audio effect to apply to the audio notification, the audio effect based on the position of the background user interface component in relation to the foreground user interface component;

apply the audio effect to the audio notification; and

present the audio notification with the audio effect.

2. The non-transitory machine-readable medium of claim 1, wherein the instructions to determine the audio effect to apply to the audio notification comprise instructions to:

determine an amount of unobstructed area of the background user interface component;

determine a distance from the foreground layer; and

construct the audio effect as a function of the amount of unobstructed area and the distance from the foreground layer.

3. The non-transitory machine-readable medium of claim 1, wherein the audio effect includes dampening an audio signal to reduce at least one of a volume or frequency range.

4. The non-transitory machine-readable medium of claim 3, wherein the volume is reduced by approximately 3 dB.

5. The non-transitory machine-readable medium of claim 3, wherein to reduce the frequency range, the audio effect includes a reduction in the slope of a low-pass filter by approximately 6 dB/octave.

6. The non-transitory machine-readable medium of claim 5, wherein the audio effect includes a reduction of the cut-off frequency of the low-pass filter by approximately 500 Hz.

7. The non-transitory machine-readable medium of claim 1, wherein the audio effect includes a reverberation or an echo.

8. The non-transitory machine-readable medium of claim 1, further comprising instructions to:

determine that the foreground user interface component has moved to a new position with Respect to the background user interface component in the 3D parallax user interface;

determine a revised audio effect to apply to the audio notification, the revised audio effect based on the new position;

apply the revised audio effect to the audio notification to obtain a revised audio notification; and

present the revised audio notification.

9. The non-transitory machine-readable medium of claim 1, wherein the background layer is a wallpaper of the 3D parallax user interface.

10. The non-transitory machine-readable medium of claim 9, wherein the wallpaper includes a soundtrack, and wherein the machine-readable medium further comprises instructions to determine and apply an audio effect to apply to the soundtrack.

11. An apparatus to provide audio obstruction effects in 3D parallax user interfaces, the apparatus comprising:

a presentation circuit to present a 3D parallax user interface on an electronic device, the 3D parallax user interface including a foreground layer and a background layer, the foreground layer having a foreground user interface component and the background layer having a background user interface component, the foreground user interface component obstructing at least a portion of the background user interface component;

a receiving circuit to receive a signal to generate an audio notification for the background user interface component; and

an audio effect circuit to;

determine an audio effect to apply to the audio notification, the audio effect based on the position of the background user interface component in relation to the foreground user interface component;

and

apply the audio effect to the audio notification; and

an audio presentation circuit to present the audio notification with the audio effect.

12. The apparatus of claim 11, wherein to determine the audio effect to apply to the audio notification, the audio effect circuit is to:

determine an amount of unobstructed area of the background user interface component;

determine a distance from the foreground layer; and

construct the audio effect as a function of the amount of unobstructed area and the distance from the foreground layer.

13. The apparatus of claim 11, wherein the audio effect includes dampening an audio signal to reduce at least one of a volume or frequency range.

14. The apparatus claim 13, wherein the volume is reduced by approximately 3 dB.

15. The apparatus of claim 13, wherein to reduce the frequency range, the audio effect includes a reduction in the slope of a low-pass filter by approximately 6 dB/octave.

16. A method for providing audio obstruction effects in 3D parallax user interfaces, the method comprising:

presenting a 3D parallax user interface on an electronic device, the 3D parallax user interface including a foreground layer and a background layer, the foreground layer having a foreground user interface component and the background layer having a background user interface component, the foreground user interface component obstructing at least a portion of the background user interface component;

receiving a signal to generate audio notification for the background user interface component;

determining an audio effect to apply to the audio notification, the audio effect based on the position of the background user interface component in relation to the foreground user interface component;

applying the audio effect to the audio notification; and

presenting the audio notification with the audio effect.

17. The method of claim 16, wherein the audio effect includes a reverberation or an echo.

18. The method of claim 16, further comprising:

determining that the foreground user interface component has moved to anew position with respect to the background user interface component in the 3D parallax user interface;

determining a revised audio effect to apply to the audio notification, the revised audio effect based on the new position;

applying the revised audio effect to the audio notification to obtain a revised audio notification; and

presenting the revised audio notification.

19. The method of claim 16, wherein the background layer is a wallpaper of the 3D parallax user interface.

20. The method of claim 19, wherein the wallpaper includes a soundtrack, and wherein the method further comprises determining and applying an audio effect to apply to the soundtrack.