Information processing device, information processing method, and program for generating a notification sound

• US 10,445,059 B2
• Filed: 01/23/2013
• Issued: 10/15/2019
• Est. Priority Date: 02/03/2012
• Status: Expired due to Fees

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Miyazawa, Yusuke
• Primary Examiner(s): Klicos, Nicholas
• Application Number:
  US14/357,225
• Publication Number:
  US 20140304604A1
• Time in Patent Office: 2,456 Days
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Abstract

Provided is an information processing device including a display control unit configured to initiate a selective displaying of content screens, and a sound output control unit configured to generate localization information of a notification sound associated with a first content screen that is not currently being displayed and initiate an outputting of the notification sound to a user in accordance with the localization information while a second content screen is being displayed.

Claims

1. An information processing apparatus comprising:

a display control unit configured to

initiate a selective displaying of only active content screens of a plurality of content screens as a currently displaying screen that is displayed by a display unit, based on a user operation,

wherein the active content screens are screens arranged to be selectively displayed before an outputting of a notification sound; and

a sound output control unit configured to

generate localization information of the notification sound associated with activating a currently inactive application, and

initiate, when the notification sound is associated with activating a first content screen of the plurality of content screens that is an inactive screen and corresponding to the currently inactive application, the outputting of the notification sound, in accordance with the localization information, with a directivity that conveys to a user an operation direction for accessing the first content screen to enable a changing of the currently displaying screen from a second content screen of the active content screens to the first content screen,

wherein the inactive screen is a screen not arranged to be selectively displayed before the outputting of the notification sound associated with the currently inactive application is initiated,

wherein the display control unit is further configured to, after the outputting of the notification sound is initiated, activate, based on the user operation and corresponding to the operation direction, the first content screen so that the display control unit enables the selective displaying, based on the user operation, of the first content screen as the currently displaying screen, and

wherein the display control unit and the sound output control unit are each implemented via at least one processor.

2. The information processing apparatus of claim 1, wherein the first content screen is not being displayed when the sound output control unit initiates the outputting of the notification sound.

3. The information processing apparatus of claim 1, wherein the display control unit is further configured to initiate a selective changing of the currently displaying screen from the second content screen to the first content screen, based on a scroll operation initiated by the user and corresponding to the operation direction.

4. The information processing apparatus of claim 1, wherein the localization information indicates a sound source position of the notification sound.

5. The information processing apparatus of claim 4, wherein a volume of the notification sound is higher when the sound source position of the notification sound is located closer to the second content screen that is currently being displayed.

6. The information processing apparatus of claim 1, wherein the sound output control unit is further configured to initiate an outputting of the notification sound with a directivity that conveys to the user a relative location of the first content screen that is not currently being displayed relative to the second content screen that is currently displayed.

7. The information processing apparatus of claim 1, wherein the first content screen is generated after an occurrence of a triggering event upon which basis the notification sound is generated.

8. The information processing apparatus of claim 1, wherein the sound output control unit is further configured to generate updated localization information of the notification sound associated with the first content screen when the currently displaying screen changes to a third content screen from the second content screen.

9. The information processing apparatus of claim 8, wherein the sound output control unit is further configured to generate the localization information based on a distance between the second content screen that is currently being displayed and the third content screen that is not currently being displayed.

10. The information processing apparatus of claim 9, wherein the distance indicates a number of user operations for enabling the changing of the currently displaying screen from the second content screen to the first content screen.

11. The information processing apparatus of claim 9, wherein the distance indicates a number of changes of display screens for changing the second content screen to the first content screen.

12. The information processing apparatus of claim 8, wherein the third content screen is associated with an application that is open and active in the information processing apparatus.

13. The information processing apparatus of claim 8, wherein the third content screen is open and active in the information processing apparatus prior to an occurrence of a triggering event to which the notification sound is responsively generated.

14. The information processing apparatus of claim 1, wherein the display control unit is further configured to initiate a displaying of guidance information indicating an operation direction for initiating a displaying of the first content screen.

15. The information processing apparatus of claim 1, further comprising:

an operation unit configured to generate instructions for initiating the selective displaying of desired content screens of the plurality of content screens,

wherein the operation unit is implemented via at least one processor.

16. The information processing apparatus of claim 15, wherein the operation unit comprises a touch panel configured to receive a touch input from the user.

17. The information processing apparatus of claim 15, wherein the operation unit comprises a tilt sensor configured to acquire tilt information of a housing within which a display unit resides.

18. The information processing apparatus of claim 17, wherein the display control unit is further configured to initiate a change in a display orientation of the plurality of content screens, based on the acquired tilt information.

19. The information processing apparatus of claim 18, wherein the sound output control unit is further configured to generate updated localization information of the notification sound upon initiation of the change in the display orientation of the plurality of content screens.

20. The information processing apparatus of claim 1, wherein a relative location of the first content screen relative to the second content screen is restricted to selected directions emanating away from the second content screen.

21. The information processing apparatus of claim 20, wherein the relative location of the first content screen relative to the second content screen is restricted to positions vertically displaced from the second content screen.

22. The information processing apparatus of claim 20, wherein the relative location of the first content screen relative to the second content screen is restricted to positions horizontally displaced from the second content screen.

23. The information processing apparatus of claim 1, wherein the first content screen is related to a notification associated with the currently inactive application.

24. The information processing apparatus of claim 1, wherein the sound output control unit is further configured to generate the localization information based on a number of the plurality of content screens between the second content screen that is currently being displayed and the first content screen that is not currently being displayed.

25. The information processing apparatus of claim 1, wherein the sound output control unit configured to

initiate, when the notification sound is associated with a third content screen of the active content screens, the outputting of the notification sound, in accordance with the localization information, with a directivity that conveys to the user the operation direction for accessing the third content screen and a volume that conveys a distance between the third content screen and the currently displaying screen to enable the changing of the currently displaying screen from the second content screen that is currently being displayed to the third content screen.

26. The information processing apparatus of claim 25, wherein, when the notification sound is associated with activating the first content screen, the notification sound includes only the directivity, and when the notification sound is associated with activating the third content screen, the notification sound includes the directivity and the distance.

27. An information processing apparatus comprising:

a display unit configured to

selectively display only active content screens of a plurality of content screens as a currently displaying screen that is displayed by a display unit, based on a user operation,

wherein the active content screens are screens arranged to be selectively displayed before an outputting of a notification sound;

a sound output control unit configured to generate localization information of the notification sound associated with activating a currently inactive application; and

a sound output unit configured to output, when the notification sound is associated with activating a first content screen of the plurality of content screens that is an inactive screen and corresponding to the currently inactive application, in accordance with the localization information, the notification sound with a directivity that conveys to a user an operation direction for accessing the first content screen to enable a changing of the currently displaying screen from a second content screen of the active content screens to the first content screen,

wherein the inactive screen is a screen not arranged to be selectively displayed before the outputting of the notification sound associated with the currently inactive application is initiated,

wherein the display unit is further configured to, after the outputting of the notification sound, activate, based on the user operation and corresponding to the operation direction, the first content screen so that the display unit enables the selective displaying, based on the user operation, of the first content screen as the currently displaying screen, and

wherein the display unit, the sound output control unit, and the sound output unit are each implemented via at least one processor.

28. An information processing method comprising:

enabling selective displaying of only active screens of a plurality of content screens as a currently displaying screen, based on a user operation,

wherein the active content screens are screens arranged to be selectively displayed before an outputting of a notification sound;

generating localization information of the notification sound associated with activating a currently inactive application;

outputting, when the notification sound is associated with activating a first content screen, of the plurality of content screens, that is an inactive screen and corresponding to the currently inactive application, in accordance with the localization information, the notification sound with a directivity that conveys to a user an operation direction for accessing the first content screen to enable a changing of the currently displaying screen from a second content screen of the active content screens to the first content screen,

wherein the inactive screen is a screen not arranged to be selectively displayed before the outputting of the notification sound associated with the currently inactive application is initiated; and

after the outputting of the notification sound, activating, based on the user operation and corresponding to the operation direction, the first content screen to enable the selective displaying, based on the user operation, of the first content screen as the currently displaying screen.

29. The information processing method of claim 28, wherein the notification sound is output with a directivity that conveys to the user a relative location of the first content screen that is not currently being displayed relative to the second content screen that is currently being displayed.

30. The information processing method of claim 28, wherein the first content screen is created after an occurrence of a triggering event upon which basis the notification sound is generated.

31. A non-transitory computer-readable medium embodied with a program, which when executed by a computer, causes the computer to perform a method comprising:

enabling selective displaying of only active screens of a plurality of content screens as a currently displaying screen, based on a user operation,

wherein the active content screens are screens arranged to be selectively displayed before an outputting of a notification sound;

generating localization information of the notification sound associated with activating a currently inactive application;

outputting, when the notification sound is associated with activating a first content screen, of the plurality of content screens, that is an inactive screen and corresponding to the currently inactive application, in accordance with the localization information, the notification sound with a directivity that conveys to a user an operation direction for accessing the first content screen to enable a changing of the currently displaying screen from a second content screen of the active content screens to the first content screen,

wherein the inactive screen is a screen not arranged to be selectively displayed before the outputting of the notification sound associated with the currently inactive application is initiated; and

after the outputting of the notification sound, activating, based on the user operation and corresponding to the operation direction, the first content screen to enable the selective displaying, based on the user operation, of the first content screen as the currently displaying screen.