User interface apparatus and user interface method

• US 10,665,203 B2
• Filed: 04/13/2018
• Issued: 05/26/2020
• Est. Priority Date: 07/29/2014
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Lee, Jun Haeng, Ryu, Eric Hyunsurk, Shin, Chang Woo, Woo, Joo Yeon
• Primary Examiner(s): Amini, Javid A
• Application Number:
  US15/952,944
• Publication Number:
  US 20180233104A1
• Time in Patent Office: 774 Days
• Field of Search: 345629
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G09G 2340/12 Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
• CPC Class Codes: G09G 2340/125 wherein one of the images is motion video
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 2360/144 the light being ambient light
• CPC Class Codes: G09G 2380/02 Flexible displays
• CPC Class Codes: G09G 5/006 Details of the interface to the display terminal specific for a display terminal using a CRT G09G1/167; using a flat panel G09G3/2096; circuits for interfacing with colour displays G09G5/04
• CPC Class Codes: G09G 5/026 Control of mixing and/or overlay of colours in general G09G5/022 and G09G5/024 take precedence

Abstract

A user interface apparatus and a method of improving user interface are provided. The user interface apparatus may detect a change in an incident light and may control a display to represent the detected change in the light to be overlaid on image content. Provided is a user interface apparatus including: a display configured to display image content; a detector configured to detect a change in an incident light; and a controller configured to control the display to overlay the detected change in the light on the image content.

Claims

1. A user interface apparatus comprising:

a sound outputter configured to output audible sound content from a first source, the sound content of the first source being unrelated to a surrounding environment of the user interface apparatus;

a detector implemented by at least one auditory sensor and configured to detect a change in an audible input sound from a second source different from the first source, the input sound from the second source being generated from the surrounding environment of the user interface apparatus; and

a controller implemented by at least one hardware processor and configured to control the sound outputter to output the change in the audible input sound while continuously outputting the audible sound content.

2. The user interface apparatus of claim 1, wherein the detector comprises a microphone configured to detect an event where the input sound varies and configured to time-asynchronously generate a signal indicating the change in the input sound.

3. The user interface apparatus of claim 1, wherein the detector comprises:

a sound collector configured to collect the input sound; and

a generator configured to analyze the collected sound and configured to generate a signal indicating the change in the input sound.

4. The user interface apparatus of claim 1, wherein the input sound varies due to moving of an object with respect to the user interface apparatus.

5. The user interface apparatus of claim 1, wherein the controller is configured to analyze the change in the input sound to minimize a duration of time in which the change in the input sound is output.

6. The user interface apparatus of claim 1, wherein the controller is configured to generate information associated with a sound source present around the user interface apparatus based on the change in the input sound and configured to control at least one of a display and the sound outputter based on the generated information.

7. The user interface apparatus of claim 6, wherein the information associated with the sound source comprises at least one of a type of the sound source and a location of the sound source.

8. The user interface apparatus of claim 1, wherein the controller is configured to control the sound outputter to reduce a volume of the audible sound content while outputting the change in the input sound.

9. A mobile device comprising the user interface apparatus of claim 1.

10. A wearable device comprising the user interface apparatus of claim 1.

16. The user interface apparatus of claim 1, wherein the controller is further configured to control the sound outputter, based on a determination that a level of the change in the input sound satisfies a predetermined threshold condition, to output the change in the input sound while continuously outputting the audible sound content.

17. The user interface apparatus of claim 1, wherein the controller is further configured to control the sound outputter, based on a change in a volume of the input sound, to output the change in the input sound while continuously outputting the audible sound content.

18. The user interface apparatus of claim 1, wherein the controller is further configured to control the sound outputter, based on a change in a frequency of the input sound, to output the change in the input sound while continuously outputting the audible sound content.

19. The user interface apparatus of claim 17, wherein the controller is further configured to control the sound outputter, based on an increase or a decrease in the volume of the input sound, to output the change in the input sound while continuously outputting the audible sound content.

20. The user interface apparatus of claim 18, wherein the controller is further configured to control the sound outputter, based on an increase or a decrease in the frequency of the input sound, to output the change in the input sound while continuously outputting the audible sound content.

11. A user interface method comprising:

outputting audible sound content using a sound outputter implemented by a speaker, the audible sound content being provided by a first source and being unrelated to a surrounding environment of a user interface apparatus being held by a user;

detecting, by a detector implemented by at least one auditory sensor, a change in an input sound from a second source different from the first source, the input sound from the second source being generated from the surrounding environment of the user interface apparatus; and

controlling, by a controller implemented by at least one hardware processor, the sound outputter to output the change in the input sound while continuously outputting the audible sound content.

12. The user interface method of claim 11, wherein the controlling comprises controlling the sound outputter to reduce a volume of the audible sound content while outputting the change in the input sound.

13. A non-transitory computer-readable medium comprising a program configured to instruct a computer to perform the method of claim 11.

14. A user interface apparatus comprising:

a sound outputter implemented by a speaker and configured to output audible sound content, the audible sound content being unrelated to a surrounding environment of the user interface apparatus;

a detector implemented by at least one auditory sensor and configured to detect a change in external sound of the surrounding environment of the user interface apparatus; and

a controller implemented by at least one hardware processor and configured to control the sound outputter to output the change in the external sound while continuously outputting the audible sound content.

15. The user interface apparatus of claim 14, wherein the detector is further configured to detect an event where the external sound varies and to time-asynchronously generate a signal indicating the change in the external sound.