USER INTERFACE APPARATUS AND USER INTERFACE METHOD

• US 20160035315A1
• Filed: 04/15/2015
• Published: 02/04/2016
• Est. Priority Date: 07/29/2014
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: LEE, Jun Haeng, RYU, Eric Hyunsurk, SHIN, Chang Woo, WOO, Joo Yeon
• Granted Patent: US 9,947,289 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G09G 2340/12 Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
• CPC Class Codes: G09G 2340/125 wherein one of the images is motion video
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 2360/144 the light being ambient light
• CPC Class Codes: G09G 2380/02 Flexible displays
• CPC Class Codes: G09G 5/006 Details of the interface to the display terminal specific for a display terminal using a CRT G09G1/167; using a flat panel G09G3/2096; circuits for interfacing with colour displays G09G5/04
• CPC Class Codes: G09G 5/026 Control of mixing and/or overlay of colours in general G09G5/022 and G09G5/024 take precedence

Abstract

A user interface apparatus and a method of improving user interface are provided. The user interface apparatus may detect a change in an incident light and may control a display to represent the detected change in the light to be overlaid on image content. Provided is a user interface apparatus including: a display configured to display image content; a detector configured to detect a change in an incident light; and a controller configured to control the display to overlay the detected change in the light on the image content

Claims

1. A user interface apparatus comprising:

a display configured to display image content;

a detector configured to detect a change in an incident light; and

a controller configured to control the display to overlay the detected change in the light on the image content.

2. The user interface apparatus of claim 1, wherein the detector comprises an event-based vision sensor configured to detect an event where the incident light varies and configured to time-asynchronously generate a signal indicating the change in the light.

3. The user interface apparatus of claim 1, wherein the detector comprises:

a collector configured to collect the incident light; and

a generator configured to analyze the collected light and configured to generate a signal indicating the change in the light.

4. The user interface apparatus of claim 1, wherein the incident light varies due to moving of an object with respect to the user interface apparatus.

5. The user interface apparatus of claim 1, wherein the controller is configured to detect pixels corresponding to the change in the light from among a plurality of pixels of the display and is configured to control values of the detected pixels so that the overlaid change of the light is represented on the image content.

6. The user interface apparatus of claim 1, wherein the controller is configured to analyze the change in the light to minimize a portion in which the change in the light is represented to be overlaid on the image content.

7. The user interface apparatus of claim 1, wherein the controller is configured to generate information associated with an object present around a user based on the change in the light, and configured to control the display based on the generated information.

8. The user interface apparatus of claim 7, wherein the information associated with the object comprises at least one of a type of the object, a velocity of the object, a distance between the user and the object, and a location of the object.

9. The user interface apparatus of claim 1, wherein the controller is configured to determine whether the change in the light is caused by a hand of a user, and configured to process a user input based on the change in the light in response to the change in the light being determined to be caused by the hand of the user.

10. The user interface apparatus of claim 1, wherein the incident light comprises an incident light from a surrounding environment of the user interface apparatus.

18. The user interface apparatus of claim 1, wherein the input sound comprises an input sound from a surrounding environment of the user interface apparatus.

19. A mobile device comprising the user interface apparatus of claim 1.

20. A wearable device comprising the user interface apparatus of claim 1.

11. A user interface apparatus comprising:

a sound outputter configured to output sound content;

a detector configured to detect a change in an input sound; and

a controller configured to control the sound outputter to output the change in the input sound.

12. The user interface apparatus of claim 11, wherein the detector comprises an event-based auditory sensor configured to detect an event where the input sound varies and configured to time-asynchronously generate a signal indicating the change in the input sound .

13. The user interface apparatus of claim 11, wherein the detector comprises:

a sound collector configured to collect the input sound; and

a generator configured to analyze the collected sound and configured to generate a signal indicating the change in the input sound.

14. The user interface apparatus of claim 11, wherein the input sound varies due to moving of an object with respect to the user interface apparatus.

15. The user interface apparatus of claim 11, wherein the controller is configured to analyze the change in the input sound to minimize a duration of time in which the change in the input sound is output.

16. The user interface apparatus of claim 11, wherein the controller is configured to generate information associated with a sound source present around the user interface apparatus based on the change in the input sound and configured to control at least one of the display and the sound outputter based on the generated information.

17. The user interface apparatus of claim 16, wherein the information associated with the sound source comprises at least one of a type of the sound source and a location of the sound source.

21. A user interface method comprising:

displaying image content on a display;

detecting a change in an incident light; and

controlling the display to overlay the detected change in the light on the image content.

22. A user interface method comprising:

outputting sound content using a sound outputter;

detecting a change in an input sound; and

controlling the sound outputter to output the change in the input sound.

23. A user interface apparatus comprising:

a display configured to display image content;

a detector configured to detect an object surrounding the user interface apparatus; and

a controller configured to control the display to overlay the detected object on the image content and display the image content and the detected object.

24. The user interface apparatus of claim 23, wherein the detector is configured to detect the object by detecting a change of amount of light by the detector.

25. A user interface apparatus comprising:

a sound outputter configured to output sound content;

a detector configured to detect a change in external sound from a surrounding environment of the user interface apparatus; and

a controller configured to control the sound outputter to output the change in the external sound.