METHOD AND APPARATUS FOR DISPLAYING SCREEN IN RESPONSE TO EVENT RELATED TO MOTION OF EXTERNAL OBJECT

• US 20160109955A1
• Filed: 05/22/2015
• Published: 04/21/2016
• Est. Priority Date: 10/21/2014
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: PARK, Keun Joo, RYU, Eric Hyunsurk, LEE, Kyoobin, LEE, Jun Haeng
• Granted Patent: US 9,983,681 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06F 3/147 using display panels
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G09G 2320/0261 in the context of movement of objects on the screen or movement of the observer relative to the screen
• CPC Class Codes: G09G 2340/0464 Positioning
• CPC Class Codes: G09G 5/00 Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T

Abstract

A method and an apparatus for displaying a screen in response to an event related to a motion of an external object, are provided. The method includes generating an event signal in response a motion of an external object being sensed, sensing a movement of the external object relative to an apparatus based on the event signal, and displaying a screen based on the movement of the external object.

Claims

1. A method for displaying a screen, the method comprising:

generating an event signal in response a motion of an external object being sensed;

sensing a movement of the external object relative to an apparatus based on the event signal; and

displaying a screen based on the movement of the external object.

2. The method of claim 1, wherein the displaying comprises moving the screen based on the movement of the external object.

3. The method of claim 1, wherein the displaying comprises determining at least one of a moving direction, a moving distance, and a moving velocity of the screen based on at least one of a moving direction, a moving distance, and a moving velocity of the external object.

4. The method of claim 1, wherein the displaying comprises magnifying a region of the screen based on the movement of the external object.

5. The method of claim 1, wherein the displaying comprises magnifying a region of the screen in response to a moving velocity of the external object being sensed to be greater than a threshold velocity.

6. The method of claim 1, wherein the displaying comprises moving the screen in response to a moving velocity of the external object being sensed to be less than or equal to a threshold velocity.

7. The method of claim 1, wherein the displaying comprises displaying the screen based on a number of times that the external object is shaken during a period of time.

8. The method of claim 1, wherein the generating comprises generating the event signal in response to an event being sensed, and

wherein the sensing comprises:

generating an event map comprising a map element corresponding to the event signal,

determining, based on the event map, an optical flow comprising a velocity vector corresponding to the map element, and

sensing the movement of the external object based on the determined optical flow.

9. The method of claim 1, wherein the sensing comprises:

generating an event frame by storing the event signal during a time window;

extracting a region of interest (ROI) from the event frame;

determining an optical flow corresponding to the ROI; and

sensing the movement of the external object based on the determined optical flow.

10. The method of claim 1, wherein the sensing comprises:

generating an event frame by storing the event signal during a time window;

extracting a region of interest (ROI) from the event frame; and

sensing the movement of the external object based on a movement of the ROI.

11. The method of claim 1, further comprising:

sensing an acceleration of the apparatus; and

sensing a tilt of the apparatus,

wherein the displaying comprises displaying the screen based on the acceleration, the tilt, and the movement of the external object.

12. A non-transitory computer-readable recording medium that stores a program that is executable by a computer to perform the method of claim 1.

13. An apparatus comprising:

an event sensor configured to generate an event signal in response to a motion of an external object being sensed;

a processor configured to sense a movement of the external object relative to the apparatus based on the event signal; and

a display configured to display a screen based on the movement of the external object.

14. The apparatus of claim 13, wherein the processor is configured to control the display to move the screen based on the movement of the external object.

15. The apparatus of claim 13, wherein the processor is configured to control the display to magnify a region of the screen based on the movement of the external object.

16. The apparatus of claim 13, wherein the processor is configured to control the display to display the screen based on a number of times that the external object is shaken during a period of time.

17. The apparatus of claim 13, wherein the event sensor comprises a plurality of sensing elements, each of the plurality of sensing elements being configured to generate the event signal in response to an event being sensed, and

wherein the processor is configured to:

generate an event map comprising a map element corresponding to the event signal,

determining, based on the event map, an optical flow comprising a velocity vector corresponding to the map element, and

sense the movement of the external object based on the determined optical flow.

18. The apparatus of claim 13, wherein the processor is configured to:

generate an event frame by storing the event signal during a time window;

extract a region of interest (ROI) from the event frame;

determine an optical flow corresponding to the ROI; and

sense the movement of the external object based on the determined optical flow.

19. The apparatus of claim 13, wherein the processor is configured to:

generate an event frame by storing the event signal during a time window;

extract a region of interest (ROI) from the event frame; and

sense the movement of the external object based on a movement of the ROI.

20. The apparatus of claim 13, further comprising:

an acceleration sensor configured to sense an acceleration of the apparatus; and

a tilt sensor configured to sense a tilt of the apparatus,

wherein the display is configured to display the screen based on the acceleration, the tilt, and the movement of the external object.

21. The apparatus of claim 13, wherein the display is a head mounted display configured to be mounted on a head of a user to display the screen.