Visibility enhancement devices, systems, and methods

• US 10,417,496 B2
• Filed: 02/07/2018
• Issued: 09/17/2019
• Est. Priority Date: 02/27/2015
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Tokutake, Kenji
• Primary Examiner(s): Le, Vu
• Assistant Examiner(s): Rivera-Martinez, Guillermo M
• Application Number:
  US15/890,783
• Publication Number:
  US 20180239963A1
• Time in Patent Office: 587 Days
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 2201/07 Target detection
• CPC Class Codes: G06V 2201/10 Recognition assisted with metadata
• CPC Class Codes: H04M 1/72403 with means for local support of applications that increase the functionality
• CPC Class Codes: H04M 2250/52 including functional features of a camera
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/631 Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 23/634 Warning indications
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 7/188 Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position signal generation from motion picture films H04N5/253

Abstract

Embodiments include systems of and methods for an electronic device having a camera configured to capture image data, a display configured to display the captured image data and content corresponding to an application of the electronic device, and a motion sensor configured to detect motion of the electronic device. The electronic device also includes circuitry configured to activate the camera when motion is detected by the motion sensor, and control the display to display at least a portion of the captured image data at a size proportional to an amount of motion as detected by an output of the motion sensor.

Claims

1. An electronic device, comprising:

a camera configured to capture image data;

a display;

a motion sensor configured to detect motion of the electronic device; and

circuitry configured to

control the display to display a content corresponding to an application of the electronic device in response to an output of the motion sensor indicating that the electronic device is in a static state;

control the camera to be activated and control the display to display the content in a first area of the display and the captured image data in a second area of the display in response to the output of the motion sensor indicating that the electronic device is in a walking state; and

control the camera to be activated and control the display to display the captured image data without display of the content in response to the output of the motion sensor indicating that the electronic device is in a running state.

2. The electronic device of claim 1, wherein the circuitry is further configured to detect an approaching object from the captured image data of the camera and to issue a warning of the approaching object.

3. The electronic device of claim 2, wherein the circuitry is further configured to detect a motion vector of the approaching object from the captured image data of the camera.

4. The electronic device of claim 2, wherein the issued warning comprises one or more of an illumination of the approaching object, a flashing approaching object, an audible signal, or a vibratory signal.

5. The electronic device of claim 1, wherein the motion sensor is further configured to detect a change in a viewing direction of the camera.

6. The electronic device of claim 5, wherein the circuitry is further configured to detect the change in viewing direction of the camera and to adjust a motion vector of an approaching object according to the change in viewing direction.

7. The electronic device of claim 1, wherein the circuitry is further configured to detect an approaching object out of view of the camera based on a time and position of the approaching object from previously captured images.

8. The electronic device of claim 1, wherein the electronic device comprises a handheld electronic device.

9. The electronic device of claim 1, wherein the electronic device comprises a head-mounted electronic device.

10. The electronic device of claim 9, wherein the circuitry is further configured to determine when the electronic device changes a position from a seated user-perspective position to a standing user-perspective position.

11. The electronic device of claim 10, wherein the circuitry is further configured to control the display to change from display of a full image of the content while in the seated user-perspective position to a combined image of the content and a transparent image of the electronic device'"'"'s surroundings while in the standing user-perspective position, wherein a back layer of the display is viewable through the transparent image.

12. The electronic device of claim 10, wherein the circuitry is further configured to determine when the electronic device changes to the running state and to display a full image of the electronic device'"'"'s surroundings.

15. The electronic device of claim 1, wherein the motion sensor is configured to detect a cycle of vibration of the electronic device.

16. The electronic device of claim 15, wherein the circuitry is configured to detect a change of the state of a user and activate the camera based on the cycle of vibration detected by the motion sensor.

17. The electronic device of claim 1, wherein the motion sensor is configured to detect a size and cycle of vibration of the electronic device.

18. The electronic device of claim 17, wherein the circuitry is configured to detect a change of the state of a user and activate the camera based on the cycle of vibration detected by the motion sensor.

19. The electronic device of claim 18, wherein the circuitry is configured to control the display to display at least a portion of the captured image data at a size that increases as the size and cycle of vibration of the electronic device increases.

13. A method of using an electronic device including a camera, a display, a motion sensor, and circuitry, the method comprising:

capturing image data with the camera;

detecting, using the motion sensor, motion of the electronic device;

controlling, using the circuitry, the display to display a content corresponding to an application of the electronic device in response to an output of the motion sensor indicating that the electronic device is in a static state;

controlling, using the circuitry, the camera to be activated and the display to display the content in a first area of the display and the captured image data in a second area of the display in response to the output of the motion sensor indicating that the electronic device is in a walking state; and

controlling, using the circuitry, the camera to be activated and the display to display the captured image data without display of the content in response to the output of the motion sensor indicating that the electronic device is in a running state.

14. A non-transitory, computer-readable storage medium storing instructions that, when executed on an electronic device including a camera, a display, a motion sensor, and circuitry, control the electronic device to carry out a method comprising:

capturing image data with the camera;

detecting, using the motion sensor, motion of the electronic device;

controlling, using the circuitry, the display to display a content corresponding to an application of the electronic device in response to an output of the motion sensor indicating that the electronic device is in a static state;

controlling, using the circuitry, the camera to be activated and the display to display the content in a first area of the display and the captured image data in a second area of the display in response to the output of the motion sensor indicating that the electronic device is in a walking state; and

controlling, using the circuitry, the camera to be activated and the display to display the captured image data without display of the content in response to the output of the motion sensor indicating that the electronic device is in a running state.