Camera orientation notification system

• US 9,800,778 B2
• Filed: 07/21/2015
• Issued: 10/24/2017
• Est. Priority Date: 07/21/2015
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Haehnichen, Steven
• Primary Examiner(s): Daniels, Anthony J
• Application Number:
  US14/805,076
• Publication Number:
  US 20170026568A1
• Time in Patent Office: 826 Days
• Field of Search: 34833302
• CPC Class Codes: F16M 13/04 for supporting on, or holding steady relative to, a person, e.g. by chains , e.g. rifle butt or pistol grip supports, supports attached to the chest or head apparatus or arrangements for taking photographs or for projecting or viewing them G03B
• CPC Class Codes: G03B 17/18 Signals indicating condition of a camera member or suitability of light indicating depth of field G03B13/30
• CPC Class Codes: G03B 17/561 Support related camera accessories
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G08B 3/10 using electric transmission; using electromagnetic transmission
• CPC Class Codes: G08B 6/00 Tactile signalling systems, e.g. personal calling systems
• CPC Class Codes: H04N 23/60 Control of cameras or camera modules
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 23/66 Remote control of cameras or camera parts, e.g. by remote control devices
• CPC Class Codes: H04N 23/68 for stable pick-up of the scene, e.g. compensating for camera body vibrations

Abstract

This disclosure provides systems, methods, and apparatus, including computer programs encoded on computer storage media, for notifying a user when a device including a camera has moved from a desired orientation. The orientation of the camera can be determined by one or more sensors and/or image processing techniques. The user may be notified with a non-visual cue, such as an audible sound or a haptic alert. In some aspects, a user may be notified when the device including the camera is substantially level.

Claims

1. A system comprising:

a device having at least one camera, the device capable of being secured to a mount to secure the device in a desired orientation;

an orientation sensor configured to determine the orientation of the device with respect to the mount at least in part by comparing an image characteristic of at least a portion of a captured image with respect to other portions of the captured image; and

a processor in communication with the orientation sensor and configured to trigger a notification when the orientation of the device changes with respect to the mount.

2. The system of claim 1, wherein the processor is further configured to trigger a notification when the orientation sensor determines that the camera is substantially level with respect to a horizon line.

3. The system of claim 1, additionally comprising a notification unit disposed within the device having at least one camera.

4. The system of claim 1, wherein the device comprises a phone.

5. The system of claim 1, wherein the orientation sensor is disposed within the device having at least one camera.

6. The system of claim 1, wherein the orientation sensor comprises at least one accelerometer or at least one gyroscope.

7. The system of claim 1, wherein the orientation sensor comprises an image processor configured to determine whether a reference line in a frame of captured image data is substantially level.

8. The system of claim 1, wherein the notification is non-visual.

9. The system of claim 8, wherein the non-visual notification comprises an audible sound.

10. The system of claim 8, wherein the non-visual notification comprises a haptic alert.

11. The system of claim 1, wherein the camera is in a location with respect to a user such that the user cannot visually monitor the orientation of the camera.

12. The system of claim 1, wherein the processor triggers a notification by providing a signal to a separate device which performs the haptic alert.

13. The system of claim 1, wherein the processor is disposed within the mount.

14. The system of claim 13, wherein the orientation sensor is disposed within the mount.

15. The system of claim 1, wherein the orientation sensor is configured to determine the orientation of the device with respect to the mount at least in part by comparing the relative brightness or luminance of pixels within at least a portion of the captured image with respect to the relative brightness or luminance of pixels within other portions of the captured image.

16. The system of claim 1, wherein the orientation sensor is configured to determine the orientation of the device with respect to the mount at least in part by comparing the color of pixels within at least a portion of the captured image with respect to the color of pixels within other portions of the captured image.

17. The system of claim 1, wherein the orientation sensor is configured to determine the orientation of the device with respect to the mount at least in part by identifying a separation in contrast within the captured image.

18. The device of claim 1, wherein the at least one camera comprises the orientation sensor.

19. A method comprising:

determining the orientation of a camera secured to a mount at least in part by comparing an image characteristic of at least a portion of a captured image with respect to at least one other portion of the captured image;

triggering the emission of a first non-visual cue when the camera is substantially level with respect to a horizon line; and

triggering the emission of a second non-visual cue when the camera moves with respect to the mount.

20. The method of claim 19, wherein the camera is configured to be secured in a location with respect to a user such that the user cannot visually monitor the orientation of the camera.

21. The method of claim 19, wherein the first non-visual cue is different from the second non-visual cue.

22. The method of claim 19, wherein the comparing step includes capturing at least a first image with the camera and processing the captured image.

23. The method of claim 22, wherein the comparing step includes capturing at least a second image with the camera and comparing the second captured image with the first captured image.

24. The method of claim 19, wherein the signal triggers a separate device to trigger the emission of a first non-visual cue.

25. The method of claim 19, wherein comparing an image characteristic of at least a portion of the captured image with respect to other portions of the captured image comprises comparing the relative brightness or luminance of pixels within at least a portion of the captured image with respect to the relative brightness or luminance of pixels within other portions of the captured image.

26. The method of claim 19, wherein comparing an image characteristic of at least a portion of the captured image with respect to other portions of the captured image comprises comparing the color of pixels within at least a portion of the captured image with respect to the color of pixels within other portions of the captured image.

27. The method of claim 19, wherein comparing an image characteristic of at least a portion of the captured image with respect to other portions of the captured image comprises identifying a separation in contrast within the captured image.