METHOD FOR CONTROLLING CAMERA OPERATION BASED ON HAPTIC FUNCTION AND TERMINAL SUPPORTING THE SAME

• US 20140192247A1
• Filed: 01/07/2014
• Published: 07/10/2014
• Est. Priority Date: 01/07/2013
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: CHEONG, Cheolho, Koh, Dongjin
• Granted Patent: US 9,667,870 B2
• Time in Patent Office: Days
• US Class Current: 348/333.11
• CPC Class Codes: G03B 37/02 with scanning movement of lens or cameras
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 5/772 the recording apparatus and the television camera being placed in the same enclosure

Abstract

A method for providing camera operations using a haptic function, and an electronic device implementing the same are provided. The method of operating the electric device includes receiving, by an electronic device including a camera, an input to activate the camera; receiving a request to output guidance information for assisting with photographing with the camera; determining haptic feedback corresponding to the guidance information; and outputting the determined haptic feedback.

Claims

1. A method for operating an electric device, the method comprising:

receiving, by an electronic device including a camera, an input to activate the camera;

receiving a request to output guidance information for assisting with photographing with the camera;

determining haptic feedback corresponding to the guidance information; and

outputting the determined haptic feedback.

2. The method of claim 1, wherein determining the haptic feedback comprises:

calculating a virtual image area to be photographed in sequence based on a previously photographed image;

calculating correlation information between a current preview area and the virtual image area; and

determining the haptic feedback according to the correlation information.

3. The method of claim 2, wherein determining the haptic feedback comprises determining the haptic feedback such that the haptic feedback guides a user to move the camera so that the current preview area becomes identical to the virtual image area.

4. The method of claim 2, wherein the correlation information includes at least one of a distance between an image of the current preview area and the virtual image, angle difference, directional nature, overlapping nature, overlapping ratio of boundary line, overlapping ratio of area, overlapping area of volume, overlapped area, or length of overlapped boundary line.

5. The method of claim 2, wherein determining the haptic feedback determines a type or amplitude of haptic feedback according to the size of the correlation information.

6. The method of claim 1, wherein determining the haptic feedback comprises adjusting at least one of a strength, amplitude, intensity, frequency, duration, time, period, pattern, number of vibrations, temperature, air pressure, or electrostatics of the haptic feedback.

7. The method of claim 1, further comprising collecting context information including at least one of a terminal grip or contact location, camera location, camera state, angle, azimuth, rotation, service state, camera movement, object movement, GPS, geomagnetism, gyro compass, acceleration, angular velocity, horizontality, contact detection, expansion ratio, focusing information, motion recognition, or distance to object.

8. The method of claim 1, wherein determining the haptic feedback comprises adjusting at least one of a predefined strength, pattern, frequency, or drive order of a plurality of haptic devices.

9. The method of claim 7, wherein determining the haptic feedback comprises providing the haptic feedback including at least one of a terminal contact location obtained in the collection of context information, or an adjacent location within a predetermined distance from the terminal contact location.

10. The method of claim 1, wherein the guidance information includes information for facilitating with at least one of a panorama image photography mode, an action shot image photography mode, a face recognition mode, an image-based barcode recognition mode, or a card recognition mode.

11. The method of claim 10, further comprising:

selecting the panorama image photography mode or the action shot image photography mode;

deactivating components related to the haptic feedback after activating the camera; and

,

activating the components related to the haptic feedback if a first image is photographed.

12. The method of claim 10, further comprising:

selecting the panorama image photography mode;

identifying whether motion information of a specific object is included in a preview image; and

,

outputting a haptic feedback warning while temporarily stopping storing and synthesizing an image if the motion information is included.

13. The method of claim 10, further comprising:

selecting the action shot image photography mode;

identifying whether motion information of specific object is included in a preview image; and

calculating an estimated motion of object and outputting a haptic feedback based on the calculation if the motion information is included.

14. An electronic device, comprising:

a camera configured to obtain an image;

a processor configured to determine haptic feedback corresponding to guidance information for assisting with photographing with the camera, if an output of the guidance information is requested; and

a haptic device module configured to output the determined haptic feedback.

15. The electronic device of claim 14, wherein the processor is further configured to:

calculate a virtual image area to be photographed in sequence based on a previously photographed image;

calculate correlation information between a current preview area and the virtual image area; and

determine the haptic feedback according to the correlation information.

16. The electronic device of claim 15, wherein the processor determines the haptic feedback by instructing so that the current preview area becomes identical to the virtual image area.

17. The electronic device of claim 15, wherein the correlation information includes at least one of a distance between an image of the current preview area and the virtual image, angle difference, directional nature, overlapping nature, overlapping ratio of boundary line, overlapping ratio of area, overlapping area of volume, overlapped area, or length of overlapped boundary line.

18. The electronic device of claim 15, wherein the processor determines a type and amplitude of haptic feedback differently according to a size of the correlation information.

19. The electronic device of claim 14, further comprising a context information collecting module configured to collect information including at least one of a terminal grip or contact location, camera location, camera state, angle, azimuth, rotation, service state, camera movement, object movement, GPS, geomagnetism, gyro compass, acceleration, angular velocity, horizontality, contact detection, expansion ratio, focusing information, motion recognition, or distance to object.

20. The electronic device of claim 19, wherein the processor determines the haptic feedback by adjusting at least one of a predefined strength, pattern, frequency, or drive order of a plurality of haptic devices.

21. The electronic device of claim 19, wherein the processor controls to provide the haptic feedback including at least one of a terminal contact location obtained in the collecting context information, or an adjacent location within a predetermined distance from the terminal contact location.

22. The electronic device of claim 14, further comprising an input unit configured to generate an input signal or a display unit having an input function to select at least one of a panorama image photography mode, action shot image photography mode, face recognition mode, image-based barcode recognition mode, or card recognition mode.

23. The electronic device of claim 22, wherein the processor deactivates components related to the haptic feedback after activating the camera, and activates the components related to the haptic feedback after a first image is photographed, if the panorama image photography mode or action shot image photography mode is selected.

24. The electronic device of claim 22, wherein the processor temporarily stops storing and synthesizing an image, and outputs a haptic feedback warning, if motion information of a specific object is identified to be included in a preview image when the panorama image photography mode is selected.

25. The electronic device of claim 22, wherein the processor calculates an estimated motion of an object and controls to output haptic feedback warning based on the calculation, if motion information of a specific object is identified to be included in a preview image when the action shot image photographing mode is selected.

26. The electronic device of claim 14, wherein the haptic device module comprises at least one of a motor, vibrator, mechanical, electromechanical, electromagnetic, piezoelectric, acoustic generator, heat generator, cooler, pneumatic, or microfluidic haptic device.

27. The electronic device of claim 26, wherein the processor controls to output the determined haptic feedback by applying at least one of a strength of haptic, frequency, duration time, period, pattern, number of vibration, temperature, air pressure, or electrostatics of the haptic devices.

28. A method of operating an electronic device, the method comprising:

receiving, by an electronic device including a camera and one or more haptic devices, an input to activate the camera;

determining, by the electronic device, one or more of a desired position, orientation, or movement of the electronic device for an operation of the camera; and

activating, by the electronic device, at least one of the one or more haptic devices, based on the determined one or more of the desired position, orientation, or movement.

29. The method of claim 28, wherein the electronic device further comprises a sensor configured to determine at least one of a position or an orientation of the electronic device, and wherein determining the one or more of the desired position, orientation, or movement comprises using at least one of the sensor or an image provided by the camera.

30. The method of claim 28, wherein activating the at least one of the one or more haptic devices comprises selecting the at least one of the one or more the haptic devices, which corresponds to the one or more of the desired position, orientation, or movement.

31. An electronic device comprising:

a camera configured to obtain an image;

a processor configured to receive an input to activate the camera, and to determine one or more of a desired position, orientation, or movement of the electronic device for an operation of the camera; and

one or more haptic devices,

wherein the processor is further configured to activate at least one of the one or more haptic devices, based on the determined one or more of the desired position, orientation, or movement.

32. The electronic device of claim 31, further comprising a sensor configured to determine at least one of a position or orientation of the electronic device,

wherein the processor is further configured to determine the one or more of the desired position, orientation, or movement using at least one of the sensor or an image provided by the camera.

33. The electronic device of claim 31, wherein the processor is further configured to select the at least one of the one or more the haptic devices corresponding to the one or more of the desired position, orientation, or movement.

34. The electronic device of claim 31, wherein the processor is further configured to determine an object movement using one or more images provided by the camera, to determine one or more of a position or a movement direction of the object, and to determine the one or more of the desired position, orientation, or movement of the electronic device using the one or more of the position or the movement direction of the object.