Electronic device and method for controlling the electronic device

• US 10,735,820 B2
• Filed: 09/14/2017
• Issued: 08/04/2020
• Est. Priority Date: 10/10/2016
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd. (Samsung Group)
• Original Assignee: Samsung Electronics Co. Ltd. (Samsung Group)
• Inventors: Kim, Soo-hong, Shin, Su-won, Kim, Ki-suk
• Primary Examiner(s): Krasnic, Bernard
• Application Number:
  US15/704,180
• Publication Number:
  US 20180103299A1
• Time in Patent Office: 1,055 Days
• Field of Search: None
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/147 using display panels
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 2207/20092 Interactive image processing based on input by user
• CPC Class Codes: G06T 2207/30208 Marker matrix
• CPC Class Codes: G06T 2207/30244 Camera pose
• CPC Class Codes: G06T 7/194 involving foreground-background segmentation
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06T 7/80 Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
• CPC Class Codes: H04N 21/485 End-user interface for client configuration
• CPC Class Codes: H04N 21/4854 for modifying image parameters, e.g. image brightness, contrast
• CPC Class Codes: H04N 21/4858 for modifying screen layout parameters, e.g. fonts, size of the windows
• CPC Class Codes: H04N 21/8153 comprising still images, e.g. texture, background image
• CPC Class Codes: H04N 5/445 for displaying additional information H04N5/50 takes precedence

Abstract

An electronic device and a method for controlling the electronic device are provided. The method includes acquiring an image comprising a guide member positioned in an area at which a display device is to be installed; displaying the acquired image; analyzing a background area of the acquired image, the background area being positioned within the guide member in the acquired image; and acquiring information about a background image that is to be displayed in the background area of the acquired image.

Claims

1. A method for controlling an electronic device, the method comprising:

acquiring an image comprising a guide member for guiding a position at which a display device is to be placed, wherein the image of the guide member comprises an image of a plurality of marks that are physically located on the guide member;

displaying the acquired image;

displaying a plurality of indicators to be laid over the image of the plurality of marks;

prompting a user to adjust a camera to place the plurality of marks of the guide member within the plurality of indicators, respectively;

analyzing a background area within the guide member of the acquired image;

acquiring information about a background image that is to be displayed on the display device based on the background area; and

displaying, on the display device, the background image based on the information about the background image,

wherein the guide member is a physical component having a frame-like shape with an empty space therein for acquiring an image of an area behind the display device to be placed at the guided position.

2. The method as claimed in claim 1, wherein a shape of the guide member corresponds to a shape of the display device and the guide member includes the plurality of marks formed in corner areas of the guide member,

wherein the displaying the plurality of indicators comprises displaying the plurality of indicators that guides positions of the plurality of marks of the guide member, and

wherein in response to identifying that the plurality of marks of the guide member are positioned at the plurality of indicators in the acquired image, the analyzing the background area of the acquired image is performed.

3. The method as claimed in claim 2, wherein the acquiring the information about the background image comprises:

identifying whether a shape of the guide member included in the acquired image corresponds to the shape of the display device based on positions and sizes of the plurality of marks included in the acquired image; and

in response to the shape of the guide member included in the acquired image corresponding to the shape of the display device, performing the acquiring information about the background image based on the background area of the acquired image.

4. The method as claimed in claim 3, wherein the acquiring the information about the background image comprises:

in response to the shape of the guide member included in the acquired image not corresponding to the shape of the display device, processing the acquired image to render the shape of the guide member in the acquired image to correspond to the shape of the display device; and

acquiring the information about the background image based on the background area of the acquired image.

5. The method as claimed in claim 3, further comprising:

in response to the shape of the guide member included in the acquired image not corresponding to the shape of the display device, displaying a guide message that guides a user motion that renders the shape of the guide member in the acquired image to correspond to the shape of the display device.

6. The method as claimed in claim 1, wherein the guide member includes a color mark that includes a plurality of colors for acquiring color information of the acquired image,

wherein the acquiring the information about the background image comprises acquiring the information by analyzing the color mark of the guide member in the acquired image, and

wherein the method further comprises adjusting the acquired image based on the information acquired by analyzing the color mark.

7. The method as claimed in claim 1, further comprising:

replacing a portion of the acquired image that is surrounded by the guide member in the acquired image, with a predetermined image.

8. The method as claimed in claim 1, wherein the guide member includes a Quick Response (QR) code for installing or executing an application that relates to installing the display device,

wherein the method further comprises:

in response to the electronic device recognizing the QR code in the acquired image, installing or executing the application.

9. The method as claimed in claim 8, further comprising:

connecting the electronic device to the display device through the application, and

transmitting the acquired information of the background image to the display device.

10. An electronic device, comprising:

a communication interface configured to communicate with a display device;

a camera configured to acquire an image that comprises a guide member for guiding a position at which the display device is to be placed, wherein the image of the guide member comprises an image of a plurality of marks that are physically located on the guide member;

a display configured to display the acquired image, and display a plurality of indicators to be laid over the image of the plurality of marks; and

a processor configured to;

control the display to prompt a user to adjust the camera to place the plurality of marks of the guide member within the plurality of indicators, respectively,

analyze a background area within the guide member of the acquired image, and

acquire information about a background image that is to be displayed on the display device based on the background area,

wherein the display is further configured to display, on the display device, the background image based on the information about the background image, and

wherein the guide member is a physical component having a frame-like shape with an empty space therein for acquiring an image of an area behind the display device to be placed at the guided position.

11. The electronic device as claimed in claim 10, wherein a shape of the guide member corresponds to a shape of the display device and the guide member comprises the plurality of marks formed in corner areas of the guide member, and

wherein the processor is further configured to control the display to display the plurality of indicators that guide positions of the plurality of marks of the guide members, and in response to the plurality of marks of the guide member being positioned at the plurality of indicators in the acquired image, analyze the background area in the acquired image.

12. The electronic device as claimed in claim 11, wherein the processor is further configured to identify whether a shape of the guide member included in the acquired image corresponds to the shape of the display device based on positions and sizes of the plurality of marks in the acquired image, and in response to the shape of the guide member included in the acquired image corresponding to the shape of the display device, acquire the information about the background image based on the background area of the acquired image.

13. The electronic device as claimed in claim 12, wherein the processor is further configured, in response to the shape of the guide member included in the acquired image not corresponding to the shape of the display device, process the acquired image to render the shape of the guide member in the acquired image to correspond to the shape of the display device, and acquire the information about the background image based on the background area of the acquired image.

14. The electronic device as claimed in claim 12, wherein the processor is further configured to, in response to the shape the guide member included in the acquired image not corresponding to the shape of the display device, control the display to display a guide message that guides a user motion that renders the shape of the guide member in the acquired image to correspond to the shape of the display device.

15. The electronic device as claimed in claim 10, wherein the guide member includes a color mark that includes a plurality of colors for acquiring color information of the acquired image,

wherein the processor is further configured to acquire the information about the background image by analyzing the color mark of the guide member in the acquired image, and adjust the acquired image based on the information about the background image acquired by analyzing the color mark.

16. The electronic device as claimed in claim 10, wherein the processor is further configured to control the display to replace a portion of the acquired image that is surrounded by the guide member in the acquired image with a predetermined image.

17. The electronic device as claimed in claim 10, wherein the guide member includes a Quick Response (QR) code for installing or executing an application that relates to installing the display device, and

wherein the processor is further configured to, in response to recognizing the QR code within the acquired image, execute or install the application.

18. The electronic device as claimed in claim 17, wherein the processor is further configured to control the communication interface to connect the electronic device to the display device according to a user command that is received through the application and control the communication interface to transmit the acquired information about the background image to the display device.

19. A non-transitory computer readable storage medium storing a program that is executable by a computer to perform a method for controlling an electronic device, the method comprising:

acquiring an image that comprises a guide member for guiding a position at which a display device is to be placed, wherein the image of the guide member comprises an image of a plurality of marks that are physically located on the guide member;

displaying the acquired image;

displaying a plurality of indicators to be laid over the image of the plurality of marks;

prompting a user to adjust a camera to place the plurality of marks of the guide member within the plurality of indicators, respectively;

analyzing a background area within the guide member of the acquired image;

acquiring information about a background image that is to be displayed on the display device based on the background area; and

displaying, on the display device, the background image based on the information about the background image,

wherein the guide member is a physical component having a frame-like shape with an empty space therein for acquiring an image of an area behind the display device to be placed at the guided position.