INFORMATION PROCESSING METHOD, SYSTEM AND ELECTRONIC DEVICE

• US 20150235078A1
• Filed: 09/29/2014
• Published: 08/20/2015
• Est. Priority Date: 02/18/2014
• Status: Active Grant

• Current Assignee: Beijing Lenovo Software Ltd (Lenovo Group Ltd.), Lenovo Company Limited (Lenovo Group Ltd.)
• Original Assignee: Beijing Lenovo Software Ltd (Lenovo Group Ltd.)
• Inventors: Feng, Xiaoyi
• Granted Patent: US 9,396,386 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 1/1616 with folding flat displays, e.g. laptop computers or notebooks having a clamshell configuration, with body parts pivoting to an open position around an axis parallel to the plane they define in closed position
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1686 the I/O peripheral being an integrated camera
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06V 20/00 Scenes; Scene-specific elements control of digital cameras H04N23/60
• CPC Class Codes: G06V 40/107 Static hand or arm

Abstract

An information processing method, system and an electronic device are provided according to the embodiments of the disclosure, and applied to an electronic device having at least a first panel, with a first surface of the first panel being provided with a display unit and at least one image acquisition apparatus, where the at least one image acquisition apparatus is positioned below the display unit in the case that the first panel stands on a plane. After an image for a to-be-recognized object and the plane is acquired by the image acquisition apparatus, whether the object contacts the plane is determined based on the acquired image, and information about position change on the object is detected in the case that it is determined that the object contacts the plane.

Claims

1. An information processing method, applicable to an electronic device, comprising:

acquiring an image for a to-be-recognized object and a plane on which the electronic device stands;

determining whether the to-be-recognized object contacts the plane based on the acquired image; and

detecting position-changed information of the to-be-recognized object in the case that it is determined that the to-be-recognized object contacts the plane.

2. The method according to claim 1, wherein before acquiring an image for a to-be-recognized object and a plane on which the electronic device stands, the method further comprises:

obtaining an angle between a first panel and a second panel of the electronic device; and

turning on at least one image acquisition apparatus of the electronic device in the case that the angle between the first panel and the second panel is greater than a preset threshold.

3. The method according to claim 1, wherein determining whether the to-be-recognized object contacts the plane based on the acquired image comprises:

obtaining edge data of the to-be-recognized object and edge data of the plane; and

determining that the to-be-recognized object contacts the plane in the case that there is an intersection between the edge data of the to-be-recognized object and the edge data of the plane.

4. The method according to claim 3, wherein detecting position-changed information of the to-be-recognized object comprises:

detecting a position of the to-be-recognized object in the image frame-by-frame; and

determining that the position of the to-be-recognized object changes in the case that the position of the to-be-recognized object in the image changes.

5. The method according to claim 1, wherein determining whether the to-be-recognized object contacts the plane based on the acquired image comprises:

synthesizing images acquired at the same time by at least two image acquisition apparatuses of the electronic device into a frame of depth image that carries coordinates of the to-be-recognized object and coordinates of points in the plane; and

determining whether the to-be-recognized object contacts the plane based on the coordinates of the to-be-recognized object and the coordinates of the points in the plane.

6. The method according to claim 5, wherein detecting position-changed information of the to-be-recognized object comprises:

obtaining coordinates of the to-be-recognized object that are respectively carried in two adjacent frames of depth images; and

determining that the position of the to-be-recognized object changes in the case that a first group of coordinates of the to-be-recognized object and a second group of coordinates of the to-be-recognized that are respectively carried in the two adjacent frames of depth images are different.

7. The method according to claim 1, further comprising:

stopping detecting the position-changed information of the to-be-recognized object in the case that it is determined that the to-be-recognized object separates from the plane.

8. An information processing system, applied to an electronic device having at least a first panel, with a first surface of the first panel being provided with least one image acquisition apparatus, wherein the at least one image acquisition apparatus acquires an image for a to-be-recognized object and the plane, and the system comprises:

a determination module, configured to determine whether the to-be-recognized object contacts the plane based on the image acquired by the at least one image acquisition apparatus; and

a detection module, configured to detect position-changed information of the to-be-recognized object in the case that the determination module determines that the to-be-recognized object contacts the plane.

9. The system according to claim 8, wherein the electronic device has the first panel and a second panel, the first panel and the second panel are movably connected through a rotating shaft;

and

the system further comprises;

a monitoring module, configured to obtain an angle between the first panel and the second panel; and

a turn-on module, configured to turn on the at least one image acquisition apparatus in the case that the angle between the first panel and the second panel that is obtained by the monitoring module is greater than a preset threshold.

10. The system according to claim 8, wherein in the case that the first surface of the first panel is provided with one image acquisition apparatus, the determination module comprises:

a first obtaining unit, configured to obtain edge data of the to-be-recognized object and edge data of the plane; and

a first determination unit, configured to determine that the to-be-recognized object contacts the plane in the case that there is an intersection between the edge data of the to-be-recognized object and the edge data of the plane.

11. The system according to claim 10, wherein the detection module comprises:

a position detection unit, configured to detect a position of the to-be-recognized object in the image frame-by-frame in the case that it is determined by the determination module that the to-be-recognized object contacts the plane; and

a second determination unit, configured to determine that the position of the to-be-recognized object changes in the case that the position of the to-be-recognized object in the image changes.

12. The system according to claim 8, wherein in the case that the first surface of the first panel is provided with at least two image acquisition apparatuses, the determination module comprises:

a synthesis unit, configured to synthesize images acquired at the same time by the at least two image acquisition apparatuses into a frame of depth image that carries coordinates of the to-be-recognized object and coordinates of points in the plane; and

a third determination unit, configured to determine whether the to-be-recognized object contacts the plane based on the coordinates of the to-be-recognized object and the coordinates of the points in the plane.

13. The system according to claim 12, wherein the detection module comprises:

a second obtaining unit, configured to obtain coordinates of the to-be-recognized object that are respectively carried in two adjacent frames of depth images; and

a fourth determination unit, configured to determine that the position of the to-be-recognized object changes in the case that a first group of coordinates of the to-be-recognized object and a second group of coordinates of the to-be-recognized object that are respectively carried in the two adjacent frames of depth images are different.

14. The system according to claim 8, wherein the system further comprises:

a control module, configured to turn on the detection module in the case that the determination module determines that the to-be-recognized object contacts the plane; and

turn off the detection module in the case that the determination module determines that the to-be-recognized object separates from the plane.

15. An electronic device, comprising:

a first panel stands on a plane;

at least one image acquisition apparatus provided on a first surface of the first panel;

a determination module, configured to determine whether a to-be-recognized object contacts the plane based on the image acquired by the at least one image acquisition apparatus; and

a detection module, configured to detect position-changed information of the to-be-recognized object in the case that the determination module determines that the to-be-recognized object contacts the plane.

16. The electronic device according to claim 15, wherein the electronic device has the first panel and a second panel, the first panel and the second panel are movably connected through a rotating shaft;

and

the electronic device further comprises;

a monitoring module, configured to obtain an angle between the first panel and the second panel; and

a turn-on module, configured to turn on the at least one image acquisition apparatus in the case that the angle between the first panel and the second panel that is obtained by the monitoring module is greater than a preset threshold.

17. The electronic device according to claim 15, wherein in the case that the first surface of the first panel is provided with one image acquisition apparatus, the determination module comprises:

a first obtaining unit, configured to obtain edge data of the to-be-recognized object and edge data of the plane; and

a first determination unit, configured to determine that the to-be-recognized object contacts the plane in the case that there is an intersection between the edge data of the to-be-recognized object and the edge data of the plane.

18. The electronic device according to claim 17, wherein the detection module comprises:

a position detection unit, configured to detect a position of the to-be-recognized object in the image frame-by-frame in the case that it is determined by the determination module that the to-be-recognized object contacts the plane; and

a second determination unit, configured to determine that the position of the to-be-recognized object changes in the case that the position of the to-be-recognized object in the image changes.

19. The electronic device according to claim 15, wherein in the case that the first surface of the first panel is provided with at least two image acquisition apparatus, the determination module comprises:

a synthesis unit, configured to synthesize image acquired at the same time by the at least two image acquisition apparatuses into a frame of depth image that carries coordinates of the to-be-recognized object and coordinates of points in the plane; and

a third determination unit, configured to determine whether the to-be-recognized object contacts the plane based on the coordinates of the to-be-recognized object and the coordinates of the points in the plane.

20. The electronic device according to claim 19, wherein the detection module comprises:

a second obtaining unit, configured to obtain coordinates of the to-be-recognized object that are carried in two adjacent frames of depth images; and

a fourth determination unit, configured to determine that the position of the to-be-recognized object changes in the case that a first group of coordinates of the to-be-recognized object and a second group of coordinates of the to-be-recognized object that are respectively carried in the two adjacent frames of depth images are different.