LUGGAGE CASE AND LUGGAGE CASE MOVING METHOD

• US 20130274987A1
• Filed: 03/20/2013
• Published: 10/17/2013
• Est. Priority Date: 04/13/2012
• Status: Abandoned Application

• Current Assignee: Hon Hai Precision Industry Co., Ltd.
• Original Assignee: Hon Hai Precision Industry Co., Ltd.
• Inventors: LEE, HOU-HSIEN, LEE, CHANG-JUNG, LO, CHIH-PING
• Application Number:
  US13/848,029
• Publication Number:
  US 20130274987A1
• Time in Patent Office: Days
• US Class Current: 701/28
• CPC Class Codes: A45C 5/14 with built-in rolling means
• CPC Class Codes: G05D 1/0246 using a video camera in combination with image processing means
• CPC Class Codes: G05D 1/0251 extracting 3D information from a plurality of images taken from different locations, e.g. stereo vision stereoscopic image analysis H04N13/00; depth recovery from images G06T7/593

Abstract

An exemplary luggage case moving method includes obtaining an image captured by a camera. The image includes a distance information indicating distances between the camera and objects captured by the camera. The method then creates a 3D scene model. Next, the method determines whether the target person appears in the created 3D scene model according to stored 3D models of target persons. The method then determines a target person minimum region in the obtained image, generates an actual minimum region, and compares the size of the actual minimum region with the size of a stored minimum region sample to determine the moving direction of the target person. The method next controls the driving unit to drive the luggage case to move toward the determined moving direction. A related luggage case is also provided.

Claims

1. A luggage case comprising:

a storage unit;

a processor;

one or more programs stored in the storage unit, executable by the processor, the one or more programs comprising;

an image obtaining module operable to obtain an image captured by a camera, the image comprising a distance information indicating distances between the camera and objects captured by the camera;

a model creating module operable to create a 3D scene model according to the image captured by the camera and the distance between the camera and any object in the field of view of the camera;

a detecting module operable to determine whether a target person appears in the created 3D scene model according to stored 3D models of target persons;

a direction determining module operable to determine a target person minimum region in the obtained image to comprise the whole target person when the target person appears in the created 3D scene model, generate an actual minimum region according to the determined target person minimum region in the obtained image, and compare the size of the actual minimum region with the size of a stored minimum region sample to determine the moving direction of the target person; and

an executing module operable to control a driving unit to drive the luggage case to move toward the moving direction determined by the direction determining module.

2. The luggage case as described in claim 1, further comprising a setting module, wherein the setting module is operable to obtain a sample of the target person image captured by the camera in response to an operation on an input unit, determine a target person minimum region in the sample of the target person image to comprise the whole target person, generate a minimum region sample according to the determined target person minimum region in the sample of the target person image, and store the sample of the target person image which comprises the minimum region sample in the storage unit, the size of the minimum region sample being capable of indicate the relationship of the distance between the luggage case and the target person.

3. The luggage case as described in claim 1, wherein the direction determining module is further to:

determine that the moving direction of the target person relation to the luggage case is forward when the size of the actual minimum region is less than the size of the minimum region sample;

determine that the target person relation to the luggage case is still when the size of the actual minimum region is equal to the size of the minimum region sample; and

determine that the moving direction of the target person relation to the luggage case is backward when the size of the actual minimum region is greater than the size of the minimum region sample.

4. The luggage case as described in claim 2, further comprising an angle determining module, wherein the angle determining module is operable to determine a center of the actual minimum region when the target person appears in the created 3D scene model, compare the determined center of the actual minimum region with a stored center of the minimum region sample when the difference between a first distance and a second distance is in a preset range, to determine a rotation direction and a rotation angle according to a stored ratio of the image size of the object in the image captured by the camera to the real-life size of the object when the distance between the object and the camera is a preset value, a first distance being the distance between the camera and the determined center of the actual minimum region, a second distance being the distance between the camera and the determined center of the minimum region sample;

the executing module is further operable to drive the driving unit to rotate toward the determined rotation direction and rotate with the determined angle.

5. The luggage case as described in claim 4, wherein the setting module is further operable to determine a center of the minimum region sample and store the sample of target person image comprising the determined center of the minimum region sample in the storage unit, the position of the center of the minimum region sample being capable of indicating the relationship of the position between the luggage case and the target person.

6. The luggage case as described in claim 4, wherein the angle determining module in detail is operable to:

align the sample of the target person image and the obtained image when the difference between the first distance and the second distance is in a preset range, and consider the determined center of the actual minimum region and the determined center of the minimum region sample being in a same image;

establish a two-dimensional Cartesian coordinate system in the image, and determine a set of coordinates of the center of the actual minimum region and a set of coordinates of the center of the minimum region sample in the same image to determine the virtual distance in the image between the center of the actual minimum region and the center of the minimum region sample;

determine the actual distance between the center of the actual minimum region and the center of the minimum region sample according to the stored ratio of the image size of the object in the image captured by the camera to the real-life size of the actual object and the determined virtual distance in the image;

a first side formed by the center of the actual minimum region and the center of the minimum region sample, a second side formed by the center of the actual minimum region and the camera, and a third side formed by the center of the minimum region sample being all connected to form a triangle; and

determine the rotation direction and the rotation angle of the luggage case according to the formula;

cos θ

=(a²+b²−

c²)/2ab, wherein a represents the actual distance between the center of the actual minimum region and the center of the minimum region sample, b represents the distance between the center of the actual minimum region and the camera, and c represents the distance between the center of the minimum region sample and the camera.

7. The luggage case as described in claim 1, further comprising a speed determining module, wherein:

the image obtaining module is further operable to obtain a preset number of successive images captured by the camera every a preset time period;

the model creating module is further operable to create successive 3D scene models according to the preset number of successive images captured by the camera, and the distance between the camera and any object in the field of view of the camera;

the detecting module is further operable to determine whether the target person appears in the created successive 3D scene models;

the speed determining module is operable to select any two created 3D scene models from the created successive 3D scene models, determine the shortest distance between the camera and the target person comprised in each of the two selected 3D scene models, and determine that the moved distance by the target person relation to the luggage case in the two selected 3D scene model is the value of the difference of the two determined shortest distances between the camera and the target person comprised in each of the two created 3D scene models;

the speed determining module is operable to determine the number of 3D scene models between the two selected 3D scene models, divide a stored shooting speed of the camera from the determined number of 3D scene models to determine a moving time passing while the target person moves the determined moved distance by the target person relation to the luggage case, and further determine the moving direction and moving speed of the target person relation to the luggage case;

the speed determining module is operable to determine the moving speed of the luggage case according to the moving direction and the moving speed of the target person relation to the luggage case, and a stored default moving speed of the luggage case; and

the executing module is further operable to control the driving unit to drive the luggage case to move with the determined moving speed of the luggage case.

8. A luggage case moving method comprising:

obtaining an image captured by a camera, the image comprising a distance information indicating distances between the camera and objects captured by the camera;

creating a 3D scene model according to the image captured by the camera and the distance between the camera and any object in the field of view of the camera;

determining whether a target person appears in the created 3D scene model according to stored 3D models of target persons;

determining a target person minimum region in the obtained image to comprise the whole target person when the target person appears in the created 3D scene model, generate an actual minimum region according to the determined target person minimum region in the obtained image, and comparing the size of the actual minimum region with the size of a stored minimum region sample to determine the moving direction of the target person; and

controlling a driving unit to drive the luggage case to move toward the determined moving direction.

9. The luggage case moving method as described in claim 8, further comprising:

obtaining a sample of the target person image captured by the camera in response to an operation on an input unit, determining a target person minimum region in the sample of the target person to comprise the whole target person, generate a minimum region sample according to the determined target person minimum region in the sample of the target person, and storing the sample of the target person image comprising the minimum region sample in a storage unit, the size of the minimum region sample being capable of indicate the relationship of the distance between the luggage case and the target person.

10. The luggage case moving method as described in claim 8, wherein the step of “

comparing the size of the actual minimum region with the size of a stored minimum region sample to determine the moving direction of the target person”

comprises;

determining that the moving direction of the target person relation to the luggage case is forward when the size of the actual minimum region is less than the size of the minimum region sample;

determining that the target person relation to the luggage case is still when the size of the actual minimum region is equal to the size of the minimum region sample; and

determining that the moving direction of the target person relation to the luggage case is backward when the size of the actual minimum region is greater than the size of the minimum region sample.

11. The luggage case moving method as described in claim 9, further comprising:

determining a center of the actual minimum region when the target person appears in the created 3D scene model, comparing the determined center of the actual minimum region with a stored center of the minimum region sample when the difference between a first distance and a second distance is in a preset range, to determine a rotation direction and a rotation angle according to a stored ratio of the image size of the object in the image captured by the camera to the real-life size of the object when the distance between the object and the camera is a preset value, a first distance being the distance between the camera and the determined center of the actual minimum region, a second distance being the distance between the camera and the determined center of the minimum region sample; and

driving the driving unit to rotate toward the determined rotation direction and rotate with the determined angle.

12. The luggage case moving method as described in claim 11, further comprising:

determining a center of the minimum region sample and storing the sample of the target person image comprising the determined center of the minimum region sample in the storage unit, the position of the center of the minimum region sample being capable of indicating the relationship of the position between the luggage case and the target person.

13. The luggage case moving method as described in claim 11, wherein the step of determining a rotation direction and a rotation angle comprises:

aligning the sample of the target person image and the obtained image when the difference between the first distance and the second distance is in a preset range, and considering the determined center of the actual minimum region and the determined center of the minimum region sample being in a same image;

establishing a two-dimensional Cartesian coordinate system in the image, and determining a set of coordinates of the center of the actual minimum region and a set of coordinates of the center of the minimum region sample in the same image to determine the virtual distance in the image between the center of the actual minimum region and the center of the minimum region sample;

determining the actual distance between the center of the actual minimum region and the center of the minimum region sample according to the stored ratio of the image size of the object in the image captured by the camera to the real-life size of the actual object and the determined virtual distance in the image;

a first side formed by the center of the actual minimum region and the center of the minimum region sample, a second side formed by the center of the actual minimum region and the camera, and a third side formed by the center of the minimum region sample being all connected to form a triangle; and

determining the rotation direction and the rotation angle of the luggage case according to the formula;

cos θ

=(a²+b²−

c²)/2ab, wherein a represents the actual distance between the center of the actual minimum region and the center of the minimum region sample, b represents the distance between the center of the actual minimum region and the camera, and c represents the distance between the center of the minimum region sample and the camera.

14. The luggage case moving method as described in claim 8, further comprising:

obtaining a preset number of successive images captured by the camera every a preset time period;

creating successive 3D scene models according to the preset number of successive images captured by the camera, and the distance between the camera and any object in the field of view of the camera;

determining whether the target person appears in the created successive 3D scene models;

selecting any two created 3D scene models from the created successive 3D scene models, determining the shortest distance between the camera and the target person comprised in each of the two selected 3D scene models, and determining that the moved distance by the target person relation to the luggage case in the two selected 3D scene model is the value of the difference of the determined two shortest distances between the camera and the target person comprised in each of the two created 3D scene models;

determining the number of 3D scene models between the two selected 3D scene models, dividing a stored shooting speed of the camera from the determined number of 3D scene models to determine a moving time passing while the target person moves the determined moved distance by the target person relation to the luggage case, and further determining the moving direction and moving speed of the target person relation to the luggage case;

determining the moving speed of the luggage case according to the moving direction and the moving speed of the target person relation to the luggage case, and a stored default moving speed of the luggage case; and

controlling the driving unit to drive the luggage case to move with the determined moving speed of the luggage case.

15. A non-transitory storage medium storing a set of instructions, the set of instructions capable of being executed by a processor of a luggage case, cause the luggage case to perform a luggage case moving method, the method comprising:

obtaining an image captured by a camera, the image comprising a distance information indicating distances between the camera and objects captured by the camera;

creating a 3D scene model according to the image captured by the camera and the distance between the camera and any object in the field of view of the camera;

determining whether the target person appears in the created 3D scene model according to stored 3D models of target persons;

determining a target person minimum region in the obtained image to comprise the whole target person when the target person appears in the created 3D scene model, generating an actual minimum region according to the determined target person minimum region in the obtained image, and comparing the size of the actual minimum region with the size of a stored minimum region sample to determine the moving direction of the target person; and

controlling the driving unit to drive the luggage case to move toward the determined moving direction.

16. The non-transitory storage medium as described in claim 15, further comprising:

obtaining a sample of the target person image captured by the camera in response to an operation on an input unit, determining a target person minimum region in the sample of the target person to comprise the whole target person, generate a minimum region sample according to the determined target person minimum region in the sample of the target person, and storing the sample of the target person image comprising the minimum region sample in a storage unit, the size of the minimum region sample being capable of indicate the relationship of the distance between the luggage case and the target person.

17. The non-transitory storage medium as described in claim 15, wherein the step of “

comparing the size of the actual minimum region with the size of a stored minimum region sample to determine the moving direction of the target person”

comprises;

determining that the moving direction of the target person relation to the luggage case is forward when the size of the actual minimum region is less than the size of the minimum region sample;

determining that the target person relation to the luggage case is still when the size of the actual minimum region is equal to the size of the minimum region sample; and

determining that the moving direction of the target person relation to the luggage case is backward when the size of the actual minimum region is greater than the size of the minimum region sample.

18. The non-transitory storage medium as described in claim 16, further comprising:

determining a center of the actual minimum region when the target person appears in the created 3D scene model, comparing the determined center of the actual minimum region with a stored center of the minimum region sample when the difference between a first distance and a second distance is in a preset range, to determine a rotation direction and a rotation angle according to a stored ratio of the image size of the object in the image captured by the camera to the real-life size of the object when the distance between the object and the camera is a preset value, a first distance being the distance between the camera and the determined center of the actual minimum region, a second distance being the distance between the camera and the determined center of the minimum region sample; and

driving the driving unit to rotate toward the determined rotation direction and rotate with the determined angle.

19. The non-transitory storage medium as described in claim 18, wherein the step of determine a rotation direction and a rotation angle comprises:

aligning the sample of the target person image and the obtained image when the difference between the first distance and the second distance is in a preset range, and considering the determined center of the actual minimum region and the determined center of the minimum region sample being in a same image;

establishing a two-dimensional Cartesian coordinate system in the image, and determining a set of coordinates of the center of the actual minimum region and a set of coordinates of the center of the minimum region sample in the same image to determine the virtual distance in the image between the center of the actual minimum region and the center of the minimum region sample;

determining the actual distance between the center of the actual minimum region and the center of the minimum region sample according to the stored ratio of the image size of the object in the image captured by the camera to the real-life size of the actual object and the determined virtual distance in the image;

a first side formed by the center of the actual minimum region and the center of the minimum region sample, a second side formed by the center of the actual minimum region and the camera, and a third side formed by the center of the minimum region sample being all connected to form a triangle; and

determining the rotation direction and the rotation angle of the luggage case according to the formula;

cos θ

=(a²+b²−

c²)/2ab, wherein a represents the actual distance between the center of the actual minimum region and the center of the minimum region sample, b represents the distance between the center of the actual minimum region and the camera, and c represents the distance between the center of the minimum region sample and the camera.

20. The non-transitory storage medium as described in claim 15, further comprising:

obtaining a preset number of successive images captured by the camera every a preset time period;

creating successive 3D scene models according to the preset number of successive images captured by the camera, and the distances between the camera and any object in the field of view of the camera;

determining whether the target person appears in the created successive 3D scene models;

selecting any two created 3D scene models from the created successive 3D scene models, determining the shortest distance between the camera and the target person comprised in each of the two selected 3D scene models, and determining that the moved distance by the target person relation to the luggage case in the two selected 3D scene model is the value of the difference of the two determined shortest distances between the camera and the target person comprised in each of the two created 3D scene models;

determining the number of 3D scene models between the two selected 3D scene models, dividing a stored shooting speed of the camera from the determined number of 3D scene models to determine a moving time passing while the target person moves the determined moved distance by the target person relation to the luggage case, and further determining the moving direction and moving speed of the target person relation to the luggage case;

determining the moving speed of the luggage case according to the moving direction and the moving speed of the target person relation to the luggage case, and a stored default moving speed of the luggage case; and

controlling the driving unit to drive the luggage case to move with the determined moving speed of the luggage case.