Information communication method

• US 10,455,161 B2
• Filed: 04/25/2019
• Issued: 10/22/2019
• Est. Priority Date: 12/27/2012
• Status: Active Grant

• Current Assignee: Panasonic Intellectual Property Corporation of America (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Intellectual Property Corporation of America (Panasonic Holdings Corporation)
• Inventors: Oshima, Mitsuaki, Nakanishi, Koji, Aoyama, Hideki, Fuchigami, Ikuo, Shin, Hidehiko, Mukai, Tsutomu, Matsushita, Yosuke, Iida, Shigehiro, Yamada, Kazunori
• Primary Examiner(s): Dobson, Daniel G
• Application Number:
  US16/394,913
• Publication Number:
  US 20190253600A1
• Time in Patent Office: 180 Days
• CPC Class Codes: H04B 10/116 Visible light communication
• CPC Class Codes: H04B 10/516 Details of coding or modulation
• CPC Class Codes: H04N 23/73 by influencing the exposure time

Abstract

A method includes setting an exposure time of an image sensor included in a terminal device so that a bright line corresponding to each of a plurality of exposure lines included in the image sensor appears according to a change in luminance of each of the plurality of subjects. The method also includes obtaining a bright line image including a plurality of bright lines corresponding to each of the plurality of subjects, and obtaining a plurality of identification information from the plurality of subjects. The method further includes specifying locations of the plurality of subjects, determining directions of arrival of lights from the plurality of subjects, calculating distances between the terminal device and each of the plurality of subjects using each of the directions of the arrival of lights, and calculating a location of the terminal device using the locations of the plurality of the subjects and the distances.

Claims

1. A method, comprising:

setting an exposure time of an image sensor included in a terminal device so that, in an image obtained by capturing a plurality of subjects by the image sensor, a bright line corresponding to each of a plurality of exposure lines included in the image sensor appears according to a change in luminance of each of the plurality of subjects;

obtaining a bright line image including a plurality of bright lines corresponding to each of the plurality of subjects, by capturing the plurality of subjects, wherein each subject changes in luminance by the image sensor with the set exposure time;

obtaining a plurality of identification information from the plurality of subjects, by demodulating data specified by a pattern of the plurality of bright lines included in the obtained bright line image;

specifying locations of the plurality of subjects using the plurality of identification information;

determining directions of arrival of lights from the plurality of subjects by analyzing positions of the plurality of subjects in the bright line image;

calculating distances between the terminal device and each of the plurality of subjects using each of the directions of the arrival of lights; and

calculating a location of the terminal device using the locations of the plurality of the subjects and the distances.

2. The method according to claim 1,

wherein the specifying includes searching the locations of the plurality of subjects using the plurality of identification information and an ID list, the ID list includes the locations of the plurality of subjects associated with the plurality of identification information of the plurality of subjects.

3. The method according to claim 2,

wherein the ID list is stored in the terminal device.

4. The method according to claim 1,

wherein the determining of the directions includes determining a tilt angle of the terminal device using a sensor of the terminal device, and determining the directions using the tilt angle.

5. The method according to claim 4,

wherein the sensor is a gyro sensor.

6. The method according to claim 1,

wherein the calculating of the distances includes,

calculating a distance between a user of the terminal device and a ceiling in which the plurality of subjects are installed, and

calculating the distances between the terminal device and the plurality of subjects using (i) the distance between the user of the terminal device and the ceiling, and (ii) the directions.

7. The method according to claim 1,

wherein the image sensor is a facing camera of the terminal device.

8. The method according to claim 1,

wherein, in the obtaining of the bright line image, an exposure time of each of the plurality of exposure lines partially overlaps with an exposure time of an adjacent one of the plurality of exposure lines, and

wherein the set exposure time is smaller than or equal to 20 times of a luminance change period of each of the plurality of subjects.

9. A device, comprising:

setting an exposure time of an image sensor included in the terminal device so that, in an image obtained by capturing a plurality of subjects by the image sensor, a bright line corresponding to each of a plurality of exposure lines included in the image sensor appears according to a change in luminance of each of the plurality of subjects;

obtaining a bright line image including a plurality of bright lines corresponding to each of the plurality of subjects, by capturing the plurality of subjects, wherein each subject changes in luminance by the image sensor with the set exposure time;

obtaining a plurality of identification information from the plurality of subjects, by demodulating data specified by a pattern of the plurality of bright lines included in the obtained bright line image;

specifying locations of the plurality of subjects using the plurality of identification information;

determining directions of arrival of lights from the plurality of subjects by analyzing positions of the plurality of subjects in the bright line image;

calculating distances between the terminal device and each of the plurality of subjects using each of the directions of the arrival of lights; and

calculating a location of the terminal device using the locations of the plurality of the subjects and the distances.

10. A non-transitory recording medium storing thereon a computer program, which when executed by a processor, causes the processor to perform operations including:

setting an exposure time of an image sensor included in a terminal device so that, in an image obtained by capturing a plurality of subjects by the image sensor, a bright line corresponding to each of a plurality of exposure lines included in the image sensor appears according to a change in luminance of each of the plurality of subjects;

obtaining a bright line image including a plurality of bright lines corresponding to each of the plurality of subjects, by capturing the plurality of subjects, wherein each subject changes in luminance by the image sensor with the set exposure time;

obtaining a plurality of identification information from the plurality of subjects, by demodulating data specified by a pattern of the plurality of bright lines included in the obtained bright line image;

specifying locations of the plurality of subjects using the plurality of identification information;

determining directions of arrival of lights from the plurality of subjects by analyzing positions of the plurality of subjects in the bright line image;

calculating distances between the terminal device and each of the plurality of subjects using each of the directions of the arrival of lights; and

calculating a location of the terminal device using the locations of the plurality of the subjects and the distances.

11. A method, comprising:

transmitting a plurality of identification information from a plurality of subjects to a terminal device by change in luminance of each of the plurality of subjects;

setting an exposure time of an image sensor included in the terminal device so that, in an image obtained by capturing the plurality of subjects by the image sensor, a bright line corresponding to each of a plurality of exposure lines included in the image sensor appears according to a change in luminance of each of the plurality of subjects;

obtaining a bright line image including a plurality of bright lines corresponding to each of the plurality of subjects, by capturing the plurality of subjects, wherein each subject changes in luminance by the image sensor with the set exposure time;

obtaining a plurality of identification information from the plurality of subjects, by demodulating data specified by a pattern of the plurality of bright lines included in the obtained bright line image;

specifying locations of the plurality of subjects using the plurality of identification information;

determining directions of arrival of lights from the plurality of subjects by analyzing positions of the plurality of subjects in the bright line image;

calculating distances between the terminal device and each of the plurality of subjects using each of the directions of the arrival of lights; and

calculating a location of the terminal device using the locations of the plurality of the subjects and the distances.

12. A system, comprising:

a terminal device; and

a plurality of transmitters configured to transmit a plurality of identification information from the plurality of transmitters to the terminal device by change in luminance of each of the plurality of transmitters,

the terminal device including

a processor,

an image sensor having a plurality of exposure lines; and

a memory storing thereon a computer program, which when executed by the processor, causes the processor to perform operations including

setting an exposure time of the image sensor included in the terminal device so that, in an image obtained by capturing a plurality of transmitters by the image sensor, a bright line corresponding to each of a plurality of exposure lines included in the image sensor appears according to a change in luminance of each of the plurality of transmitters;

obtaining a bright line image including a plurality of bright lines corresponding to each of the plurality of subjects, by capturing the plurality of transmitters, wherein each transmitter changes in luminance by the image sensor with the set exposure time;

obtaining a plurality of identification information from the plurality of transmitters, by demodulating data specified by a pattern of the plurality of bright lines included in the obtained bright line image;

specifying locations of the plurality of transmitters using the plurality of identification information;

determining directions of arrival of lights from the plurality of transmitters by analyzing positions of the plurality of transmitters in the bright line image;

calculating distances between the terminal device and each of the plurality of transmitters using each of the directions of the arrival of lights; and

calculating a location of the terminal device using the locations of the plurality of the transmitters and the distances.