Oral monitor

• US 10,178,946 B2
• Filed: 09/08/2014
• Issued: 01/15/2019
• Est. Priority Date: 09/08/2014
• Status: Active Grant

• Current Assignee: Smith Micro Software Incorporated
• Original Assignee: Location Labs (Gen Digital Inc.)
• Inventors: Weiss, Andrew, Hotes, Scott
• Primary Examiner(s): Perungavoor, Sathyanaraya V
• Assistant Examiner(s): DANG, PHILIP
• Application Number:
  US14/479,591
• Publication Number:
  US 20160066776A1
• Time in Patent Office: 1,590 Days
• CPC Class Codes: A61B 1/00009 of image signals during a use of endoscope
• CPC Class Codes: A61B 1/00016 using wireless means
• CPC Class Codes: A61B 1/00032 internally powered
• CPC Class Codes: A61B 1/00181 for multiple fixed viewing angles A61B1/00193 takes precedence
• CPC Class Codes: A61B 1/05 characterised by the image sensor, e.g. camera, being in the distal end portion
• CPC Class Codes: A61B 1/24 for the mouth, i.e. stomatoscopes, e.g. with tongue depressors tongue depressors per se A61B13/00; Instruments for opening or keeping open the mouth combined with saliva removers A61C17/00; mouth openers for animals A61D15/00
• CPC Class Codes: A61B 5/14507 specially adapted for measuring characteristics of body fluids other than blood devices for taking samples of body liquids A61B10/0045
• CPC Class Codes: A61B 5/14532 for measuring glucose, e.g. by tissue impedance measurement
• CPC Class Codes: A61B 5/4845 Toxicology, e.g. by detection of alcohol, drug or toxic products A61B5/4848 takes precedence
• CPC Class Codes: A61B 5/682 Mouth, e.g., oral cavity; tongue; Lips; Teeth
• CPC Class Codes: A61C 19/04 Measuring instruments specially adapted for dentistry A61C5/44 takes precedence; testing vitality of teeth A61B5/0534; radiation diagnosis specially adapted for dentistry A61B6/51
• CPC Class Codes: A61C 7/14 Brackets A61C7/28 takes precedence; Fixing brackets to teeth

Abstract

An oral monitoring system is provided. The oral monitoring system includes one or more cameras configured for installation in a mouth for capturing images. A memory is configured for storing images. One or more processors are configured to process images captured by the one or more cameras, and a wireless transmitter is configured to transmit data corresponding to the captured images. A chemical sensor is further provided and the wireless transmitter is further configured to transmit data corresponding to substances detected by the chemical sensor.

Claims

1. An oral monitoring system comprising:

at least one camera installed in a mouth by adhering to a tooth for capturing images over a period of time, the images captured comprising images of teeth in the mouth;

a chemical sensor attached to the mouth, the chemical sensor detecting a particular substance in the mouth;

a memory that stores at least images;

at least one processor that;

processes images captured by the at least one camera;

determines based on the images captured and the detecting by the chemical sensor consumption activities comprising a number of times a particular substance is consumed by the mouth;

determines based on the images captured at least one of an amount of plaque, a formation of a cavity, an abscess, or a dental anomaly in the mouth;

determines based on the images captured when a threshold amount of plaque has accumulated on the teeth within the mouth;

transmits a notification at least one of responsive to determining the threshold amount of plaque has accumulated or based on the determined number of times the particular substance is consumed by the mouth; and

generates a report based on the consumption activities and transmits the report; and

a wireless transmitter that transmits data corresponding to the images captured and the detected particular substance.

2. The oral monitoring system of claim 1, further comprising a housing attaching the oral monitoring system to an orthodontic apparatus connected to the teeth in the mouth.

3. The oral monitoring system of claim 1, the at least one camera comprising:

a first camera positioned within the mouth facing outside of the mouth; and

a second camera positioned within the mouth facing toward a cheek of the mouth.

4. The oral monitoring system of claim 1, wherein the wireless transmitter comprises a wireless transceiver that operates under wireless Ethernet protocol.

5. The oral monitoring system of claim 1, wherein the chemical sensor detects food sugars in the mouth, wherein:

the at least one processor further processes food sugar information collected by the chemical sensor; and

the wireless transmitter further transmits data corresponding to the food sugar information.

6. The oral monitoring system of claim 1, the at least one processor further determines tooth brushing based on the images captured by the at least one camera.

7. The oral monitoring system of claim 6, wherein the at least one processor applies a classifier to the images captured to determine the tooth brushing.

8. The oral monitoring system of claim 1, the at least one processor further:

determining based on the images captured when a medical anomaly occurs within a mouth; and

transmitting another notification responsive to determining the medical anomaly.

9. The oral monitoring system of claim 1, the chemical sensor detects food sugars the at least one processor further:

determines based on the images captured and based on detected food sugars a quality of food consumed in the mouth; and

generates the report comprising an indication of the quality of the food consumed in the mouth.

10. The oral monitoring system of claim 1, the at least one camera capturing images of smoke in the mouth, the at least one processor:

determines based on the images captured smoking activity; and

generates the report comprising an indication of smoking activity.

11. The oral monitoring system of claim 1, wherein the chemical sensor detects at least one particular mind altering substance consumed in the mouth, the at least one processor further generating the report to comprise an indication of the at least one particular mind altering substance.

12. The oral monitoring system of claim 11, wherein the at least one particular mind altering substance comprises an illicit drug.

13. The oral monitoring system of claim 11, wherein the at least one particular mind altering substance comprises at least one of alcohol or marijuana.

14. The oral monitoring system of claim 1, further comprising a network connected server, the at least one processor comprising a processor of the server, the server:

receiving the data transmitted from the wireless transmitter;

determining by the processor of the server at least one of a health state of the mouth or the particular substance consumed by the mouth based at least on the images captured; and

transmitting the notification to a user based on the determined at least one of the health state or the particular substance consumed.

15. The oral monitoring system of claim 1, wherein the at least one camera comprises a video camera.

30. The oral monitoring system of claim 1 further comprising:

a housing comprising the at least one camera, the chemical sensor, the memory, and the at least one processor; and

an adhesive for adhering the housing to a surface of a tooth.

16. An oral monitoring method comprising:

providing at least one camera;

providing a chemical sensor;

attaching the at least one camera to a tooth in a mouth;

attaching the chemical sensor in the mouth;

capturing a plurality of images by the at least one camera over a period of time, the plurality of images comprising teeth in the mouth;

detecting by the chemical sensor a particular substance in the mouth;

determining by at least one processor based on the plurality of images captured at least one of an amount of plaque, a formation of a cavity, an abscess, or a dental anomaly in the mouth;

determining based on the images captured when a threshold amount of plaque has accumulated on the teeth in the mouth;

determining by the at least one processor based on the plurality of images captured and based on the detecting by the chemical sensor a number of times a particular substance is consumed by the mouth;

generating a report based on the determined number of times the particular substance is consumed by the mouth;

transmitting a first notification comprising the report to a user based on the determined number of times the particular substance is consumed by the mouth; and

transmitting a second notification to the user responsive to determining the threshold amount of plaque has accumulated.

17. The method of claim 16, further comprising determining a number of times a particular activity is performed based on the detecting by the chemical sensor of the particular substance.

18. The method of claim 16, further comprising:

determining by the chemical sensor an amount of food sugar in the detected particular substance; and

classifying the detected particular substance based on the amount of food sugar;

wherein

the transmitted first notification comprises an indication of the classification of the detected particular substance.

19. The method of claim 16, further comprising:

detecting by the chemical sensor a food sugar in the mouth; and

transmitting the first notification to a user based on the detected food sugar in the mouth.

20. The method of claim 16, wherein the mouth is that of a first person and the user is a second person who supervises the first person.

21. The method of claim 16, further comprising determining by the at least one processor based on the plurality of images captured and based on the detecting by the chemical sensor a number of times a particular activity is performed by the mouth, wherein the particular activity is eating.

22. The method of claim 16, further comprising determining by the at least one processor based on the plurality of images captured and based on the detecting by the chemical sensor a number of times a particular activity is performed by the mouth, wherein the particular activity is teeth brushing.

25. The method of claim 16, wherein attaching the at least one camera in the mouth comprises adhering the at least one camera to an outside surface of a tooth.

26. The method of claim 16, further comprising providing the at least one camera and the chemical sensor in a housing and adhering the housing to a surface of a tooth.

27. The method of claim 16, wherein attaching the at least one camera to a tooth in the mouth comprises attaching the at least one camera to an orthodontic apparatus connected to the teeth in the mouth.

28. The method of claim 16, wherein attaching the at least one camera to a tooth in the mouth comprises attaching the at least one camera on the tooth and facing outside of the mouth.

29. The method of claim 16, further comprising determining by the at least one processor based on the plurality of images captured and based on the detecting by the chemical sensor a number of times a particular activity is performed by the mouth, wherein the particular activity performed is smoking.

23. An oral monitoring method comprising:

providing at least one camera;

providing at least one chemical sensor;

attaching the at least one camera and the at least one chemical sensor to a tooth in a mouth;

capturing a plurality of images by the at least one camera over a period of time, the captured plurality of images comprising images of teeth in the mouth;

determining based on the plurality of images captured at least one of an amount of plaque, a formation of a cavity, an abscess, or a dental anomaly in the mouth;

determining based on the images captured when a threshold amount of plaque has accumulated on the teeth within the mouth;

detecting a substance by the at least one chemical sensor;

determining by the chemical sensor an amount of food sugar in the substance;

classifying the detected substance based on the amount of food sugar;

determining a number of times the classified detected substance was consumed by the mouth based on the captured plurality of images and based on the detecting by the at least one chemical sensor;

determining a plurality of notifications by at least one processor, the plurality of notifications comprising a report of an indication of the number of times the classified detected substance was consumed and a report of an indication that a threshold amount of plaque has accumulated; and

transmitting a first of the plurality of notifications to a user responsive to determining the threshold amount of plaque has accumulated.

24. The method of claim 23, further comprising transmitting a second of the plurality of notifications responsive to determining that a threshold number of times the classified detected substance was consumed has been reached.

31. An oral monitoring method comprising:

providing an oral monitor comprising a camera, a chemical sensor, a memory that stores images, at least one processor, and a wireless transmitter;

adhering the oral monitor to a surface of a tooth in a mouth;

capturing a plurality of images by the camera over a period of time, the captured plurality of images comprising images of teeth in the mouth;

detecting by the chemical sensor a particular substance in the mouth;

determining by the at least one processor based on the captured plurality of images at least one of an amount of plaque, a formation of a cavity, an abscess, or a dental anomaly in the mouth;

determining based on the captured plurality of images when a threshold amount of plaque has accumulated on the teeth within the mouth;

determining by the at least one processor based on the plurality of images captured and based on the detecting by the chemical sensor a number of times a particular substance is consumed by the mouth;

generating a report based on the number of times the particular substance is consumed in the mouth;

transmitting by the wireless transmitter a first notification based on the determined number of times the particular substance is consumed, the first notification comprising the report; and

transmitting by the wireless transmitter a second notification responsive to determining the threshold amount of plaque has accumulated.