SYSTEMS AND METHODS FOR SELECTING CONTENT BASED ON A USER'S BEHAVIOR

• US 20170064363A1
• Filed: 08/31/2016
• Published: 03/02/2017
• Est. Priority Date: 08/31/2015
• Status: Active Grant

• Current Assignee: OrCam Technologies Ltd
• Original Assignee: OrCam Technologies Ltd
• Inventors: Wexler, Yonatan, Shashua, Amnon
• Granted Patent: US 10,555,021 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: G06Q 30/0201 Market modelling; Market analysis; Collecting market data
• CPC Class Codes: G06T 2207/30221 Sports video; Sports image
• CPC Class Codes: G06T 7/11 Region-based segmentation
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 20/30 in albums, collections or shared content, e.g. social network photos or video
• CPC Class Codes: G06V 20/40 in video content extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44
• CPC Class Codes: G06V 20/41 Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items segmenting video sequences G06V20/49
• CPC Class Codes: G06V 20/44 Event detection
• CPC Class Codes: G06V 30/10 Character recognition
• CPC Class Codes: G06V 30/18105 related to colour
• CPC Class Codes: G06V 40/166 using acquisition arrangements
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G06V 40/175 Static expression
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: H04L 67/306 User profiles
• CPC Class Codes: H04N 21/2668 Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/4223 : Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/44218 : Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 23/60 : Control of cameras or camera modules
• CPC Class Codes: H04N 23/61 : based on recognised objects
• CPC Class Codes: H04N 23/611 : where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/90 : Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 7/185 : from a mobile camera, e.g. for remote control

Abstract

A system is provided for selecting content for a user of a wearable apparatus based on the user'"'"'s behavior. In one implementation, the system may include a memory storing executable instructions and at least one processing device. The at least one processing device may be programmed to execute the instructions to analyze a plurality of images captured by a wearable image sensor included in the wearable apparatus to identify one or more of the plurality of images that depict a behavior of the user; determine, based on the analysis, information associated with the one or more images depicting the behavior of the user; and select, based on the information associated with the one or more images depicting the behavior of the user, at least one content item.

Claims

1. A system for selecting content for a user of a wearable apparatus based on the user'"'"'s behavior, the system comprising:

a memory storing executable instructions; and

at least one processing device programmed to execute the instructions to;

analyze a plurality of images captured by a wearable image sensor included in the wearable apparatus to identify one or more of the plurality of images that depict a behavior of the user;

determine, based on the analysis, information associated with the one or more images depicting the behavior of the user; and

select, based on the information associated with the one or more images depicting the behavior of the user, at least one content item.

2. The system of claim 1, wherein the at least one processing device is further programmed to execute the instructions to transmit the at least one content item to the wearable apparatus.

3. The system of claim 1, wherein the at least one processing device is further programmed to execute the instructions to transmit the at least one content item to a device paired with the wearable apparatus.

4. The system of claim 3, wherein the paired device comprises at least one of:

a smartphone, a tablet, or a smartwatch.

5. The system of claim 3, wherein the paired device is programmed to display the at least one content item on a display of the paired device.

6. The system of claim 1, wherein the at least one processing device is further programmed to execute the instructions to receive the plurality of images from the wearable apparatus.

7. The system of claim 1, wherein the system includes a server.

8. The system of claim 1, wherein the system includes the wearable apparatus.

9. The system of claim 8, wherein the wearable apparatus includes a transmitter configured to enable wireless pairing with a receiver in an external device.

10. The system of claim 9, wherein the external device is configured to receive the at least one content item from the wearable apparatus.

11. The system of claim 9, wherein the external device comprises at least one of:

a smartphone, a tablet, or a smartwatch.

12. The system of claim 1, wherein the behavior of the user includes visiting an event venue, and the at least one content item relates to a performer scheduled to perform at the event venue.

13. The system of claim 1, wherein the behavior of the user includes visiting a restaurant, and the at least one content item relates to a food item on the restaurant'"'"'s menu.

14. The system of claim 13, wherein the at least one processing device is further programmed to execute the instructions to select the at least one content item related to the food item based on a food preference of the user.

15. The system of claim 14, wherein the food preference of the user is determined based on analysis of at least one image previously captured by the wearable image sensor.

16. The system of claim 15, wherein the at least one image previously captured by the wearable image sensor included a food item ordered or consumed by the user.

17. The system of claim 1, wherein the behavior of the user includes consuming a beverage, and the at least one content item includes a coupon for the beverage.

18. The system of claim 17, wherein the behavior of the user further includes consuming the beverage at a particular time of day.

19. The system of claim 18, wherein the particular time of day includes the morning, and the beverage is coffee.

20. The system of claim 1, wherein the at least one processing device is further programmed to execute the instructions to perform optical character recognition on at least one of the plurality of images.

21. The system of claim 20, wherein an external device paired with the wearable apparatus is programmed to receive a result of the optical character recognition.

22. The system of claim 21, wherein the external device is programmed to identify the behavior of the user based on at least the result.

23. The system of claim 1, wherein the system includes the wearable apparatus, and the wearable apparatus includes a microphone, and the at least one processing device is further programmed to execute the instructions to transmit information associated with sound captured by the microphone to an external device paired with the wearable apparatus.

24. The system of claim 23, wherein the external device is programmed to analyze the information associated with the sound to identify the behavior of the user.

25. The system of claim 1, wherein the system includes the wearable apparatus, and the wearable apparatus includes a microphone, and the at least one processing device is further programmed to execute the instructions to transmit information associated with sound captured by the microphone during a designated time period to an external device paired with the wearable apparatus.

26. The system of claim 25, wherein the designated time period begins after the at least one processing device recognizes a trigger in at least one captured image.

27. The system of claim 1, wherein the one or more images depicting the behavior of the user include two or more images.

28. A method for selecting content for a user of a wearable apparatus based on the user'"'"'s behavior, the method comprising:

analyzing a plurality of images captured by a wearable image sensor included in a wearable apparatus to identify one or more of the plurality of images that depict a behavior of the user;

determining, based on the analysis, information associated with the one or more images depicting the behavior of the user; and

selecting, based on the information associated with the one or more images depicting the behavior of the user, at least one content item.

29. The method of claim 28, wherein the behavior of the user includes visiting an event venue, and the at least one content item relates to a performer scheduled to perform at the event venue.

30. The method of claim 28, wherein the behavior of the user includes visiting a restaurant, and the at least one content item relates to a food item on the restaurant'"'"'s menu.

31. The method of claim 30, wherein the at least one content item related to the food item is selected based on a food preference of the user.

32. The method of claim 31, wherein the food preference of the user is determined based on analysis of at least one image previously captured by the wearable image sensor.

33. The method of claim 32, wherein the at least one image previously captured by the wearable image sensor included a food item ordered or consumed by the user.

34. The method of claim 28, wherein the behavior of the user includes consuming a beverage, and the at least one content item includes a coupon for the beverage.

35. The method of claim 34, wherein the behavior of the user further includes consuming the beverage at a particular time of day.

36. The method of claim 35, wherein the particular time of day includes the morning, and the beverage is coffee.

37. The method of claim 28, further comprising:

performing optical character recognition on at least one of the plurality of images; and

identifying the behavior of the user based on at least a result of the optical character recognition.

38. The method of claim 28, further comprising:

analyzing sound captured by a wearable microphone included in the wearable apparatus; and

identifying the behavior of the user based on at least a result of the analysis of the captured sound.

39. The method of claim 28, wherein the one or more images depicting the behavior of the user include two or more images.

40. A software product stored on a non-transitory computer readable medium and comprising data and computer implementable instructions for carrying out the method of claim 28.