Automatic assignment of media content items to digital signage device based on comparison between demographic information collected at digital signage device and media content metadata

• US 9,836,762 B1
• Filed: 12/11/2013
• Issued: 12/05/2017
• Est. Priority Date: 12/11/2013
• Status: Active Grant

• Current Assignee: AmZetta Technologies, LLC (American Megatrends International, LLC)
• Original Assignee: American Megatrends Incorporated
• Inventors: Sivertsen, Clas Gerhard
• Primary Examiner(s): Abrahamson, Amanda
• Assistant Examiner(s): Anderson, Scott C
• Application Number:
  US14/103,391
• Time in Patent Office: 1,455 Days
• CPC Class Codes: G06Q 30/0204 Market segmentation
• CPC Class Codes: G06Q 30/0257 User requested
• CPC Class Codes: G06Q 30/0264 based upon schedule

Abstract

In certain aspects, a media content management and deployment system is provided. A data store stores content metadata associated with media content items and specifying a target demographic of each of the media content items. A demographic information server obtains first demographic data specifying a first demographic in a first timeslot at a location of a first signage device, predicts a second demographic in a second timeslot at the location based on the first demographic data, wherein the second timeslot is subsequent to the first timeslot, and generates second demographic data specifying the second demographic. When a deployment module obtains the second demographic data, the deployment module compares the content metadata with the second demographic data, selects a media content item from the plurality of media content items based on the comparison, and sends a media item identification identifying the selected media content to the first signage device.

Claims

1. A media content management and deployment system, comprising:

a data store having a processor and a memory, wherein the data store is configured to store content metadata associated with a plurality of media content items, wherein the content metadata specify a target demographic of each of the media content items;

a demographic information server configured to

obtain first demographic data specifying a first demographic in a first timeslot at a location of a first signage device of a plurality of signage devices each comprising a display device, each of the signage devices further including a camera that captures images of people passing by and a plurality of processing engines that are different, each of the plurality of processing engines being configured to

(a) implement a same common interface through which a component of the each signage device accesses that processing engine, wherein the common interface includes a function through which a detection level of that processing engine is set,

(b) digitally process the captured images, when requested, to generate demographic data associated with the captured images,

(c) detect, in each of the captured images, at least one of an edge direction, an edge strength, and offset from a segment center for each segment to determine a person in the each image and personal attributes of the person, and

(d) detect image attributes of a first image of the captured images in accordance with the detection level set for that processing engine, wherein that processing engine supports at least six detection levels, each of the six detection levels indicating a respective one of collections of image attributes that is to be detected by that processing engine;

(i) a collection including an image attribute indicating whether the first image contains a human,

(ii) a collection including all preceding attributes and an image attribute indicating a number of humans contained in the first image,

(iii) a collection including all preceding attributes and image attributes indicating a number of humans contained in the first image who are static and a number of humans contained in the first image who are in motion,

(iv) a collection including all preceding attributes and image attributes indicating age categories of the humans contained in the first image,

(v) a collection including all preceding attributes and image attributes indicating genders of the humans contained in the first image, and

(vi) a collection including all preceding attributes and image attributes indicating whether the humans contained in the first image are associated with accessories, a stroller, glasses, a beard, a tie, a brief-case, or a suitcase; and

predict a second demographic in a second timeslot at the location based on the first demographic data, the demographic patterns, and the demographic patterns trend, wherein the second timeslot is subsequent to the first timeslot,

generate second demographic data specifying the second demographic, and

identify locations and timeslots of one or more selected signage devices based on demographic parameters indicating a particular demographic, the particular demographic including the second demographic, the first signage device being among the one or more selected signage devices, the second timeslot is among the identified timeslots of the first signage device;

a deployment module configured to

obtain the content metadata associated with the plurality of media content items,

obtain the second demographic data,

compare the content metadata associated with the plurality of media content items with the second demographic data,

select a media content item from the plurality of media content items based on the comparison,

send a media item identification identifying the selected media content to the first signage device,

determine whether a budget requirement set by a user allows bidding an outbid timeslot at the location of the first signage device at a price higher than an outbidding price bid by another user, and

in response to determining the budget requirement does not allow bidding the outbid timeslot at the price higher than the outbidding price, send a request for increasing budget to a front end server.

2. The system of claim 1, wherein the front end server is configured to

send a user input interface to a remote computing device, wherein the user input interface allows the user to input the content metadata,

receive the content metadata from the remote computing device, and

store the content metadata to the data store.

3. The system of claim 1, further comprising:

an uploader, configured to

receive a media file and demographic data specifying a target demographic of the media file from the remote computing device,

store the demographic data in a meta tag field of the media file,

store the media file in a storage server, and

instruct the data store to include the demographic data in the content metadata of a content item associated with the media file.

4. The system of claim 1, wherein the first signage device comprises:

a camera configured to capture at least one image frame; and

a signage device controller in communication to the camera, the signage device controller comprising a processor and a non-volatile memory storing software, wherein the software is configured, when executed at the processor, to

process the captured at least one image frame;

detect persons in the at least one image frame;

generate at least one demographic-map data object specifying demographic information of the persons detected in the image frame; and

send the at least one demographic-map data object to the demographic information server.

5. The system of claim 4, wherein the at least one demographic-map data object comprises:

personal attribute data specifying at least one of gender, age, ethnicity, height, skin color, hair color, hair length, facial hair, weight, motion, accessories, stroller, glasses, beard, tie, brief-case, and suitcase information of the detected persons; and

personal behavior data specifying at least one of duration at the location and attentiveness information of the detected persons.

6. The system of claim 4, wherein the at least one demographic-map data object comprises:

a timestamp indicating a time to which the demographic information specified in the at least one demographic-map data object is directed; and

a location identifier indicating a location to which the demographic information specified in the at least one demographic-map data object is directed.

7. The system of claim 4, wherein the demographic information server is configured to obtain the first demographic data from data contained in the at least one demographic-map data object.

8. The system of claim 4, wherein the at least one demographic-map data object includes a plurality of demographic-map data objects having different timestamps;

wherein the demographic information server is configured to

obtain observed demographic data specifying demographics in each of a first plurality of timeslots at the location of the first signage device, and

generate predicated demographic data specifying demographics in each of a second plurality of timeslots at the location based on the observed demographic data;

wherein the deployment module is configured to

receive the predicted demographic data and indications of the second plurality of timeslots,

compare the content metadata with the predicted demographic data,

select, for each of the second plurality of timeslots, a media content item from the plurality of media content items based on the comparison, and

send a program list to the first signage device, wherein the program list includes indications of the second plurality of timeslots and the selected content item for each of the second plurality of timeslots.

9. The system of claim 1, wherein the demographic information server is configured to

receive the demographic-map data objects from a plurality of second signage devices located at different locations, wherein each of the second signage devices is configured to

generate demographic-map data objects specifying demographic information of the respective location at different times, and

send the demographic-map data objects to the demographic information server, and

generate demographic data specifying predicted demographics for different future timeslots at each of the locations of the plurality of second signage devices.

10. The system of claim 9, wherein the deployment module is configured to obtain the demographic data specifying the predicted demographics,

compare the content metadata with the demographic data specifying predicted demographics,

select, for each of the future timeslots of each of the second signage devices, a media content item from the plurality of media content items based on the comparison, and

send a program list to each of the second signage devices, wherein the respective program list includes indications of the respective future timeslots of the each second signage device and the selected content item for each of the respective future timeslots.

11. A method of managing and deploying media content, comprising:

storing, in a data store, content metadata associated with a plurality of media content items, wherein the content metadata specify a target demographic of each of the media content items;

obtaining, at a demographic information server, first demographic data specifying a first demographic in a first timeslot at a location of a first signage device of a plurality of signage devices each comprising a display device, each of the signage devices further including a camera that captures images of people passing by and a plurality of processing engines that are different, each of the plurality of processing engines

(a) implementing a same common interface through which a component of the each signage device accesses that processing engine, wherein the common interface includes a function through which a detection level of that processing engine is set,

(b) digitally processing the captured images, when requested, to generate demographic data associated with the captured images,

(c) detecting, in each of the captured images, at least one of an edge direction, an edge strength, and offset from a segment center for each segment to determine a person in the each image and personal attributes of the person;

(d) detecting image attributes of a first image of the captured images in accordance with the detection level set for that processing engine, wherein that processing engine supports at least six detection levels, each of the six detection levels indicating a respective one of collections of image attributes that is to be detected by that processing engine;

(i) a collection including an image attribute indicating whether the first image contains a human,

(ii) a collection including all preceding attributes and an image attribute indicating a number of humans contained in the first image,

(iii) a collection including all preceding attributes and image attributes indicating a number of humans contained in the first image who are static and a number of humans contained in the first image who are in motion,

(iv) a collection including all preceding attributes and image attributes indicating age categories of the humans contained in the first image,

(v) a collection including all preceding attributes and image attributes indicating genders of the humans contained in the first image, and

(vi) a collection including all preceding attributes and image attributes indicating whether the humans contained in the first image are associated with accessories, a stroller, glasses, a beard, a tie, a brief-case, or a suitcase;

predicting, at the demographic information server, a second demographic in a second timeslot at the location based on the first demographic data, the demographic patterns, and the demographic patterns trend, wherein the second timeslot is subsequent to the first timeslot;

generating, at the demographic information server, second demographic data specifying the second demographic;

identifying locations and timeslots of one or more selected signage devices based on demographic parameters indicating a particular demographic, the particular demographic including the second demographic, the first signage device being among the one or more selected signage devices, the second timeslot is among the identified timeslots of the first signage device;

obtaining the content metadata associated with the plurality of media content items;

obtaining, at a deployment module, the second demographic data;

comparing, at the deployment module, the content metadata associated with the plurality of media content items with the second demographic data;

selecting, at the deployment module, a media content item from the plurality of media content items based on the comparison;

sending, from the deployment module, a media item identification identifying the selected media content to the first signage device;

determining whether a budget requirement set by a user allows bidding an outbid timeslot at the location of the first signage device at a price higher than an outbidding price bid by another user; and

in response to determining the budget requirement does not allow bidding the outbid timeslot at the price higher than the outbidding price, sending a request for increasing budget to a front end server.

12. The method of claim 11, further comprising:

sending, from the front end server, a user input interface to a remote computing device, wherein the user input interface is configured to receive the content metadata from the user;

receiving, at the front end server, the content metadata from the remote computing device; and

storing, by the front end server, the content metadata to the data store.

13. The method of claim 11, further comprising:

receiving, at an uploader, a media file and demographic data specifying a target demographic of the media file from the remote computing device;

storing, by the uploader, the demographic data in a meta tag field of the media file;

storing, by the uploader, the media file in a storage server; and

instructing, by the uploader, the data store to include the demographic data in the content metadata of a content item associated with the media file.

14. The method of claim 11, wherein the first signage device comprises:

a camera configured to capture at least one image frame; and

a signage device controller in communication to the camera, the signage device controller comprising a processor and a non-volatile memory storing software, wherein the software is configured, when executed at the processor, to

process the captured at least one image frame;

detect persons in the at least one image frame;

generate at least one demographic-map data object specifying demographic information of the persons detected in the image frame; and

send the at least one demographic-map data object to the demographic information server.

15. The method of claim 14, wherein the at least one demographic-map data object comprises:

personal attribute data specifying at least one of gender, age, ethnicity, height, skin color, hair color, hair length, facial hair, weight, motion, accessories, stroller, glasses, beard, tie, brief-case, and suitcase information of the detected persons;

personal behavior data specifying at least one of duration at the location and attentiveness information of the detected persons;

a timestamp indicating a time to which the demographic information specified in the at least one demographic-map data object is directed; and

a location identifier indicating a location to which the demographic information specified in the at least one demographic-map data object is directed.

16. The method of claim 14, wherein the demographic information server is configured to obtain the first demographic data from data contained in the at least one demographic-map data object.

17. The method of claim 14, wherein the at least one demographic-map data object includes a plurality of demographic-map data objects having different timestamps;

wherein the method further comprises;

obtaining, at the demographic information server, observed demographic data specifying demographics in each of a first plurality of timeslots at the location of the first signage device;

generating, at the demographic information server, predicated demographic data specifying demographics in each of a second plurality of timeslots at the location based on the observed demographic data;

receiving, at the deployment module, the predicted demographic data and indications of the second plurality of timeslots;

comparing, at the deployment module, the content metadata with the predicted demographic data;

selecting, at the deployment module for each of the second plurality of timeslots, a media content item from the plurality of media content items based on the comparison; and

sending, at the deployment module, a program list to the first signage device, wherein the program list includes indications of the second plurality of timeslots and the selected content item for each of the second plurality of timeslots.

18. The method of claim 11, further comprising:

receiving, at the demographic information server, the demographic-map data objects from a plurality of second signage devices located at different locations, wherein each of the plurality of second signage devices is configured to

generate demographic-map data objects specifying demographic information of the respective location at different times, and

send the demographic-map data objects to the demographic information server;

generating, at the demographic information server, demographic data specifying predicted demographics for different future timeslots at each of the locations of the plurality of second signage devices;

obtaining, at the deployment module, the demographic data specifying the predicted demographics;

comparing, at the deployment module, the content metadata with the demographic data specifying predicted demographics;

selecting, at the deployment module for each of the future timeslots of each of the second signage devices, a media content item from the plurality of media content items based on the comparison; and

sending, at the deployment module, a program list to each of the second signage devices, wherein the respective program list includes indications of the respective future timeslots of the each second signage device and the selected content item for each of the respective future timeslots.

19. A non-transitory computer readable medium storing computer executable codes, wherein the codes comprise:

a data store, when executed at a processor, configured to store content metadata associated with a plurality of media content items, wherein the content metadata specify a target demographic of each of the media content items;

a demographic information server, when executed at the processor, configured to

obtain first demographic data specifying a first demographic in a first timeslot at a location of a first signage device of a plurality of signage devices each comprising a display device, each of the signage devices further including a camera that captures images of people passing by and a plurality of processing engines that are different, each of the plurality of processing engines being configured to

(a) implement a same common interface through which a component of the each signage device accesses that processing engine wherein the common interface includes a function through which a detection level of that processing engine is set,

(b) digitally process the captured images, when requested, to generate demographic data associated with the captured images,

(c) detect, in each of the captured images, at least one of an edge direction, an edge strength, and offset from a segment center for each segment to determine a person in the each image and personal attributes of the person, and

(d) detect image attributes of a first image of the captured images in accordance with the detection level set for that processing engine, wherein that processing engine supports at least six detection levels, each of the six detection levels indicating a respective one of collections of image attributes that is to be detected by that processing engine;

(i) a collection including an image attribute indicating whether the first image contains a human,

(ii) a collection including all preceding attributes and an image attribute indicating a number of humans contained in the first image,

(iii) a collection including all preceding attributes and image attributes indicating a number of humans contained in the first image who are static and a number of humans contained in the first image who are in motion,

(iv) a collection including all preceding attributes and image attributes indicating age categories of the humans contained in the first image,

(v) a collection including all preceding attributes and image attributes indicating genders of the humans contained in the first image, and

(vi) a collection including all preceding attributes and image attributes indicating whether the humans contained in the first image are associated with accessories, a stroller, glasses, a beard, a tie, a brief-case, or a suitcase;

predict a second demographic in a second timeslot at the location based on the first demographic data, the demographic patterns, and the demographic patterns trend, wherein the second timeslot is subsequent to the first timeslot,

generate second demographic data specifying the second demographic, and

identify locations and timeslots of one or more selected signage devices based on demographic parameters indicating a particular demographic, the particular demographic including the second demographic, the first signage device being among the one or more selected signage devices, the second timeslot is among the identified timeslots of the first signage device; and

a deployment module, when executed at the processor, configured to

obtain the second demographic data,

compare the content metadata with the second demographic data,

select a media content item from the plurality of media content items based on the comparison,

send a media item identification identifying the selected media content to the first signage device,

determine whether a budget requirement set by a user allows bidding an outbid timeslot at the location of the first signage device at a price higher than an outbidding price bid by another user, and

in response to determining the budget requirement does not allow bidding the outbid timeslot at the price higher than the outbidding price, send a request for increasing budget to a front end server.

20. The non-transitory computer readable medium of claim 19,

wherein the codes further comprise:

the front end server, when executed at the processor, configured to

send a user input interface to a remote computing device, wherein the user input interface allows the user to input the content metadata,

receive the content metadata from the remote computing device, and

store the content metadata to the data store; and

an uploader, when executed at the processor, configured to

receive a media file and demographic data specifying a target demographic of the media file from the remote computing device,

store the demographic data in a meta tag field of the media file,

store the media file in a storage server, and

instruct the data store to include the demographic data in the content metadata of a content item associated with the media file.

21. The non-transitory computer readable medium of claim 19, wherein the first signage device comprises:

a camera configured to capture at least one image frame; and

a signage device controller in communication to the camera, the signage device controller comprising a processor and a non-volatile memory storing software, wherein the software is configured, when executed at the processor, to

process the captured at least one image frame;

detect persons in the at least one image frame;

generate at least one demographic-map data object specifying demographic information of the persons detected in the image frame; and

send the at least one demographic-map data object to the demographic information server.

22. The non-transitory computer readable medium of claim 21, wherein the at least one demographic-map data object comprises:

personal attribute data specifying at least one of gender, age, ethnicity, height, skin color, hair color, hair length, facial hair, weight, motion, accessories, stroller, glasses, beard, tie, brief-case, and suitcase information of the detected persons;

personal behavior data specifying at least one of duration at the location and attentiveness information of the detected persons;

a timestamp indicating a time to which the demographic information specified in the at least one demographic-map data object is directed; and

a location identifier indicating a location to which the demographic information specified in the at least one demographic-map data object is directed.

23. The non-transitory computer readable medium of claim 21, wherein the demographic information server is configured to obtain the first demographic data from data contained in the at least one demographic-map data object.

24. The non-transitory computer readable medium of claim 21, wherein the at least one demographic-map data object includes a plurality of demographic-map data objects having different timestamps;

wherein the demographic information server is configured to

obtain observed demographic data specifying demographics in each of a first plurality of timeslots at the location of the first signage device, and

generate predicated demographic data specifying demographics in each of a second plurality of timeslots at the location based on the observed demographic data;

wherein the deployment module is configured to

receive the predicted demographic data and indications of the second plurality of timeslots,

compare the content metadata with the predicted demographic data,

select, for each of the second plurality of timeslots, a media content item from the plurality of media content items based on the comparison, and

send a program list to the first signage device, wherein the program list includes indications of the second plurality of timeslots and the selected content item for each of the second plurality of timeslots.

25. The non-transitory computer readable medium of claim 19,

wherein the demographic information server is configured to

receive the demographic-map data objects from a plurality of second signage devices located at different locations, wherein each of the second signage devices is configured to

generate demographic-map data objects specifying demographic information of the respective location at different times, and

send the demographic-map data objects to the demographic information server, and

generate demographic data specifying predicted demographics for different future timeslots at each of the locations of the plurality of second signage devices,

wherein the deployment module is configured to

obtain the demographic data specifying the predicted demographics,

compare the content metadata with the demographic data specifying predicted demographics,

select, for each of the future timeslots of each of the second signage devices, a media content item from the plurality of media content items based on the comparison, and

send a program list to each of the second signage devices, wherein the respective program list includes indications of the respective future timeslots of the each second signage device and the selected content item for each of the respective future timeslots.