OBJECT DETECTION WITH NEURAL NETWORK

• US 20170351936A1
• Filed: 12/17/2014
• Published: 12/07/2017
• Est. Priority Date: 12/17/2014
• Status: Active Grant

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Technologies Oy (Nokia Corporation)
• Inventors: Jiang, Xiaoheng
• Granted Patent: US 10,275,688 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 18/214 Generating training patterns; Bootstrap methods, e.g. bagging or boosting
• CPC Class Codes: G06F 18/24 Classification techniques
• CPC Class Codes: G06F 18/24323 Tree-organised classifiers
• CPC Class Codes: G06N 3/045 Combinations of networks
• CPC Class Codes: G06V 10/20 Image preprocessing
• CPC Class Codes: G06V 10/454 Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]
• CPC Class Codes: G06V 10/764 using classification, e.g. of video objects
• CPC Class Codes: G06V 10/82 using neural networks
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 40/10 Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• CPC Class Codes: Y04S 10/50 Systems or methods supporting the power network operation or management, involving a certain degree of interaction with the load-side end user applications

Abstract

According to an example aspect of the present invention, there is provided an apparatus comprising at least one processing core and at least one memory including computer program code, the at least one memory and the computer program code being configured to, with the at least one processing core, cause the apparatus at least to nm a convolutional neural network comprising an input layer arranged to provide signals to a first convolutional layer and a last convolutional layer, run a first intermediate classifier, the first intermediate classifier operating on a set of feature maps of the first convolutional layer, and decide to abort or to continue processing of a signal set based on a decision of the first intermediate classifier.

Claims

1-25. -25. (canceled)

26. An apparatus comprising at least one processing core and at least one memory including computer program code, the at least one memory and the computer program code being configured to, with the at least one processing core, cause the apparatus at least to:

run a convolutional neural network comprising an input layer arranged to provide signals to a first convolutional layer and a last convolutional layer;

run a first intermediate classifier, the first intermediate classifier operating on a set of feature maps of the first convolutional layer, and

decide to abort or to continue processing of a signal set based on a decision of the first intermediate classifier.

27. The apparatus according to claim 26, wherein the convolutional neural network comprises a second convolutional layer between the first convolutional layer and the last convolutional layer, and a second intermediate classifier which operates on a set of feature maps of the second convolutional layer, and the apparatus is configured to decide to abort or to continue processing of the signal set based on a decision of the second intermediate classifier.

28. The apparatus according to claim 27, wherein the convolutional neural network comprises a third convolutional layer between the second convolutional layer and the last convolutional layer, and a third intermediate classifier which operates on a set of feature maps of the third convolutional layer, and the apparatus is configured to decide to abort or to continue processing of the signal set based on a decision of the third intermediate classifier.

29. The apparatus according to claim 26, wherein the set of feature maps of the first convolutional layer comprises a subset of all feature maps of the first convolutional layer.

30. The apparatus according to claim 26, wherein the set of feature maps of the second convolutional layer comprises a subset of all feature maps of the second convolutional layer.

31. The apparatus according to claim 26, wherein the set of feature maps of the third convolutional layer comprises a subset of all feature maps of the third convolutional layer.

32. The apparatus according to claim 26, wherein the signal set comprises a processed sub-image of an image from the input layer.

33. The apparatus according to claim 26, wherein the signal set comprises a processed version of an image from the input layer.

34. The apparatus according to claim 26, wherein the convolutional neural network is configured to detect an image of a person.

35. The apparatus according to claim 34, wherein the convolutional neural network is configured to detect an image of a pedestrian.

36. The apparatus according to claim 29, wherein the apparatus is configured to select at least one of the set of feature maps of the first convolutional layer, the set of feature maps of the second convolutional layer and the set of feature maps of the third convolutional layer based on at least one criterion.

37. A method comprising:

running a convolutional neural network comprising an input layer arranged to provide signals to a first convolutional layer and a last convolutional layer;

running a first intermediate classifier, the first intermediate classifier operating on a set of feature maps of the first convolutional layer, and

deciding to abort or to continue processing of a signal set based on a decision of the first intermediate classifier.

38. The method according to claim 37, wherein the convolutional neural network comprises a second convolutional layer between the first convolutional layer and the last convolutional layer, and a second intermediate classifier which operates on a set of feature maps of the second convolutional layer, and the method comprises deciding to abort or to continue processing of the signal set based on a decision of the second intermediate classifier.

39. The method according to claim 38, wherein the convolutional neural network comprises a third convolutional layer between the second convolutional layer and the last convolutional layer, and a third intermediate classifier which operates on a set of feature maps of the third convolutional layer, and the method comprises deciding to abort or to continue processing of the signal set based on a decision of the third intermediate classifier.

40. The method according to claim 37, wherein the set of feature maps of the first convolutional layer comprises a subset of all feature maps of the first convolutional layer.

41. The method according to claim 37, wherein the set of feature maps of the second convolutional layer comprises a subset of all feature maps of the second convolutional layer.

42. The method according to claim 37, wherein the set of feature maps of the third convolutional layer comprises a subset of all feature maps of the third convolutional layer.

43. The method according to claim 37, wherein the signal set comprises a processed sub-image of an image from the input layer.

44. The method according to claim 37, wherein the signal set comprises a processed version of an image from the input layer.

45. A non-transitory computer readable medium having stored thereon a set of computer readable instructions that, when executed by at least one processor, cause an apparatus to at least:

run a convolutional neural network comprising an input layer arranged to provide signals to a first convolutional layer and a last convolutional layer;

run a first intermediate classifier, the first intermediate classifier operating on a set of feature maps of the first convolutional layer, and

decide to abort or to continue processing of a signal set based on a decision of the first intermediate classifier