Object Discovery From a Single Unlabeled Image by Mining Frequent Itemset With Multi-scale Features
Abstract : The goal of our work is to discover dominant objects in a very general setting where only a single un labeled image is given. This is far more challenge than typical co-localization or weakly-supervised localization tasks. To tackle this problem, we propose a simple but effective pattern mining-based method, called Object Location Mining (OLM), which exploits the advantages of data mining and feature representation of pre-trained convolutional neural networks (CNNs). Specifically, we first convert the feature maps from a pre-trained CNN model into a set of transactions, and then discovers frequent patterns from transaction database through pattern mining techniques. We observe that those discovered patterns, i.e., co-occurrence highlighted regions, typically hold appearance and spatial consistency.Motivated by this observation, we can easily discover and localize possible objects by merging relevant meaningful patterns. Extensive experiments on a variety of bench marks demonstrate that OLM achieves competitive localization performance compared with the state-of-the-art methods.We also evaluate our approach compared with unsupervised saliency detection methods and achieves competitive results on seven benchmark datasets.Moreover, we conduct experiments on fine-grained classification to show that our proposed method can locate the entire object and parts accurately, which can benefit to improving the classification results significantly.
? Frequent pattern mining searches for recurring relationships in a given dataset. this section introduces the basic concepts of frequent pattern mining for the discovery of interesting associations and correlations between item sets in transactional and relational databases.
? We begin presenting an example of market basket analysis, the earliest form of frequent pattern mining for association rules.
? Frequent item set mining leads to the discovery of associations and correlations among items in large transactional or relational datasets. With massive amounts of data continuously being collected and stored, many industries are becoming interested in mining such patterns from their databases.
? Object localization from unlabeled data is a very challenging problem, there exist a limited number of comparable methods.
? The extracts feature descriptors from the last max-pooling layer of a pre-trained VGG-16 model and employs a simple “mean-threshold” strategy to locate the main objects in fine-grained images.
? For promoting the development of saliency community, explores a deeper insight into the SOD problem and proposes a new high-quality SOC dataset.
? We propose a novel deep network architecture for unsupervised learning, which factors the image into multiple object instances that are based on the sparsity of images and the inter-frame structure of videos.
? We propose a method to discover the primary object in single images by completely unsupervised learning without any manual annotation or pre-trained features.
? Our segmentation quality tends to increase logarithmically with the amount of training data, which suggests the infinite possibilities of learning and generalization of our model.
? Besides, our model maintains a very high speed in testing and the experimental results demonstrate that it is at least two orders of magnitude faster than the related co-segmentation methods
? We propose a novel pattern mining-based method, called Object Location Mining (OLM), for object discovery and localization from a single unlabeled image. Our method exploits the advantage of data mining and feature representation of pre-trained CNN models.
? We also evaluate the localization ability on unsupervised saliency detection and fine-grained classification task .
? Our method achieves competitive performance compared with the state-of-the-art methods.
? we extract the deep features from multiple convolutional layers and use a tunable threshold to select the descriptors that are used to convert to items.
|