Dynamic Multicontext Segmentation of Remote Sensing Images Based on Convolutional Networks


Nogueira K, Dalla Mura M, Chanussot J, Schwartz WR & dos Santos JA (2019) Dynamic Multicontext Segmentation of Remote Sensing Images Based on Convolutional Networks. IEEE Transactions on Geoscience and Remote Sensing, 57 (10), pp. 7503-7520.

Semantic segmentation requires methods capable of learning high-level features while dealing with large volume of data. Toward such goal, convolutional networks can learn specific and adaptable features based on the data. However, these networks are not capable of processing a whole remote sensing image, given its huge size. To overcome such limitation, the image is processed using fixed size patches. The definition of the input patch size is usually performed empirically (evaluating several sizes) or imposed (by network constraint). Both strategies suffer from drawbacks and could not lead to the best patch size. To alleviate this problem, several works exploited multicontext information by combining networks or layers. This process increases the number of parameters, resulting in a more difficult model to train. In this paper, we propose a novel technique to perform semantic segmentation of remote sensing images that exploits a multicontext paradigm without increasing the number of parameters while defining, in training time, the best patch size. The main idea is to train a dilated network with distinct patch sizes, allowing it to capture multicontext characteristics from heterogeneous contexts. While processing these varying patches, the network provides a score for each patch size, helping in the definition of the best size for the current scenario. A systematic evaluation of the proposed algorithm is conducted using four high-resolution remote sensing data sets with very distinct properties. Our results show that the proposed algorithm provides improvements in pixelwise classification accuracy when compared to the state-of-the-art methods.

Convolutional networks (ConvNets); deep learning; multicontext; multiscale; remote sensing; semantic segmentation

IEEE Transactions on Geoscience and Remote Sensing: Volume 57, Issue 10

FundersPró-Reitoria de Pesquisa, Universidade Federal de Minas Gerais, Conselho Nacional de Desenvolvimento Científico e Tecnológico, Coordenação de Aperfeiçoamento de Pessoal de Nível Superior and Fundação de Amparo à Pesquisa do Estado de Minas Gerais
Publication date31/10/2019
Publication date online03/06/2019
Date accepted by journal21/04/2019
PublisherInstitute of Electrical and Electronics Engineers (IEEE)

Research centres/groups