A deep semantic vegetation health monitoring platform for citizen science imaging data

Khan, Asim ORCID: 0000-0003-0543-3350, Asim, Warda ORCID: 0000-0002-0501-7907, Ulhaq, Anwaar ORCID: 0000-0002-5145-7276 and Robinson, Randall ORCID: 0000-0001-8425-0709 (2022) A deep semantic vegetation health monitoring platform for citizen science imaging data. PLoS ONE, 17. ISSN 1932-6203


Automated monitoring of vegetation health in a landscape is often attributed to calculating values of various vegetation indexes over a period of time. However, such approaches suffer from an inaccurate estimation of vegetational change due to the over-reliance of index values on vegetation’s colour attributes and the availability of multi-spectral bands. One common observation is the sensitivity of colour attributes to seasonal variations and imaging devices, thus leading to false and inaccurate change detection and monitoring. In addition, these are very strong assumptions in a citizen science project. In this article, we build upon our previous work on developing a Semantic Vegetation Index (SVI) and expand it to introduce a semantic vegetation health monitoring platform to monitor vegetation health in a large landscape. However, unlike our previous work, we use RGB images of the Australian landscape for a quarterly series of images over six years (2015–2020). This Semantic Vegetation Index (SVI) is based on deep semantic segmentation to integrate it with a citizen science project (Fluker Post) for automated environmental monitoring. It has collected thousands of vegetation images shared by various visitors from around 168 different points located in Australian regions over six years. This paper first uses a deep learning-based semantic segmentation model to classify vegetation in repeated photographs. A semantic vegetation index is then calculated and plotted in a time series to reflect seasonal variations and environmental impacts. The results show variational trends of vegetation cover for each year, and the semantic segmentation model performed well in calculating vegetation cover based on semantic pixels (overall accuracy = 97.7%). This work has solved a number of problems related to changes in viewpoint, scale, zoom, and seasonal changes in order to normalise RGB image data collected from different image devices.

Dimensions Badge

Altmetric Badge

Item type Article
URI https://vuir.vu.edu.au/id/eprint/46135
DOI 10.1371/journal.pone.0270625
Official URL https://journals.plos.org/plosone/article?id=10.13...
Subjects Current > FOR (2020) Classification > 3103 Ecology
Current > Division/Research > Institute for Sustainable Industries and Liveable Cities
Keywords semantic vegetation index, SVI, imaging, vegetation health, landscape composition
Citations in Scopus 0 - View on Scopus
Download/View statistics View download statistics for this item

Search Google Scholar

Repository staff login