Southern corn rust (SCR) is a significant foliar disease, which can result in substantial corn yield losses. Unmanned aerial vehicle (UAV)-based optical remote sensing presents a promising method for efficiently monitoring SCR in field conditions. Nevertheless, its performance can be challenged by SCR's bottom-up pathogenesis and canopy occlusion in field conditions. In contrast, multi-view imaging spectral measurements (MISM) can mitigate the effects of canopy occlusion by collecting complementary information from different corn layers. However, a method to optimize the fusion of MISM for precise and efficient monitoring of SCR remains absent. In this study, an attention-based deep learning method was introduced for the automated extraction of critical spectral and spatial information from MISM to monitor SCR. First, the optimal spectral features for SCR were explored and identified. Second, the improvements in SCR monitoring were evaluated by comparing MISM with the sole use of nadir-view. Finally, the performances of two attention-based deep learning algorithms (i.e., attention-based Fully Connected Network (FCN) and attention-based Convolutional Neural Network (CNN)) were assessed against the baseline Random Forest (RF) algorithm. These results indicated that: (1) spectral indices based on green-red-red edge bands were most effective for SCR monitoring across various views; (2) MISM significantly improved the accuracy of SCR monitoring compared to that of nadir-view imaging spectral measurement (-10 % improvements in both OA and Macro F1); (3) the integration of an attention mechanism with FCN or CNN, which considers the varied importance of multi-view spectral features, further improved the accuracy of SCR monitoring. The highest accuracy in SCR monitoring (OA: 82.1 %, Macro F1: 0.82) was achieved by the attention-based FCN, with a -7 % improvement in both OA and Macro F1 relative to the RF. Overall, this study provides a promising method for efficiently monitoring SCR in field conditions, which could assist in making smart agriculture decisions and reducing pesticide inputs.

ObjectiveIn recent years, there has been a significant increase in the severity of leaf diseases in maize, with a noticeable trend of mixed occurrence. This poses a serious threat to the yield and quality of maize. However, there is a lack of studies that combine the identification of different types of leaf diseases and their severity classification, which cannot meet the needs of disease prevention and control under the mixed occurrence of different diseases and different severities in actual maize fields.MethodsA method was proposed for identifying the types of typical leaf diseases in maize and classifying their severity using hyperspectral technology. Hyperspectral data of three leaf diseases of maize: northern corn leaf blight (NCLB), southern corn leaf blight (SCLB) and southern corn rust (SCR), were obtained through greenhouse pathogen inoculation and natural inoculation. The spectral data were preprocessed by spectral standardization, SG filtering, sensitive band extraction and vegetation index calculation, to explore the spectral characteristics of the three leaf diseases of maize. Then, the inverse frequency weighting method was utilized to balance the number of samples to reduce the overfitting phenomenon caused by sample imbalance. Relief-F and variable selection using random forests (VSURF) method were employed to optimize the sensitive spectral features, including band features and vegetation index features, to construct models for disease type identification based on the full stages of disease development (including all disease severities) and for individual disease severities using several representative machine learning approaches, demonstrating the effectiveness of the research method. Furthermore, the study individual occurrence severity classification models were also constructed for each single maize leaf disease, including the NCLB, SCLB and SCR severity classification models, respectively, aiming to achieve full-process recognition and disease severity classification for different leaf diseases. Overall accuracy (OA) and Macro F1 were used to evaluate the model accuracy in this study.Results and DiscussionThe research results showed significant spectrum changes of three kinds of maize leaf diseases primarily focusing on the visible (550-680 nm), red edge (740-760 nm), near-infrared (760-1 000 nm) and shortwave infrared (1 300-1 800 nm) bands. Disease-specific spectral features, optimized based on disease spectral response rules, effectively identified disease species and classify their severity. Moreover, vegetation index features were more effective in identifying disease-specific information than sensitive band features. This was primarily due to the noise and information redundancy present in the selected hyperspectral sensitive bands, whereas vegetation index could reduce the influence of background and atmospheric noise to a certain extent by integrating relevant spectral signals through band calculation, so as to achieve higher precision in the model. Among several machine learning algorithms, the support vector machine (SVM) method exhibited better robustness than random forest (RF) and decision tree (DT). In the full stage of disease development, the optimal overall accuracy (OA) of the disease classification model constructed by SVM based on vegetation index reached 77.51%, with a Macro F1 of 0.77, representing a 28.75% increase in OA and 0.30 higher of Macro F1 compared to the model based on sensitive bands. Additionally, the accuracy of the disease classification model with a single severity of the disease increased with the severity of the disease. The accuracy of disease classification during the early stage of disease development (OA=70.31%) closely approached that of the full disease development stage (OA=77.51%). Subsequently, in the moderate disease severity stage, the optimal accuracy of disease classification (OA=80.00%) surpassed the optimal accuracy of disease classification in the full disease development stage. Furthermore, the optimal accuracy of disease classification under severe severity reached 95.06%, with a Macro F1 of 0.94. This heightened accuracy during the severity stage can be attributed to significant changes in pigment content, water content and cell structure of the diseased leaves, intensifying the spectral response of each disease and enhancing the differentiation between different diseases. In disease severity classification model, the optimal accuracy of the three models for maize leaf disease severity all exceeded 70%. Among the three kinds of disease severity classification results, the NCLB severity classification model exhibited the best performance. The NCLB severity classification model, utilizing SVM based on the optimal vegetation index features, achieved an OA of 86.25%, with a Macro F1 of 0.85. In comparison, the accuracy of the SCLB severity classification model (OA=70.35%, Macro F1=0.70) and SCR severity classification model (OA=71.39%, Macro F1=0.69) were lower than that of NCLB.ConclusionsThe aforementioned results demonstrate the potential to effectively identify and classify the types and severity of common leaf diseases in maize using hyperspectral data. This lays the groundwork for research and provides a theoretical basis for large-scale crop disease monitoring, contributing to precision prevention and control as well as promoting green agriculture.

BACKGROUNDSpatial-explicit weed information is critical for controlling weed infestation and reducing corn yield losses. The development of unmanned aerial vehicle (UAV)-based remote sensing presents an unprecedented opportunity for efficient, timely weed mapping. Spectral, textural, and structural measurements have been used for weed mapping, whereas thermal measurements-for example, canopy temperature (CT)-were seldom considered and used. In this study, we quantified the optimal combination of spectral, textural, structural, and CT measurements based on different machine-learning algorithms for weed mapping. RESULTSCT improved weed-mapping accuracies as complementary information for spectral, textural, and structural features (up to 5% and 0.051 improvements in overall accuracy [OA] and Marco-F1, respectively). The fusion of textural, structural, and thermal features achieved the best performance in weed mapping (OA = 96.4%, Marco-F1 = 0.964), followed by the fusion of structural and thermal features (OA = 93.6%, Marco-F1 = 0.936). The Support Vector Machine-based model achieved the best performance in weed mapping, with 3.5% and 7.1% improvements in OA and 0.036 and 0.071 in Marco-F1 respectively, compared with the best models of Random Forest and Naive Bayes Classifier. CONCLUSIONThermal measurement can complement other types of remote-sensing measurements and improve the weed-mapping accuracy within the data-fusion framework. Importantly, integrating textural, structural, and thermal features achieved the best performance for weed mapping. Our study provides a novel method for weed mapping using UAV-based multisource remote sensing measurements, which is critical for ensuring crop production in precision agriculture. (c) 2023 The Authors. Pest Management Science published by John Wiley & Sons Ltd on behalf of Society of Chemical Industry.

Southern corn leaf blight (SCLB) seriously threatens corn production. The timely and accurate monitoring of SCLB conditions (e.g., detection during the asymptomatic stage and severity classification during the symptomatic stage) is valuable for precision agriculture, because the application of pesticides depends on disease conditions. Compared with time-consuming and laborious field surveys, spectroscopy is a promising tool for plant disease monitoring. The unique advantages of combining multiple spectral enhancement features for monitoring rice and wheat diseases have been recognized. However, physiological and biochemical differences between maize leaves and rice and wheat leaves, along with the specific spectral response of SCLB, are likely to affect the performance of combining multiple spectral enhancement features. In addition, similar previous studies have not combined spectral slope features, i.e., first-order spectral derivatives (FSDs), with spectral bands (SBs) and spectral indices (SIs) and wavelet features (WFs) to improve plant disease detection. Thus, the performance of a method that combines FSDs, WFs, SBs, and SIs for SCLB asymptomatic detection, symptomatic detection, and symptomatic severity classification should be evaluated further. Here, the utility of combining SBs, SIs, WFs, and FSDs was quantified and evaluated in the asymptomatic detection, symptomatic detection, and symptomatic severity classification of SCLB. Various forms of spectral enhancement features that were sensitive to SCLB infection from the asymptomatic stage to the severe stage were first identified and combined using the RELIEF-F and sequential floating forward selection algorithms on the basis of two independent inoculation experiments. Finally, SCLB asymptomatic detection, symptomatic detection, and symptomatic severity classification models were developed and evaluated using the support vector machine algorithm. Results showed that combining FSDs with SBs, SIs, and WFs achieved the best performance in SCLB spectroscopic monitoring. (1) SCLB asymptomatic detection and symptomatic detection were moderately improved, i.e., overall accuracy (OA) and macro F1 (MF1) improved by ~ 1% to 2%. The OA of SCLB asymptomatic detection was 87.1% with an MF1 of 0.87, and that of symptomatic detection was 93.1% with an MF1 of 0.93. (2) SCLB symptomatic severity classification was significantly improved, i.e., OA and MF1 improved by ~ 7%. The OA of severity classification was 81.8% with am MF1 of 0.82. This study demonstrated that the complementary relationships among SBs, SIs, WFs, and FSDs could effectively improve SCLB spectroscopic monitoring. The proposed method provides a novel tool for large-scale SCLB spectroscopic monitoring. It has broad implications for assisting management decisions (i.e., when and where to apply pesticides and how much to apply) in precision agriculture.

Plantation forests provide critical ecosystem services and have experienced worldwide expansion during the past few decades. Accurate mapping of tree species through remote sensing is critical for managing plantation forests. The typical temporal behaviors and traits of tree species in satellite image time series (SITS) generate temporal and spectral features in multiple phenological stages that are critical to improve tree species mapping. However, the diverse input features, sequential relations and complex structures in SITS drastically increase the dimension and difficulty of spectral-temporal feature extraction, which challenges the capacity of many general classifiers not explicitly adapted for spectral-temporal learning. As a result, there is still a lack of a method that could automatically extract spectral-temporal features with high separability and regional adaptability from highdimensional SITS for tree species mapping of plantation forests. Moreover, the effects of varying temporal resolution and feature combination on the plantation tree species mapping are under-explored. Here, we developed a multi-head attention-based method for automatically extracting spectral-temporal features with high separability based on a modified Transformer network (Transformer4SITS) for improved plantation tree species mapping. The end-to-end network model consists of a feature extraction module to learn deep spectral-temporal features from SITS and a fusion module to combine multiple features for improving mapping accuracy. We applied this method to two representative plantation forests in southern and northern China for tree species mapping. The results show that: (1) Transformer4SITS method could self-adaptively extract typical spectraltemporal features of key phenological stages (e.g., greenness rising and falling) from SITS, and achieved significantly improved accuracies by at most 15% in comparison with all four baseline methods (i.e., long shortterm memory, harmonic analysis, time-weighted dynamic time warping, linear discriminant analysis); (2) time series with higher temporal resolution tended to produce more accurate species maps consistently across two sites, with their overall accuracies (OA) respectively increasing from 91.05% and 84.33% (60-day) to 94.88% and 88.72% (5-day), but the effect of high temporal resolution respectively leveled off around 90-day and 50-day resolution across two sites; (3) the mapping results using all available bands and two-band spectral indices outperformed the results using a subset of them, but with only modest increase in the accuracy (i.e., OA increased from 93.63% and 86.01% to 94.88% and 88.72%. This study thus provides a state-of-the-art deep learning-based method for improved tree species mapping, which is critical for sustainable management and biodiversity monitoring of plantation forests across large scales.

The recent northward expansion of Southern Pine Beetle (SPB) outbreaks associated with warming winters has caused extensive tree mortality in temperate pine forests, significantly affecting forest dynamics, structure, and functioning. Spatially-explicit early warning and detection of SPB-induced tree mortality is critical for timely and sustainable forest management practices. The unique contributions of remote sensing technologies to mapping the location, extent, and severity of beetle outbreaks, as well as assisting in analyzing the potential drivers for outbreak predictions, have been well recognized. However, little is known about the performance of moderate resolution satellite multispectral imagery for early warning and detection of SPB-induced tree mortality. Thus, we conducted this study, as the first attempt, to capture the spatial-temporal patterns of SPB infestation severity at the regional scale and to understand the underlying environmental drivers in a spatially-explicit manner. First, we explored the spectral signatures of SPB-killed trees based on 30-m plot measurements and Landsat-8 imagery. Then, to improve detection accuracy for areas with low-moderate SPB infestation severity, we added spectraltemporal anomaly information in the form of a linear trend of the spectral index trajectory to a previously developed approach. The best overall accuracy increased from 84.7% to 90.1% and the best Macro F1 value increased from 0.832 to 0.900. Next, we compared the performances of spectral indices in mapping SPB infestation severity (i.e., % red stage within the 30-m grid cell). The results showed that the combination of Normalized Difference Moisture Index and Tasseled Cap Greenness had the best performance for mapping SPB infestation severity (2016: R2 = 0.754; RSME = 15.7; 2017: R2 = 0.787; RSME = 12.4). Finally, we found that climatic and landscape variables can explain the detected patterns of SPB infestation from 2014 to 2017 in our study area (R2 = 0.751; RSME = 9.67), providing valuable insights on possible predictors for early warning of SPB infestation. Specifically, in our study area, winter dew point temperature was found to be one of the most important predictors, followed by SPB infestation locations in the previous year, canopy cover of host species, elevation, and slope. In the context of continued global warming, our study not only provides a novel framework for efficient, spatially-explicit, and quantitative measurements of forest damage induced by SPB infestation over large scales, but also uncovers opportunities to predict future SPB outbreaks and take precautions against it.

Ratoon rice production has been an emerging cropping system to increase food quality and productivity worldwide. Efficient monitoring of ratoon rice aboveground biomass (AGB) over large areas is valuable for precision agriculture, as AGB is closely related to crop grain yield and quality. Unmanned aerial vehicle (UAV) remote sensing has opened an unprecedented opportunity to efficiently monitor crop AGB instead of labor-intensive ground measurements. Vegetation indices (VIs)-based approach for estimating AGB is easily affected by background materials and often suffers saturation problems at high AGB levels. Although the combined use of UAV-collected structural and spectral features can alleviate these problems to some extent, uncertainties on the AGB estimation still exist for crop with significant difference in canopy architecture and AGB composition throughout the growing season (e.g., ratoon rice). There is a hypothesis that the combination of spectral, textural and structural features can improve ratoon rice AGB estimations across different developmental stages. Therefore, the utility of UAV-based spectral, textural and structural features were quantified in estimating ratoon rice AGB at field level with contrasting agronomic treatments (i.e., nitrogen fertilizer and stubble height), in which multiple linear regression (MLR) and gaussian process regression (GPR) methods were applied and compared. Results showed that (1) each feature had its own respective limitation: specifically, spectral and textural features exhibited insufficient sensitivity to AGB variability of remaining stubbles or stem at early stage and suffered saturation problem at grain filling stage; structural features were difficult to detect the emergence of panicles from panicle initiation to heading stages; (2) the combination of three types of features can complement each other and achieved the highest accuracy using GPR method: the combination of spectral, structural and textural features achieved the best estimation accuracy for estimating ratoon rice AGB with an R2 of 0.94 and RMSE of 81.4 g m−2 across different developmental stages, which significantly improved the model performance compared to the combination of spectral and textural features (R2 = 0.56, RMSE = 170.2 g m−2) and the combination of spectral and structural features (R2 = 0.86, RMSE = 138.8 g m−2). In summary, this study provides a novel approach for efficiently estimating ratoon rice AGB at field level, which is critical for timely decision making (e.g., determine when and where to apply fertilizer or pesticide) in precision agriculture.

Spatial information on urban forest canopy height (FCH) is fundamental for urban forest monitoring and assisting urban planning and management. Traditionally, ground-based canopy height measurements are time-consuming and laborious, making it challenging for periodic inventory of urban FCH at crown level. Airborne-light detection and ranging (LiDAR) sensor can efficiently measure crown-level FCH; however, the high cost of airborne-LiDAR data collection over large scales hinders its wide applications at a high temporal resolution. Previous studies have shown that in some cases, the Unmanned Aerial Vehicle (UAV)-digital aerial photogrammetry (DAP) approach (i.e., UAV-based structure from motion algorithm) is equivalent to or even outperform airborne-LiDAR in measuring forest structure, but few studies have evaluated their performances in measuring FCH in more complex urban environment, across non-ground coverage (including both canopy and building coverage) and topographical slope gradients. Also, the contribution of multi-angle measurement technique from UAV-DAP to FCH estimation accuracy has rarely been explored in the urban environment. Here, we compared the performances of UAV-LiDAR and UAV-DAP approaches on measuring thousands of crown-level FCH at different non-ground coverage and topographical slope areas in an urban environment. Specifically, UAV-LiDAR-based spatial measurements of crown-level FCH were used as the reference after ground-based validation (R2 = 0.88, RMSE = 2.36 m). The accuracy of UAV-DAP approach with/without multi-angle measurement in different non-ground coverage and topographical slope areas were then analyzed. The results showed that although the DAP multi-angle-based approach can improve the accuracy of spatial measurement for crown-level FCH in some cases, non-ground coverage (including both canopy and building coverage) was still the main factor affecting the broad applications of DAP approach in measuring urban FCH: at areas where non-ground coverage < 0.95, no matter how topographical slope varied, the accuracy of DAP approach was high (R2 = 0.86∼0.94, RMSE = 1.56∼2.93 m); at areas where non-ground coverage > 0.95, except for the case of flat areas (i.e., topographical slope <= 2°), the accuracy of DAP was poor (R2 = 0.20, RMSE = 12.34 m). However, using LiDAR-digital terrain model (DTM) instead of DAP-DTM, at areas where non-ground coverage > 0.95, can significantly improve the accuracy of UAV-DAP approach in measuring crown-level FCH (R2 = 0.91, RMSE =1.61 m). Our study thus provides a complete guidance on the usage of cost-effective UAV-DAP approach for measuring crown-level FCH in the urban environment, which will be helpful for precise urban forest management and improving the efficiency of urban environmental planning.

智慧农业代表着未来农业的发展方向,是我国农业高质量发展的重要内容.农业遥感技术在智慧农业的信息感知和定量决策中具有举足轻重的作用.文章重点梳理了农业遥感技术在作物识别与制图、病虫害监测、草害监测、作物关键理化参数反演及产量监测预测等方面的研究进展和应用,探讨了其未来发展方向和趋势.

Unmanned aerial vehicles-collected (UAVs) digital red–green–blue (RGB) images provided a cost-effective method for precision agriculture applications regarding yield prediction. This study aims to fully explore the potential of UAV-collected RGB images in yield prediction of winter wheat by comparing it to multi-source observations, including thermal, structure, volumetric metrics, and ground-observed leaf area index (LAI) and chlorophyll content under the same level or across different levels of nitrogen fertilization. Color indices are vegetation indices calculated by the vegetation reflectance at visible bands (i.e., red, green, and blue) derived from RGB images. The results showed that some of the color indices collected at the jointing, flowering, and early maturity stages had high correlation (R2 = 0.76–0.93) with wheat grain yield. They gave the highest prediction power (R2 = 0.92–0.93) under four levels of nitrogen fertilization at the flowering stage. In contrast, the other measurements including canopy temperature, volumetric metrics, and ground-observed chlorophyll content showed lower correlation (R2 = 0.52–0.85) to grain yield. In addition, thermal information as well as volumetric metrics generally had little contribution to the improvement of grain yield prediction when combining them with color indices derived from digital images. Especially, LAI had inferior performance to color indices in grain yield prediction within the same level of nitrogen fertilization at the flowering stage (R2 = 0.00–0.40 and R2 = 0.55–0.68), and color indices provided slightly better prediction of yield than LAI at the flowering stage (R2 = 0.93, RMSE = 32.18 g/m2 and R2 = 0.89, RMSE = 39.82 g/m2) under all levels of nitrogen fertilization. This study highlights the capabilities of color indices in wheat yield prediction across genotypes, which also indicates the potential of precision agriculture application using many other flexible, affordable, and easy-to-handle devices such as mobile phones and near surface digital cameras in the future.

The fraction of absorbed photosynthetically active radiation (fAPAR) is a critical biophysical parameter for crop growth monitoring and yield estimation. Remote sensing provides an efficient way for measuring fAPAR over large areas, compared with the time-consuming and labor-intensive field measurements. However, the optical remote sensing signals usually saturate over dense vegetation (e.g., Leaf Area Index (LAI) > 5 or fAPAR > 0.7), limiting the performance of optical remote sensing in modeling fAPAR. Multi-source remote sensing data fusion has proven to be a feasible method to overcome the saturation problem of optical remote sensing in vegetation monitoring, but little is known about the performance of optical, structural and thermal features fusion for modeling winter wheat fAPAR. Also, the modeling powers of optical, structural, and thermal features for fAPAR estimation have seldom been compared. To fill in these knowledge gaps, the very high spatial resolution RGB-optical and thermal imagery collected by Unmanned Aircraft Vehicle (UAV) were used to quantify the powers of RGB-derived vegetation indices (VIs), Structural Indices (SIs, crop height/canopy cover), and Canopy Temperature (CT) and their combinations in modeling winter wheat fAPAR in this study. The modeling powers of different remote sensing features were compared with the commonly used hyperspectral vegetation indices (HVIs) from field spectrometer measurements. Results showed that (1) multi-source data fusion that integrates optical, structural, and thermal features provided the best model in winter wheat fAPAR mapping (R2 = 0.907 and RMSE = 0.041) ; (2) the RGB imagery-derived optical (i.e., RGB VIs) and structural features (i.e., RGB SIs) were important preditors for winter wheat fAPAR modeling, and their combination can steadily improve the modeling accuracy (~2% improvement in R2 compared to optical-only model); (3) the thermal feature alone performed the worst among all experiments, but it still can complement other types of remote sensing features (i.e., RGB VIs&SIs) and further improve the modeling accuracy within the framework of data fusion (~3% improvement in R2 compared to optical-only model). In general, this study indicates that the framework of multi-source remote sensing data fusion can provide more accurate, efficient measurements of winter wheat fAPAR for crop management in precision agriculture, which can help improve resource utilization efficiency (e.g., determine where and when to apply nitrogen fertilizer) and ensure food security in the face of climate change.

Southern Corn Rust (SCR) is one of the most destructive diseases in corn production, significantly affecting corn quality and yields globally. Field-based fast, nondestructive diagnosis of SCR is critical for smart agriculture applications to reduce pesticide use and ensure food safety. The development of spectral disease indices (SDIs), based on in situ leaf reflectance spectra, has proven to be an effective method in detecting plant diseases in the field. However, little is known about leaf spectral signatures that can assist in the accurate diagnosis of SCR, and no SDIs-based model has been reported for the field-based SCR monitoring. Here, to address those issues, we developed SDIs-based monitoring models to detect SCR-infected leaves and classify SCR damage severity. In detail, we first collected in situ leaf reflectance spectra (350–2500 nm) of healthy and infected corn plants with three severity levels (light, medium, and severe) using a portable spectrometer. Then, the RELIEF-F algorithm was performed to select the most discriminative features (wavelengths) and two band normalized differences for developing SDIs (i.e., health index and severity index) in SCR detection and severity classification, respectively. The leaf reflectance spectra, most sensitive to SCR detection and severity classification, were found in the 572 nm, 766 nm, and 1445 nm wavelength and 575 nm, 640 nm, and 1670 nm wavelength, respectively. These spectral features were associated with leaf pigment and leaf water content. Finally, by employing a support vector machine (SVM), the performances of developed SCR-SDIs were assessed and compared with 38 stress-related vegetation indices (VIs) identified in the literature. The SDIs-based models developed in this study achieved an overall accuracy of 87% and 70% in SCR detection and severity classification, 1.1% and 8.3% higher than the other best VIs-based model under study, respectively. Our results thus suggest that the SCR-SDIs is a promising tool for fast, nondestructive diagnosis of SCR in the field over large areas. To our knowledge, this study represents one of the first few efforts to provide a theoretical basis for remote sensing of SCR at field and larger scales. With the increasing use of unmanned aerial vehicles (UAVs) with hyperspectral measurement capability, more studies should be conducted to expand our developed SCR-SDIs for SCR monitoring at different study sites and growing stages in the future.