Accurate tree volume and structure are crucial for forest biomass estimation and ecosystem investigations. While terrestrial laser scanning (TLS) offers non-destructive pathways for the detailed three-dimensional tree recon struction, current methods overestimate small branch volumes and often require tree segmentation and leaf-wood separation as a priori. This study introduces and validates RayExtract, a novel method for reconstructing woody volume from TLS data, utilising tools from the RayCloudTools library, to automate the extraction of tree struc tural metrics from point clouds. Our method incorporates two key morphological rules - Self-Similarity and Leonardo's Rule - to aid branch radius and taper calculations. Likewise, it enables rapid and automated plot-scale reconstruction by integrating tree segmentation and woody structure modelling without requiring leaf point classification. In this study, RayExtract demonstrated high accuracy across four high-quality destructive harvest reference sets with concordance correlation coefficient (CCC) values ranging from 0.82 to 0.97 (n=124). To explore algorithm behaviours under different leaf conditions and point densities, we implement a framework using TLS simulation of highly realistic synthetic trees. Results from the simulation framework show consistent high accuracy of total woody volume, with CCC ranging from 0.97 to 0.98 (n=18) across four distinct scan ning configurations. Fine-scale volumetric analysis revealed that incorporating simple morphological rules can effectively inform branch taper and reduce woody volume overestimation, particularly in smaller components. Furthermore, it identifies a limitation in volumetric accuracy in trees exhibiting significant taper in the lower stem. Analysis of RayExtract's computational efficiency demonstrates that runtime and memory usage scale pre dictably with input data size, primarily driven by point count and the associated structural complexity within the point cloud, positioning the algorithm as well suited for large-scale applications. RayExtract represents a significant advancement in forest reconstruction, biomass estimation, and vegetation structural analysis. The method's efficiency, accuracy, and robustness across varied forest conditions mark a substantial improvement in forest structural assessment techniques using laser scanning and have broad implications for improving re gional biomass estimations, and contributing to the calibration and validation of broad-scale remote sensing observations.
Terrestrial laser scanning (TLS) represents the gold standard in remote quantification of woody vegetation structure and volume, but is costly and time consuming to acquire. TLS data is typically collected at spatial scales of 1 ha or smaller, which limits its suitability for representing heterogeneous landscapes, and for training and validating satellite-based models which are needed for larger area monitoring. Advances in unoccupied aerial vehicle laser scanning (UAV-LS) sensors have recently narrowed the gap in quality between what TLS delivers and what can be acquired over larger areas from UAV platforms. We tested how well new nadir-forward–backward (NFB) UAV-LS technology can capture the structure of individual trees in a tropical savanna setting with a diversity of tree sizes and growth forms. UAV-LS data was acquired with a RIEGL VUX-120 LiDAR sensor mounted on a Acecore NOA hexacopter. Reference data was obtained with a RIEGL VZ-2000i TLS scanner using a multi-scan approach. Point clouds were segmented into individual trees and volumetrically reconstructed with RayCloudTools (RCT). We found no statistical difference between UAV-LS and TLS derived estimates of tree height, canopy cover, diameter, and wood volume. Mean tree height and DBH derived from UAV-LS were within 3% of the TLS estimate, and there was less than 1% deviation in stand wood volume. Our findings ease the advancements on the detailed monitoring of open forests, potentially achieving large-scale mapping and multi-temporal investigations. The open structure of savanna systems is well suited to UAV-LS sensing, but more research is needed across diverse ecosystems to understand the generality of these findings in landscapes with greater canopy closure or complex understorey conditions.
Background: Robots are not widely used in wildfire risk reduction. Firefighters do not commonly know how to use them and technology providers are not aware of key operational directions for improvements. Objective: This study aims to identify, catalogue and discuss directions for the development of robot technologies in terms of wildfire risk reduction. The viewpoint of the fire service is presented. Method: Survey was conducted with experts to gather new knowledge on the use of robots in wildfire response and to identify inspiration for improvements for technology providers. Results: 92 end-user-related developments were categorised into particular elements of wildfire response process. 31 development directions related to technology providers have been assigned to general robot functionalities: ensuring safety of firefighters, shaping situational awareness, and supporting firefighting systems. The robot functionality sets can be implemented in reconnaissance robots, delivery and evacuation robots, and firefighting robots. Conclusion: Fire service perceives the robot use in wildfire risk reduction more broadly than is reflected by currently developed disaster robots and existing disaster risk reduction concepts. The viewpoint of the fire service can raise awareness among end-users and inspire technology providers to effectively and rationally implement robots for wildfire risk reduction.
Generating accurate digital tree models from scanned environments is invaluable for forestry, agriculture, and other outdoor industries in tasks such as identifying fall hazards, estimating trees' biomass and calculating traversability. Existing methods for tree reconstruction rely on sparse feature identification to segment a forest into individual trees and generate a branch structure graph, limiting their application to easily separable trees and uniform forests. However, the natural world is a messy place in which trees present with significant heterogeneity and are frequently encroached upon by the surrounding environment. We present a general method for extracting the branch structure of trees from point cloud data, which estimates the structure of trees by adapting the methods of structural topology optimisation to find the optimal material distribution to interpolate the input data. We present the results of this optimisation over a wide variety of scans, and discuss the benefits and drawbacks of this novel approach to tree structure reconstruction. Our method generates detailed and accurate tree structures, with a mean Surface Error (SE) of 15 cm over 13 diverse tree datasets.
We describe a new toolset for the manipulation and analysis of ray clouds (3D maps defined by a set of rays from a moving lidar to the scanned surfaces). Unlike point clouds, ray clouds contain information on free-space (air) as well as surface geometry. This allows the toolset to perform volumetric functions and analysis that cannot be done on point clouds alone. The presented toolset consists of seventeen command-line functions, with a C++ library available for those who require more control or tight integration. Our aim is that RayCloudTools is as useful and simple as possible, and we use this paper to demonstrate its utility, and to assess its ease of use, with comparison to established cloud processing libraries.
We propose a novel, canopy density estimation solution using a three‐dimensional (3D) ray cloud representation for perennial horticultural crops at the field scale. To attain high spatial and temporal fidelity in field conditions, we propose the application of continuous‐time 3D SLAM (simultaneous localization and mapping) to a spinning lidar payload (AgScan3D) mounted on a moving farm vehicle. The AgScan3D data are processed through a Continuous‐Time SLAM algorithm into a globally registered 3D ray cloud. The global ray cloud is a canonical data format (a digital twin) from which we can compare vineyard snapshots over multiple times within a season and across seasons. Then, the vineyard rows are automatically extracted from the ray cloud and a novel density calculation is performed to estimate the maximum likelihood canopy densities of the vineyard. This combination of digital twinning, together with the accurate extraction of canopy structure information, allows entire vineyards to be analyzed and compared, across the growing season and from year to year. The proposed method is evaluated both in simulation and field experiments. Field experiments were performed at four sites, which varied in vineyard structure and vine management, over two growing seasons and 64 data collection campaigns, resulting in a total traversal of 160 km, 42.4 scanned hectares of vines with a combined total of approximately 93,000 scanned vines. Our experiments show canopy density repeatability of 3.8% (relative root mean square error) per vineyard panel, for acquisition speeds of 5–6 km/h, and under half the standard deviation in estimated densities when compared with an industry standard gap‐fraction based solution. The code and field data sets are available at https://github.com/csiro-robotics/agscan3d.
Detailed understanding of gully erosion processes is essential for monitoring gully remediation and requires fine-scale monitoring. Hand-held laser scanning systems (HLS) enable rapid ground-based data acquisition at centimeter precision and ranges of 10–100 m. This study quantified errors in measuring gully morphology and erosion over a four year period using two models of HLS. Reference datasets were provided by Real-Time-Kinematic (RTK) GPS and a RIEGL Terrestrial Laser Scanner (TLS). The study site was representative of linear gullies that occur extensively on hillslopes throughout Great Barrier Reef catchments, where gully erosion is the dominant source of fine sediment. The RMSE error against RTK survey points varied 0.058–0.097 m over five annual scans. HLS was found to measure annual gully headcut extension within 0.035 m of RTK. HLS was, on average, within 6% of TLS for morphological metrics of depth, area and volume. Volumetric change over a 60 m length of the gully and four years was estimated to within 23% of TLS. Errors could potentially be improved by scanning at times of year with lower ground vegetation cover. HLS provided similar levels of error and was relatively more rapid than TLS and RTK for monitoring gully morphology and change.
The evolution of orchard production systems towards higher density layouts, makes monitoring of canopy and disease increasingly important. Technological advances over the last few years have greatly increased our ability to collect, collate and analyse our data on a per-tree basis at large orchard scales. We call this the Digital-Twin Orchard. A digital-twin is a virtual model of every tree and surroundings. The pairing of the virtual and physical worlds allows analysis of data and continuous monitoring of orchards production systems to predict stress, disease and crop losses, and to develop new opportunities for end-to-end learning. Monitoring of orchards is not a new concept but the digital-twin is a continuously learning system that could be queried automatically to analyse specific outcomes under varying simulated environmental and orchard management parameters. Digital-twin enables improvement of production and dynamic prediction of disease, stress and yield gaps using an end-to-end AI platform. In this paper, we present AgScan3D+: our automated dynamic canopy monitoring system to generate a digital-twin of every tree on a large orchard scale. AgScan3D+ consists of a spinning 3D LiDAR plus cameras that can be retrofitted to a farm vehicle and provides real time on-farm decision support by monitoring the condition of every plant in 3D such as their health, structure, stress, fruit quality, and more. The proposed system has been trialled in mango, macadamia, avocado and grapevines orchards and generated a digital-twin of 15,000 trees. The results were used to model canopy structural characteristics such as foliage density and light penetration distribution.
Directionality in path planning is essential for efficient autonomous navigation in a number of real-world environments. In many map-based navigation scenarios, the viable path from a given point A to point B is not the same as the viable path from B to A. We present a method that automatically incorporates preferred navigation directionality into a path planning costmap. This 'preference' is represented by coloured paths in the costmap. The colourisation is obtained based on an analysis of the driving trajectory generated by the robot as it navigates through the environment. Hence, our method augments this driving trajectory by intelligently colouring it according to the orientation of the robot during the run. Creating an analogy between the vehicle orientation angle and the hue angle in the Hue-Saturation-Value colour space, the method uses the hue, saturation and value components to encode the direction, directionality and scalar cost, respectively, into a costmap image. We describe a costing function to be used by the A* algorithm to incorporate this information to plan direction-aware vehicle paths. Our experiments with LiDAR-based localisation and autonomous driving in real environments illustrate the applicability of the method.
We combine MAP-Elites and highly parallelisable simulation to explore the design space of a class of large legged robots, which stand at around 2m tall and whose design and construction is not well-studied. The simulation is modified to account for factors such as motor torque and weight, and presents a reasonable fidelity search space. A novel robot encoding allows for bio-inspired features such as legs scaling along the length of the body. The impact of three possible control generation schemes are assessed in the context of body-brain co-evolution, showing that even constrained problems benefit strongly from coupling-promoting mechanisms. A two stage process in implemented. In the first stage, a library of possible robots is generated, treating user requirements as constraints. In the second stage, the most promising robot niches are analysed and a suite of human-understandable design rules generated related to the values of their feature variables. These rules, together with the library, are then ready to be used by a (human) robot designer as a Design Assist tool.
This paper presents a novel approach for local 3D environment representation for autonomous unmanned ground vehicle (UGV) navigation called On Visible Point Clouds Mesh(OVPC Mesh). Our approach represents the surrounding of the robot as a watertight 3D mesh generated from local point cloud data in order to represent the free space surrounding the robot. It is a conservative estimation of the free space and provides a desirable trade-off between representation precision and computational efficiency, without having to discretize the environment into a fixed grid size. Our experiments analyze the usability of the approach for UGV navigation in rough terrain, both in simulation and in a fully integrated real-world system. Additionally, we compare our approach to well-known state-of-the-art solutions, such as Octomap and Elevation Mapping and show that OVPC Mesh can provide reliable 3D information for trajectory planning while fulfilling real-time constraints.
We present a novel method for mapping general three-dimensional environments, where sufficient geometric or visual information is not everywhere guaranteed and where the device motion is unconstrained as with handheld systems. The continuous-time simultaneous localization and mapping algorithm integrates a lidar, camera, and inertial measurement unit in a complementary fashion whereby all sensors contribute constraints to the optimization. The proposed algorithm is designed to expand the domain of mappable environments and therefore increase the reliability and utility of general purpose mobile mapping. A key component of the proposed algorithm is the incorporation of depth uncertainty into visual features, which is effective for noisy surfaces and allows features with and without depth estimates to be modeled in a unified manner. Results demonstrate a wider mappable domain on challenging environments compared to the state-of-the-art lidar or vision-based localization and mapping algorithms.
We investigate the problem of colourising a point cloud using an arbitrary mobile mapping device and an independent camera. The loose coupling of sensors creates a number of challenges related to timing, point visibility, and colour determination. We address each of these problems and demonstrate our resulting algorithm on data captured using sensor payloads mounted to hand-held, aerial, and ground systems, illustrating the “plug-and-play” portability of the method.
In August 2014, CSIRO and 3P Learning (through subsidiary IntoScience) launched what is probably Australia's biggest (and arguably coolest) school excursion ever. In classrooms around the country, students can now set out to explore the spectacular Jenolan Caves located in the scenic Blue Mountains. Students are immersed, via the web, in an authentic 3D digital recreation of the Jenolan Caves to discover the science behind cave formation.
This study presents an alternative method of displaying vector and raster graphics which provides greater visual clarity than standard methods. Rather than rasterising lines and points by shading them with a pixel thickness, shade is interpreted as an intensity per length and per point, respectively; generically per fractal measure of the geometric feature. Integrating these shades through supersampling provides a generic shading method that is independent of screen resolution, supersample size and feature dimension. By using a fractal measure that is local in both space and scale, the author's method generalises to arbitrary features and so is extendable to raster images where no feature is truly sub-two-dimensional. The resulting images exhibit details that are lost to standard rasterisers. Their system can be seen as enabling a sliding scale between a photographic view and a diagrammatic view of the same data.