Estimating the 6D pose of textureless objects from RGB images is an important problem in robotics. Due to appearance ambiguities, rotational symmetries, and severe occlusions, single-view based 6D pose estimators are still unable to handle a wide range of objects, motivating research towards multi-view pose estimation and next-best-view prediction that addresses these limitations. In this work, we propose a comprehensive active perception framework for estimating the 6D poses of textureless objects using only RGB images. Our approach is built upon a key idea: decoupling the 6D pose estimation into a two-step sequential process can greatly improve both accuracy and efficiency. First, we estimate the 3D translation of each object, resolving scale and depth ambiguities inherent to RGB images. These estimates are then used to simplify the subsequent task of determining the 3D orientation, which we achieve through canonical scale template matching. Building on this formulation, we then introduce an active perception strategy that predicts the next best camera viewpoint to capture an RGB image, effectively reducing object pose uncertainty and enhancing pose accuracy. We evaluate our method on the public ROBI and TOD datasets, as well as on our reconstructed transparent object dataset, T-ROBI. Under the same camera viewpoints, our multi-view pose estimation significantly outperforms state-of-the-art approaches. Furthermore, by leveraging our next-best-view strategy, our approach achieves high pose accuracy with fewer viewpoints than heuristic-based policies across all evaluated datasets. The accompanying video and T-ROBI dataset will be released on our project page: https://trailab.github.io/ActiveODPE.
Automatic extrinsic sensor calibration is a fundamental problem for multi-sensor platforms. Reliable and general-purpose solutions should be computationally efficient, require few assumptions about the structure of the sensing environment, and demand little effort from human operators. In this work, we introduce a fast and certifiably globally optimal algorithm for solving a generalized formulation of the robot-world and hand-eye calibration (RWHEC) problem. The formulation of RWHEC presented is "generalized" in that it supports the simultaneous estimation of multiple sensor and target poses, and permits the use of monocular cameras that, alone, are unable to measure the scale of their environments. In addition to demonstrating our method's superior performance over existing solutions through extensive simulated and real experiments, we derive novel identifiability criteria and establish a priori guarantees of global optimality for problem instances with bounded measurement errors. As part of our analysis, we propose a new constraint qualification for nonlinear programs with redundant constraints; this constraint qualification is of independent interest for establishing the exactness of SDP relaxations of QCQPs that have been tightened through the addition of redundant constraints. Finally, we provide a free and open-source implementation of our algorithms and experiments.
The construction of stable, conservative, and accurate volume dissipation is extended to discretizations that possess a generalized summation-by-parts (SBP) property within a tensor-product framework. The dissipation operators can be applied to any finite-difference or spectral-element scheme that uses the SBP framework, including high-order entropy-stable schemes. Additionally, we clarify the incorporation of a variable coefficient within the operator structure and analyze the impact of a boundary correction matrix on operator structure and accuracy. Following the theoretical development and construction of novel dissipation operators, we relate the presented volume dissipation to the use of upwind SBP operators. When applied to spectral-element methods, the presented approach yields unique dissipation operators that can also be derived through alternative approaches involving orthogonal polynomials. Numerical examples featuring the linear convection, Burgers, and Euler equations verify the properties of the constructed dissipation operators and assess their performance compared to existing upwind SBP schemes, including linear stability behaviour. When applied to entropy-stable schemes, the presented approach results in accurate and robust methods that can solve a broader range of problems where comparable existing methods fail.
The renewed global interest in furthering human’s presence on the Moon has catalyzed efforts to establish a sustainable lunar base. The incentive is not only for scientific opportunities and prospects of deep-space exploration, but also for demonstrating technologies that will extend our reach throughout the Solar System. Central to such efforts is the development of robust and scalable lunar construction technologies. This survey presents a comprehensive review of the state-of-the-art in lunar construction, including environmental characterization, infrastructure development, construction methods and materials, and robotic systems. The unique challenges posed by the lunar environment are highlighted, such as extreme temperature variations, high radiation exposure, and micrometeorite impacts, with a particular emphasis on the abrasive, adhesive, and electrostatically charged lunar regolith, thus including strategies developed for lunar dust mitigation. The survey investigates the critical infrastructure that will need to be established, including habitats, power stations, communication stations, landing pads, blast berms, and more. A detailed analysis of the methods and materials that are being developed to create such infrastructure is presented, identifying which methods have demonstrated promise and garnered the most attention. A diversity of robotic technologies are required to enable the construction of the necessary infrastructure using these methods and systems, which are broken down into lunar cranes, mobile manipulators, 3D printers, and robot teams, with a particular focus on work being done to develop flight systems. The paper concludes by identifying critical research and technological gaps that must be addressed to support the next generation of lunar missions and long-term extraterrestrial habitation.
Ensuring safe robot operation in cluttered and dynamic environments remains a fundamental challenge. While control barrier functions provide an effective framework for real-time safety filtering, their performance critically depends on the underlying geometric representation, which is often simplified, leading to either overly conservative behavior or insufficient collision coverage. Superquadrics offer an expressive way to model complex shapes using a few primitives and are increasingly used for robot safety. To integrate this representation into collision avoidance, most existing approaches directly use their implicit functions as barrier candidates. However, we identify a critical but overlooked issue in this practice: the gradients of the implicit SQ function can become severely ill-conditioned, potentially rendering the optimization infeasible and undermining reliable real-time safety filtering. To address this issue, we formulate an SQ-based safety filtering framework that uses signed distance functions as barrier candidates. Since analytical SDFs are unavailable for general SQs, we compute distances using the efficient Gilbert-Johnson-Keerthi algorithm and obtain gradients via randomized smoothing. Extensive simulation and real-world experiments demonstrate consistent collision-free manipulation in cluttered and unstructured scenes, showing robustness to challenging geometries, sensing noise, and dynamic disturbances, while improving task efficiency in teleoperation tasks. These results highlight a pathway toward safety filters that remain precise and reliable under the geometric complexity of real-world environments.
