In this paper, we present a novel trajectory planning method for externally-actuated modular manipulators (EAMMs), consisting of multiple rotor-actuated links with joints that can be either locked or unlocked. This joint-locking feature allows effective balancing of the payload capacity and dexterity of the robot but significantly complicates the planning problem by introducing binary decision variables. To address this challenge, we leverage the problem’s intrinsic structure, i.e., the payload at the end-effector being enhanced by merely locking its immediate connected links; this allows us to break down the complex planning problem into a series of manageable subproblems and solve them sequentially. Our approach significantly reduces the problem’s complexity: in a serial n-link EAMM with m joint-lock mechanisms, where there could potentially be 2 m distinct configurational dynamics, we require solving only n + 1 trajectory optimization problems for single rigid body dynamics sequentially, thereby rendering the problem tractable. We substantiate the efficacy of our method through various simulation and experimental studies, covering ground-free and ground-bound configurations as well as both motion-only and manipulation tasks.

The ability to grasp objects broadens the application range of unmanned aerial vehicles (UAVs) by allowing interactions with the environment. The difficulty in performing a midair grasp is the high probability of impact between the UAV's foot and the target. For a successful grasp, the foot must smoothly absorb the energy of impact and simultaneously engage with the target in a short period of time. We present a bioinspired passive dynamic foot in which the claws are actuated solely by the impact energy. Our gripper simultaneously resolves the issue of smooth absorption of the impact energy and fast closure of the claws by linking the motion of an ankle linkage and the claws through soft tendons. We study the dynamics of impact and use the stiffness of the tendon as our design/control parameter to adjust the mechanics of the gripper for smooth recycling of the impact energy. Our gripper closes within 45 ms after initial contact with the impacting object without requiring any controller or actuation energy. An electroadhesive locking mechanism attached to the tendon locks the claws within 20 ms after reaching closed configuration. We demonstrated the effectiveness of our gripper by integrating it in an UAV and performing a variety of passive dynamic perching and grasping tasks.

Aerial manipulation with a multi-rotor drone and manipulator systems or omni -directional drones has critical barriers such as limited flight time, insufficient payload, and inaccurate onboard sensing and control. To overcome these limitations, the Large-size Aerial Skeleton with Distributed Rotor Actuation (LASDRA) was proposed in previous research [1]. In this paper, we develop a downsized LASDRA with a novel joint locking device. The developed downsized LASDRA with joint locking device can work in narrower spaces with more DoF and generates a bigger operational force by joint locking. The joint locking device employs a capstan brake and latch mechanism to generate large locking torques with a small form factor. As an experimental result, the payload of a 3-link downsized LASDRA increased from 0.4 kg to 1.2 kg with joint locking, while the length of each link decreased from 1 m to 0.76 m.

In this paper, we propose a novel sim-to-real framework to solve bolting tasks with tight tolerance and complex contact geometry which are hard to be modeled. The sim-to-real has desirable features in terms of cost and safety, however, that of the assembly task is rare due to the lack of simulator, which can robustly render multi-contact assembly. We implement the sim-to-real transfer of nut tightening policy which is adaptive to uncertain bolt positions. This can be realized through developing a novel contact model, which is fast and robust to complex assembly geometry, and novel hierarchical controller with reinforcement learning (RL), which can perform the tasks with a narrow and complicated path. The fast and robust contact model is achieved by utilizing configuration space abstraction and passive midpoint integrator (PMI), which render the simulator robust even in a high stiffness contact condition. And we use sampling-based motion planning to construct a path library and design linear quadratic tracking controller as a low-level controller to be compliant and avoid local optima. Additionally, we use the RL agent as a high-level controller to make it possible to adapt to the bolt position uncertainty, thereby realizing sim-to-real. Experiments are performed to verify our proposed sim-to-real framework.

The RVM (Robot-based Vibration Suppression Modules) is proposed for the manipulation and transport of a large flexible object. Since the RVM is easily attachable/detachable to the object, this RVM allows distributing over the manipulated object so that it is scalable to the object size. The composition of the system is partly motivated by the MAGMaS (Multiple Aerial-Ground Manipulator System) [1]- [3], however, since the quadrotor usage is mechanically too complicated and its design is not optimized for manipulation, thus we overcome these limitations using distributed RVMs and newly developed theory. For this, we first provide a constrained optimization problem of RVM design with the minimum number of rotors, so that the feasible thrust force is maximized while it minimizes undesirable wrench and its own weight. Then, we derive the full dynamics and elucidate a controllability condition with multiple distributed RVMs and show that even if multiple, their structures turn out similar to [2] composed with a single quadrotor. We also elucidate the optimal placement of the RVM via the usage of controllability gramian which is not even alluded in [2] and established for the first time here. Experiments are performed to demonstrate the effectiveness of the proposed theory.

We propose novel haptic tele-driving control frameworks of a wheeled mobile robot (WMR) over the imperfect Internet communication network with varying delay and packet loss. We consider both the dynamic and kinematic WMRs and their various tele-driving modes. By utilizing passive set-position modulation framework, we can guarantee two-port passivity or passivity/stability combination of the closed-loop tele-driving system with some theoretical performance measures. Experiments are performed to show the efficacy of the proposed frameworks using the Internet-emulated communication and a custom-built dynamic/kinematic WMR.

The manipulation of large objects by robotic systems is a challenge for applications in the construction industry, industrial decommissioning, and urban search and rescue (USAR). These are associated with dangerous environments and thus motivate devising robotic solutions to replace human presence. Furthermore, they often require manipulation of long objects, such as pipes, bars, beams, and metal ...

The MAGMaS (Multiple Aerial-Ground Manipulator System) was proposed in [1] as a heterogeneous system composed of multiple ground (mobile) manipulators and aerial robots to collaboratively manipulate a long/large-sized object and demonstrated therein for rigid load manipulation. Here, we extend this result of [1] to the case of load manipulation with flexibility, which is crucial for long/slender object manipulation, yet, not considered in [1]. We first provide a rigorous modeling of the load flexibility and its effects on the MAGMaS dynamics. We then propose a novel collaborative control framework for flexible load-tip pose tracking, where the ground manipulator provides slower nominal pose tracking with overall load weight holding, whereas the aerial robot allows for faster vibration suppression with some load weight sharing. We also discuss the issue of controllability stemming from that the aerial robot provides less number of actuation than the modes of the load flexibility; and elucidate some peculiar conditions for this vibration suppression controllability. Simulations are also performed to demonstrate the effectiveness of the proposed theory.

Electrical motor and hydraulic actuation widely-used in robotics are “internal actuation” with their actuators sitting at the joint between two links. This internal actuation is fundamentally limiting to construct a large-size dexterously-articulated robot, since any external force (and its own link weight) is to be accumulated to the base multiplied by the moment arm length, requiring extremely strong/sturdy base actuator/structure as the system size increases. In this paper, we propose a novel robotic system, LASDRA (large-size aerial skeleton with distributed rotor actuation), which, by utilizing distributed rotors as “external actuation”, can overcome this limitation of internal actuation and enables us to realize large-size dexterously-articulated robots. We present its design and modeling, joint locking strategy to increase its loading capability, and also a novel decentralized control scheme to allow for compliant operation with scalability against the number of links. Trajectory tracking and valve turning experiments are also performed to validate the theory.

We present a tutorial introduction to the multi-rotor unmanned aerial vehicles, often simply referred as drones. We first explain typical configuration, components and construction of the drones. We then provide basic kinematic and dynamic modeling of drones and their principle of flight. Some representative motion control techniques are then presented, which take into account the issue of under-actuation of the drones. State estimation problem of the drones, that is crucial for their proper flying, yet, should be done only by using onboard sensors and their sensor fusion, is explained. Some emerging research directions requiring capability beyond typical drones are also mentioned.

In this paper, we develop a zero-moment-point and friction force calculation framework for wheeled mobile robots on uneven terrain to evaluate roll-over and slippage tendency of the given trajectory. The proposed framework using dynamic constraints and passive decomposition has advantages of low computations and implementation cost. Simulation results using CarSim is provided to analyze the performance of the proposed framework.

GPS-IMU based sensor fusion is widely used for autonomous flying, which yet suffers from the inaccuracy and drift of the GPS signal and also the failure with the loss of GPS (e.g., indoor flying). To circumvent this issue, in this paper, we propose a new framework for camera-GPS-IMU sensor fusion, which, by fusing monocular camera information with that from GPS and IMU, can improve the accuracy and robustness of the autonomous flying. For camera and GPS-IMU calibration, a new Kalman filter is also proposed, which runs in parallel with the state estimation EKF and also utilize multiple key frames generated from the camera information. An autonomous flying experiment is performed to validate the theory.

We present some preliminary results on state estimation of SmQT system, which consists of multiple UAVs. By using multiple set of IMU-camera and additional IMU, we estimate whole state of UAVs and tool. The estimator merge vision data and IMU measurements under mechanical constraint of SmQT system to increase tracking accuracy and robustness. Simulation is also performed to illustrate the results.

We propose an hierarchical control framework for multiple cooperative quadrotor-manipulator systems, which allows us to endow the common grasped object with a user-specified desired behavior (e.g., trajectory tracking, compliant interaction, etc.). To achieve this, our control framework consists of the following hierarchical layers: 1) object desired behavior design; 2) optimal cooperative force distribution; and 3) individual quadrotor-manipulator control based on object stiffness model, which can also take into account different dynamics characteristics of the (slower/coarse) quadrotor-platform and the (faster/fine) manipulator. Simulations of object transport and compliant interaction with three quadrotor-manipulator systems are performed to illustrate the theory.

In this paper, we propose cooperative localization scheme based feedback control for the multiple omni-directional mobile robots. Using the proposed cooperative localization scheme, localization capability of each mobile robot is enhanced, although some of the robots loss its absolute position measurement. Position error is bounded based on relative measurements which is unbounded for dead reckoning. Implementation results are also provided to validate the theory.

We show that the Lagrange dynamics of quadrotor-manipulator systems can be completely decoupled into: 1) the center-of-mass dynamics in E(3), which, similar to the standard quadrotor dynamics, is point-mass dynamics with under-actuation and gravity effect; and 2) the “internal rotational” dynamics of the quadrotor's rotation and manipulator configuration, which assumes the form of standard Lagrange dynamics of robotic manipulator with full-actuation and no gravity effect. Relying on this structure, we propose a novel backstepping-like end-effector tracking control law, which can allow us to assign different roles for the center-of-mass control and for the internal rotational dynamics control according to task objectives. Simulations using a planar quadrotor with a 2-DOF arm are also performed to show the theory.

We propose controller for quadrotor with arm system. Quadrotor is underactuated which makes control problem difficult. Attached manipulator makes system dynamics complicate. To control end-effector position, we used passive decomposition and it provides decomposed dynamics. Using decomposed dynamics, we proposed backstepping-like controller to control end-effector position. Proposed controller achieve desired end-effector trajectory via underatuated system while moving manipulator. Simulation results are presented.

We present a novel cooperative grasping control framework for multiple kinematic nonholonomic mobile manipulators, which enables them to drive the grasped object with velocity commands, while rigidly maintaining the grasping shape with no dedicated grasp-enforcing fixtures and also avoiding obstacles either via their whole formation maneuver or internal formation reconfiguration. For this, nonholonomic passive decomposition [1], [2] is utilized to split the robots' motion into the three aspects (i.e., grasping shape; grasped object maneuver; internal motions) so that we can control these aspects simultaneously and separately. Peculiar dynamics of the internal motions is exploited to achieve obstacle avoidance via the formation reconfiguration. Simulations are performed to support the theory.