Fringe projection profilometry (FPP) suffers from heterogeneous phase unwrapping errors (PUEs) that are difficult to correct cooperatively. We propose a classification and adaptive correction method based on global structural priors. Building on spatial continuity and approximate low-rankness, the method classifies PUEs into three categories—structural gross, sparse gross, and random—and corrects them progressively through boundary preprocessing, structure-aware weighted low-rank optimization (SA-WLRO), and conservative median filtering. An optional adaptive backfilling step is then introduced, yielding a dual-mode approach: the core algorithm (without backfilling) and the backfilling mode (with backfilling enabled), which together enable a flexible trade-off between precision and data completeness. Systematic experiments on flat plate, composite geometric bodies, plaster sculptures, and stair model demonstrate that the proposed dual-mode approach achieves substantial improvements over four representative model-driven methods in all tested scenarios, which include planar surfaces, isolated discontinuities, complex curved surfaces, and steep height variations. Notably, on the stair model—the most challenging case— the core algorithm achieves an RMSE of 0.0437 rad at 97.55% VPP, while the backfilling mode raises the VPP to 99.99% with an RMSE of 0.3084 rad, still more accurate than the 0.4251 rad of the best competing method. Ablation studies confirm the necessity of each module. These results position the proposed dual-mode approach as an effective post-processing solution for high-precision FPP systems.

In offline signature verification, extracting effective features and enhancing identification accuracy remain critical challenges. Traditional feature extraction modules struggle to capture comprehensive, detailed characteristics from signatures alone and often suffer from overfitting issues. This paper introduces ResT, a novel approach that integrates the Residual Network (ResNet) and Transformer architectures for multi-scale feature extraction. The proposed method comprises two components: ResNet blocks and Transformer blocks, designed to extract local and global signature characteristics, respectively. Within the ResNet blocks, we integrate two modules-Spatial-to-Depth Convolution (SPD-Conv) and Spatial and Channel Reconstruction Convolution (SCConv)-to emphasize stroke-level features, thereby improving local feature extraction. For the Transformer blocks, Vision Transformer (ViT) is employed to analyze the signature's overall shape and stroke trends, capturing global features. To evaluate performance, we implement a writer-independent (WI) verification system and conduct extensive experiments on four public datasets: GPDS, CEDAR, BHSig-Bengali, and BHSig-Hindi. Results demonstrate that the proposed ResT model effectively distinguishes genuine from forged signatures and achieves competitive performance compared to existing methods.

In the field of forensic document examination, accurately determining the chronological sequence of intersecting lines between seal ink and handwriting is a crucial technical step for verifying document authenticity, identifying contract tampering, and detecting forged signatures. This technique analyzes the physical superimposition relationship formed by the deposition of the two media on the paper substrate to provide objective scientific evidence for judicial practice. Although traditional methods such as microscopic imaging and mass spectrometry analysis have achieved some progress, they still suffer from common limitations including high equipment costs, complex operation, and potential damage to samples. This study proposes and validates an innovative non-destructive determination method that integrates structured light 3D reconstruction technology with deep learning algorithms. The research captures the microscopic 3D morphological features of the ink intersection area using a high-precision structured light scanning system and effectively eliminates noise interference caused by paper substrate undulation through Gaussian flattening technology. Subsequently, a multimodal fusion strategy combines 2D texture images with 3D depth information to construct a dataset rich in features. On this basis, a deep learning model based on an improved Residual Neural Network (ResNet) is designed, incorporating the ELU activation function and an EMA mechanism to enhance the model’s feature extraction capability and convergence stability. Experimental results demonstrate that the proposed method achieves a recognition accuracy of 94.39% on the test set, fully validating its effectiveness and application potential in the non-destructive determination of ink stroke sequencing.

With the rapid advancement of aerospace technology, the maneuverability of spacecraft has increasingly improved, creating a pressing demand for star sensors with a high attitude update rate and high precision. Star identification, as the most complex and time-consuming algorithm of star sensors, faces stringent requirements for enhanced identification speed and an enhanced identification rate. Furthermore, as the space environment is becoming more complex, the need for star sensors with heightened detection sensitivity is growing to facilitate real-time and accurate alerts for various non-cooperative targets, which has led to a sharp increase in the number of high-magnitude navigation stars in the star catalog, significantly impeding the speed and rate of star identification. Traditional methods are no longer adequate to meet the current demand for star sensors with high identification speed and a high identification rate. Addressing these challenges, a voting-based star identification algorithm using a partitioned star catalog is proposed. Initially, a uniform partitioning method for the star catalog is introduced. Building on this, a navigation feature library using partitioned catalog neighborhoods as a basic unit is constructed. During star identification, a method based on a voting decision is employed for feature matching in the basic unit. Compared to conventional methods, the proposed algorithm significantly simplifies the navigation feature library and narrows the retrieval region during star identification, markedly enhancing identification speed while effectively reducing the probability of redundant and false matching. The performance of the proposed algorithm is validated through a simulation experiment and nighttime star observation experiment. Experimental results indicate an average identification rate of 99.760% and an average identification time of 8.861 milliseconds, exhibiting high robustness against position errors, magnitude errors, and false stars. The proposed algorithm presents a clear advantage over other common star identification methods, meeting the current requirement for star sensors with high star identification speed and a high identification rate.

A bullet point cloud registration algorithm with a low overlap rate based on line feature detection was proposed to solve the problem of the difficulty and low efficiency of point cloud registration due to the low overlap rate among point clouds sampled by the bullet model. In this paper, voxel downsampling is used to remove some noise points and outliers from the bullet point cloud and applied to the specified resolution to reduce the calculation cost. The bullet point cloud is transformed to a better initial position by fitting the central axis with the geometrical features of the bullet. Then, the direction vector of the bullet linear features is obtained by using an icosahedral fitting discrete Hough transform to simplify the parameter space of the search transformation. Finally, the optimal rotation angle is searched for in the parameter space by using the improved Cuckoo algorithm to realize the registration of the bullet point cloud with a low overlap rate. Simulation and experimental results show that the proposed registration method can accurately register bullet point clouds of different densities with a low overlap rate. Compared with the commonly used ICP, GICP, and TRICP algorithms, the registration error of the proposed algorithm is reduced by 92.68% on average when the overlap rate is 52.85%. The registration error is reduced by 98.87% in the case of a 41.36% overlap rate, by 99.52% in the case of a 33.02% overlap rate, and by 98.89% in the case of a 22.75% overlap rate.

星敏感器是自主导航姿态控制系统中的重要组成部分之一.作为星敏感器的核心部件,信息处理系统对其整机性能有重要影响.基于飞腾多核DSP+复旦微FPGA架构设计了一种全国产化多视场星敏感器信息处理系统.在设计中采用EMIF接口和GPIO接口与复旦微FPGA进行数据交互及控制,将 2 片串行 Flash用于存储星库数据和启动程序,将 2 片DDR3 芯片用于缓存数据.详细介绍了信息处理系统的整体软件流程设计、算法流程设计及实现.经试验验证,该系统可稳定运行并输出正确姿态.在星图分辨率为 2048×2048 的情况下,系统无初始指向时的数据更新频率为 20 Hz,有初始指向时的数据更新频率为625 Hz.运算性能约为普通ARM架构的 3 倍,对于提升多视场星敏感器的实时性、丰富其工程化实现方法具有重要意义.

Fringe projection profilometry (FPP) is prone to phase unwrapping error (PUE) due to phase noise and measurement conditions. Most of the existing PUE-correction methods detect and correct PUE on a pixel-by-pixel or partitioned block basis and do not make full use of the correlation of all information in the unwrapped phase map. In this study, a new method for detecting and correcting PUE is proposed. First, according to the low rank of the unwrapped phase map, multiple linear regression analysis is used to obtain the regression plane of the unwrapped phase, and thick PUE positions are marked on the basis of the tolerance set according to the regression plane. Then, an improved median filter is used to mark random PUE positions and finally correct marked PUE. Experimental results show that the proposed method is effective and robust. In addition, this method is progressive in the treatment of highly abrupt or discontinuous regions.

In this work, we propose a 3D occlusion facial recognition network based on a multi-feature combination threshold (MFCT-3DOFRNet). First, we design and extract the depth information of the 3D face point cloud, the elevation, and the azimuth angle of the normal vector as new 3D facially distinctive features, so as to improve the differentiation between 3D faces. Next, we propose a multi-feature combinatorial threshold that will be embedded at the input of the backbone network to implement the removal of occlusion features in each channel image. To enhance the feature extraction capability of the neural network for missing faces, we also introduce a missing face data generation method that enhances the training samples of the network. Finally, we use a Focal-ArcFace loss function to increase the inter-class decision boundaries and improve network performance during the training process. The experimental results show that the method has excellent recognition performance for unoccluded faces and also effectively improves the performance of 3D occlusion face recognition. The average Top-1 recognition rate of the proposed MFCT-3DOFRNet for the Bosphorus database is 99.52%, including 98.94% for occluded faces and 100% for unoccluded faces. For the UMB-DB dataset, the average Top-1 recognition rate is 95.08%, including 93.41% for occluded faces and 100% for unoccluded faces. These 3D face recognition experiments show that the proposed method essentially meets the requirements of high accuracy and good robustness.

为有效解决当前传统步态特征人身识别技术过分依赖人工判读、识别准确率较低的问题,将计算机技术引入步态特征识别领域中,以获取一种基于反向传播(back propagation,BP)神经网络的步态特征识别新方法.将立体赤足足迹作为研究对象,通过光栅立体足迹采集仪对立体赤足足迹图像进行预处理,以获取计算机可识别出的三维足迹触觉步态特征信息,记录立体赤足足迹的深度差、区域面积、区域体积三类步态特征信息,并在法庭科学领域中的足迹检验理论为基础的前提下运用BP神经网络,对其中Multillayer Perceptron分类器参数进行优化调整,最后,将测试结果与传统的人工检验结果进行比对,从比对结果得出,相对于传统的人工鉴别方法只有84.7％的准确率,基于BP神经网络的步态特征人身识别算法的准确率可达到90％以上.

The image-type angular displacement measurement method based on linear image recognition has garnered attention because of its higher frequency response, strong fault tolerance, and high robustness. In the small-size image angular displacement measuring device, due to the limited pixel size, the circular grating cannot place more lines when realizing single-channel absolute coding recognition on a small diameter grating disk. This leads to larger errors in angular displacement measurement when the line density of the grating disk is low. To improve the measurement accuracy of small-scale displacement, the present work aimed to reduce this error by studying the error compensation method involving low-density grating disks. First, the mechanism of linear image-type angular displacement measurements is described, and a measurement algorithm based on linear scan images is proposed. Second, the measurement error model for low-density grating disks is established according to the proposed measurement algorithm. Third, a simplified error compensation algorithm based on a harmonic model is developed. Finally, simulations and experiments are performed to verify the performance of the proposed algorithm. Simulation results show that the developed harmonic compensation algorithm can effectively reduce the error caused by the low-density circular grating. When the proposed error compensation algorithm is applied to a grating disk with a 62 mm diameter and 2 N lines, the measurement accuracy is improved from 8.14” to 4.78”. The proposed error compensation algorithm can significantly improve the accuracy of linear image-type angular displacement measurements involving low-density grating disks, and the results presented herein laid a foundation for improving the accuracy and engineering applicability of angular displacement measurement technology.

Invalid points, such as shadow and background, in the captured fringe patterns of fringe projection profilometry (FPP) are often inevitable due to the limited field of view measurements of three-dimensional (3D) imaging equipment. To ensure the quality of 3D reconstruction data, these invalid points must be identified and removed. FPP captures co-frequency-based fringe pattern sequences and approximately distributes this data along an ideal cosine curve. We propose an invalid points removal method based on an error energy function. By analyzing the relationship between the pixel values of a series of captured co-frequency patterns and an ideal cosine curve, we quantize the error energy by using a Gaussian weighted Euclidean distance. An improved Gaussian filtering method based on modulation intensity is used to significantly increase the error energy difference between the valid points of the target and the invalid points of the shadow/background area. Finally, the points whose error energy is greater than a certain error threshold are removed as invalid points. Experimental results indicate that this method can efficiently remove invalid points in fringe patterns and performs better than existing traditional methods.

光学动作捕捉技术是一种常用的动作捕捉方法,目前已经在各个行业内广泛应用.尤其是在体育竞技领域,已经成为了不可或缺的训练辅助手段.在光学动作捕捉中,最常见的问题是缺失标记,可能由外部遮挡、身体自遮挡或信号丢失等原因造成.对于缺失标记问题,在以往的研究中要么需要舍弃缺失的标记,要么需要大量后处理工作来恢复缺失标记.针对这种情况,本文提出一种用于光学动作捕捉中缺失标记的重建方法,该方法使用卡尔曼滤波框架,结合运动数据来预估缺失标记点的位置,实时重建人体运动模型.实验结果证明该方法能够快速有效的恢复缺失标记,重建人体运动.

There is urgent demand for new absolute Linear Displacement Measurement (LDM) technology with high resolution and high precision, during the development of high-end numerical control technology. In previous research, we found that displacement measurement based on the image processing method performs well, however, the volume increases when using an imaging lens, and the system is susceptible to factors such as virtual focus. In this paper, the lensless LDM image optical path is established based on grating projection imaging, then the absolute grating coding method is operated based on M-sequence pseudo-random coding. A linear displacement subdivision algorithm is then deployed based on the digital image recognition algorithm. An LDM device with a measuring range of 250 mm was designed to test the performance of the proposed method. The device shows a measurement resolution of 1 nm and measurement accuracy of 1.76 mu m in the range of 250 mm. This work lays a foundation for further research on high performance LDM technology.

针对战场感知及侦破现场中传统人工主观经验检验与识别模式误差较大的问题,提出了一种基于人工智能的足迹识别与特征提取方法.采用三维形貌重构系统进行足迹图像采集,并将数字图像处理算法与传统足迹检验法结合,提取足迹的区域关系特征和形状长度特征,进而采用支持向量机的模式识别方法对提取的特征进行立体足迹身份鉴别对比实验.实验结果表明,所提方法准确率超过人工鉴别准确率,达到99.1％,可应用于战场感知及侦破现场足迹准确检测与识别,也可推广应用于人体身份鉴别的相关领域.

Tracking objects over time, i.e., identity (ID) consistency, is important when dealing with multiple object tracking (MOT). Especially in complex scenes with occlusion and interaction of objects this is challenging. Significant improvements in single object tracking (SOT) methods have inspired the introduction of SOT to MOT to improve the robustness, that is, maintaining object identities as long as possible, as well as helping alleviate the limitations from imperfect detections. SOT methods are constantly generalized to capture appearance changes of the object, and designed to efficiently distinguish the object from the background. Hence, simply extending SOT to a MOT scenario, which consists of a complex scene with spatially mixed, occluded, and similar objects, will encounter problems in computational efficiency and drifted results. To address this issue, we propose a binary-channel verification model that deeply excavates the potential of SOT in refining the representation while maintaining the identities of the object. In particular, we construct an integrated model that jointly processes the previous information of existing objects and new incoming detections, by using a unified correlation filter through the whole process to maintain consistency. A delay processing strategy consisting of the three parts—attaching, re-initialization, and re-claiming—is proposed to tackle drifted results caused by occlusion. Avoiding the fuzzy appearance features of complex scenes in MOT, this strategy can improve the ability to distinguish specific objects from each other without contaminating the fragile training space of a single object tracker, which is the main cause of the drift results. We demonstrate the effectiveness of our proposed approach on the MOT17 challenge benchmarks. Our approach shows better overall ID consistency performance in comparison with previous works.

Road detection is a crucial research topic in computer vision, especially in the framework of autonomous driving and driver assistance. Moreover, it is an invaluable step for other tasks such as collision warning, vehicle detection, and pedestrian detection. Nevertheless, road detection remains challenging due to the presence of continuously changing backgrounds, varying illumination (shadows and highlights), variability of road appearance (size, shape, and color), and differently shaped objects (lane markings, vehicles, and pedestrians). In this paper, we propose an algorithm fusing appearance and prior cues for road detection. Firstly, input images are preprocessed by simple linear iterative clustering (SLIC), morphological processing, and illuminant invariant transformation to get superpixels and remove lane markings, shadows, and highlights. Then, we design a novel seed superpixels selection method and model appearance cues using the Gaussian mixture model with the selected seed superpixels. Next, we propose to construct a road geometric prior model offline, which can provide statistical descriptions and relevant information to infer the location of the road surface. Finally, a Bayesian framework is used to fuse appearance and prior cues. Experiments are carried out on the Karlsruhe Institute of Technology and Toyota Technological Institute (KITTI) road benchmark where the proposed algorithm shows compelling performance and achieves state-of-the-art results among the model-based methods.

随着星敏感器探测灵敏度的提高,导航星表中恒星的数量急剧增加,导致星图识别的识别速度和识别率降低。因此,为了提高星图识别的识别速度和识别率,文中在三角形算法的基础上提出了一种基于多特征匹配的快速星图识别算法。首先,采用天球的内接正二十面体法对预处理后的星表进行分区。然后,将特征三角形的边长以及外接圆和内切圆半径的乘积作为特征值构建导航特征库,并根据后者的哈希函数对特征库进行分块。在识别的过程中,利用观测三角形外接圆和内切圆半径乘积的哈希函数实现导航特征库子块的快速定位,并在该子块内采用多特征匹配的方法得到观测三角形的识别结果,最后根据该结果确定星敏感器视场所包含的天球子区域,并在子区域内完成视场中其它导航星的识别。实验结果表明,文中算法的识别性能与导航特征库的分块数有关,在选择合适的分块数后,与常用三角形算法相比,算法在识别速度,识别率以及对星等误差和假目标的鲁棒性等方面具有明显的优势,算法的平均识别时间和识别率分别为17.161ms和98.58%,满足星敏感器对高识别速度和识别率的要求。

Under the dynamic working conditions of a star sensor, motion blur of the star will appear due to its energy dispersion during imaging, leading to the degradation of the star centroid accuracy and attitude accuracy of the star sensor. To address this, a restoration method of a blurred star image for a star sensor under dynamic conditions is presented in this paper. First, a kinematic model of the star centroid and the degradation function of blurred star image under different conditions are analyzed. Then, an improved curvature filtering method based on energy function is proposed to remove the noise and improve the signal-to-noise ratio of the star image. Finally, the Richardson Lucy algorithm is used and the termination condition of the iterative equation is established by using the star centroid coordinates in three consecutive frames of restored images to ensure the restoration effect of the blurred star image and the accuracy of the star centroid coordinates. Under the dynamic condition of 0~4°/s, the proposed algorithm can effectively improve the signal-to-noise ratio of a blurred star image and maintain an error of the star centroid coordinates that is less than 0.1 pixels, which meets the requirement for high centroid accuracy.

Under the dynamic working conditions for a star sensor, motion blur will appear in a star because of its energy dispersion in the process of imaging, which leads to a decrease in the signal to noise ratio (SNR) and makes the blurred region difficult to extract. Meanwhile, this causes a degradation in star centroid positon accuracy and attitude accuracy in the star sensor. Therefore, a restoration method for blurred star images based on region filters is presented in this paper, which simultaneously concentrates on the improvement of SNR and star centroid accuracy. Firstly, the kinematic models of a star centroid under different conditions are set up based on the characteristics of star sensors. Secondly, the motion trail of star centroid is determined based on the kinematic model, allowing the star blurred region to be extracted. The images inside and outside the star blurred region are then preprocessed by image processing algorithm respectively. Finally, the blurred star image is restored by an image restoration algorithm. The experiment results indicate that under the dynamic condition of 2 degrees/s, the region filter algorithm can effectively improve the SNR of a blurred star image. In restored images, the error of star centroid is less than 0.1 pixels, which can satisfy the requirements for star sensor of high centroid accuracy.

The tracking performance of star sensor degrades seriously under dynamic conditions. To improve the tracking accuracy and efficiency, an attitude tracking method based on unscented Kalman filter (UKF) and singular value decomposition (SVD) is proposed in this paper. The star sensor is modeled as a nonlinear stochastic system, the state of which is attitude quaternion. The quaternion can be estimated by UKF, then the predicted attitude and corresponding star positions are obtained. To ensure the stability of attitude tracking, SVD is applied to obtain the sigma points in UKF continuously. The experimental results indicate that the proposed method yields high accuracy and efficiency in attitude tracking. This method provides a practical approach to ensure the tracking performance of star sensor under dynamic conditions.