Accurate edge detection is of great significance to image processing. However, the traditional methods, which use differential operations or prior experience to determine the value of the operator, cannot meet the high demand for accuracy in the field of image processing. Deep-learning based detection algorithms restrict its flexible usability due to the high demand of computational resources (storage space, processor) for its large number of parameters. To date, neither traditional nor emerging techniques cannot achieve SOTA performance on detection tasks. Therefore, to address the need for both precision and resources, this paper proposes an edge detection operator (HQ operator) based on the relationship between the original image and label mapping, which enhances the edge detection effect while drastically reducing the computational complexity. Unlike previous edge extraction operators, HQ operator utilizes a combination of labels and original images for edge detection, and does not use iterative training, but through subgraph generation classification (SGC) method and subgraph feature fusion operation (SFFO) to obtain the edge detection operator at once. Compared to the traditional edge detection operator, HQ operator can accurately extract feature information of the edge of target region. And compared to deep learning, the number of parameters of the HQ operator is greatly reduced and the calculation time of parameters is reduced. In addition, the HQ operator obtained on one dataset can be ported to other datasets with good edge extraction results. The edge images processed by the HQ operator can be spliced with the original image in the form of channels, and the image after splicing is fed into the image segmentation network to improve the performance of the segmentation network. to improve the performance of the segmentation network. The experimental results show that by using the HQ operator, the image edge detection effect is significantly improved (PA:96.49%), and the performance of the segmentation network is also improved to a certain extent when this operator is combined with the segmentation network(Dice:89.97%, IoU:81.97%).
Deep convolutional neural networks have made some progress in skin lesion classification and cancer diagnosis, but there are still some problems to be solved, such as the challenge of small inter-class feature differences and large intra-class feature differences, which might limit the classification performance of the model as high-level and low-level features are not properly utilized. This paper proposes a multi-scale skin cancer image identification network using self-interactive attention pyramid and cross-layer bilinear-trilinear pooling(SPCB-Net), which mainly consists of three proposed sub-modules that are the self-interacting attention pyramid (SAP), the across-layer bilinear-trilinear pooling operation and the global average algorithm(GAA). The SPCB-Net is applied to two representative datasets of medical images in dermatology and histopathology (HAM10000 and NCT-CRC-HE-100K) to demonstrate the effectiveness of in the skin lesion classification. SPCB-Net(ResNet101) achieves 97.10% and 99.87% accuracy on HAM10000 and NCT-CRC-HE-100K respectively, which are both achieved performance improvements of 0.4% compared to the state-of-the-art models. In addition, a large number of experiments on HAM10000 show that the interactive attention pyramid(SPA) proposed in this paper is superior to the common attention module, and the method with a cross-layer bilinear-trilinear pooling is superior to the cross-layer trilinear pooling method. SPCB-Net is configured on Vgg19 and ResNet101 to evaluate the effectiveness of our proposed module. The experimental results show that SPCB-Net has shown state-of-the-art performance in the two field of dermatology and histopathology. Therefore, it is not only well qualified for the task of identifying skin cancer image but also has the potential to identify skin cancer by identifying pathological tissue.
In the field of neuroscience, the electroencephalogram (EEG) is a crucial indicator of emotion. The EEG emotion recognition method based on domain adaptation (DA) has good objectivity and high time resolution and is the preferred method to study the brain's response to emotional stimuli. However, due to the obvious instability of EEG emotion characteristics, it is difficult to predict the emotion corresponding to EEG signals of cross-subjects by a model that combines all source domains into a single source. In order to solve the problem of cross-subject emotion analysis, we propose an EEG emotion recognition net with a cross-subject multi-source adaptive method (MASTF-net), where EEG features of different subjects are regarded as different domains. Through analyzing the invariance of the target domain and the uniqueness of the source domain, this method realizes the emotional analysis of different objects according to the spatio-temporal images and frequency domain information. First, features of EEG image are extracted from frequency and time dimensions. Secondly, combined with the serialized EEG frequency characteristics of local brain regions, independent classification module are established for different domains to recognize the emotion feature distribution of different subjects. In addition, a feature extraction method of differential entropy(DE) data of EEG is proposed based on frequency band division, which can provide stable feature input for our network structure. Finally, experiments are conducted on the SEED dataset. The experimental results show that our method has better classification accuracy in the experiment on the problem of cross multiple subjects. MASTF-net is superior to other relevant methods and models in multi-source domain. On the issue of cross subject emotion analysis, the highest accuracy of our method can reach 88.19% .
Convolutional neural networks (CNNs) show excellent performance in accurate medical image segmentation. However, the characteristics of sample with small size and insufficient feature expression, irregular shape of the segmented target and inaccurate judgment of edge texture have always been problems to be faced in the field of skin lesion image segmentation. Therefore, in order to solve these problems, discrete Fourier transform (DFT) is introduced to enrich the input data and a CNN architecture (HWA-SegNet) is proposed in this paper. Firstly, DFT is improved to analyze the features of the skin lesions image, and multi-channel data is extended for each image. Secondly, a hierarchical dilated analysis module is constructed to understand the semantic features under multi-channel. Finally, the pre-prediction results are fine-tuned using a weight adjustment structure with fully connected layers to obtain higher accuracy prediction results. Then, 520 skin lesion images are tested on the ISIC 2018 dataset. Extensive experimental results show that our HWA-SegNet improve the average segmentation Dice Similarity Coefficient from 88.30% to 91.88%, Sensitivity from 89.29% to 92.99%, and Jaccard similarity index from 81.15% to 85.90% compared with U-Net. Compared with the State-of-the-Art method, the Jaccard similarity index and Specificity are close, but the Dice Similarity Coefficient is higher. The experimental data show that the data augmentation strategy based on improved DFT and HWA-SegNet are effective for skin lesion image segmentation.
MRI is often influenced by many factors, and single image super-resolution (SISR) based on a neural network is an effective and cost-effective alternative technique for the high-resolution restoration of low-resolution images. However, deep neural networks can easily lead to overfitting and make the test results worse. The network with a shallow training network is difficult to fit quickly and cannot completely learn training samples. To solve the above problems, a new end-to-end super-resolution (SR) method is proposed for magnetic resonance (MR) images. Firstly, in order to better fuse features, a parameter-free chunking fusion block (PCFB) is proposed, which can divide the feature map into n branches by splitting channels to obtain parameter-free attention. Secondly, the proposed training strategy including perceptual loss, gradient loss, and L1 loss has significantly improved the accuracy of model fitting and prediction. Finally, the proposed model and training strategy take the super-resolution IXISR dataset (PD, T1, and T2) as an example to compare with the existing excellent methods and obtain advanced performance. A large number of experiments have proved that the proposed method performs better than the advanced methods in highly reliable measurement.
With the development of modern medical technology, medical image classification has played an important role in medical diagnosis and clinical practice. Medical image classification algorithms based on deep learning emerge in endlessly, and have achieved amazing results. However, most of these methods ignore the feature representation based on frequency domain, and only focus on spatial features. To solve this problem, we propose a hybrid domain feature learning (HDFL) module based on windowed fast Fourier convolution pyramid, which combines the global features with a wide range of receptive fields in frequency domain and the local features with multiple scales in spatial domain. In order to prevent frequency leakage, we construct a Windowed Fast Fourier Convolution (WFFC) structure based on Fast Fourier Convolution (FFC). In order to learn hybrid domain features, we combine ResNet, FPN, and attention mechanism to construct a hybrid domain feature learning module. In addition, a super-parametric optimization algorithm is constructed based on genetic algorithm for our classification model, so as to realize the automation of our super-parametric optimization. We evaluated the newly published medical image classification dataset MedMNIST, and the experimental results show that our method can effectively learning the hybrid domain feature information of frequency domain and spatial domain.
The classification method of steel surface defects based on deep learning provides a basis for quality control of industrial steel manufacturing. Due to a large number of interference in the steel production area and the limited computing resources of the edge equipment deployed in the production area, it is a challenge to develop a lightweight model to achieve rapid and accurate classification in the case of limited computing resources. In this article, an improved lightweight convolution structure (LCS) is proposed, which combines the separable structure of convolution and introduces depth convolution and point direction convolution instead of the traditional convolutional module, so as to realize the lightweight of the model. In order to ensure the classification accuracy, spatial attention and channel attention are combined to compensate for the accuracy loss after deep convolution and point direction convolution respectively. Further, in order to improve the classification accuracy, a mixed interactive attention module (MIAM) is proposed to enhance the extracted feature information after LCS. The experimental results show that the recognition accuracy of our method exceeds that of the traditional model, and the number of parameters and the amount of calculation are greatly reduced, which realizes the lightweight of the steel surface defect classification model.
Melanoma segmentation based on a convolutional neural network (CNN) has recently attracted extensive attention. However, the features captured by CNN are always local that result in discontinuous feature extraction. To solve this problem, we propose a novel multiscale feature fusion network (MSFA-Net). MSFA-Net can extract feature information at different scales through a multiscale feature fusion structure (MSF) in the network and then calibrate and restore the extracted information to achieve the purpose of melanoma segmentation. Specifically, based on the popular encoder-decoder structure, we designed three functional modules, namely MSF, asymmetric skip connection structure (ASCS), and calibration decoder (Decoder). In addition, a weighted cross-entropy loss and two-stage learning rate optimization strategy are designed to train the network more effectively. Compared qualitatively and quantitatively with the representative neural network methods with encoder-decoder structure, such as U-Net, the proposed method can achieve advanced performance.
The surface defects of a hot-rolled strip will adversely affect the appearance and quality of industrial products. Therefore, the timely identification of hot-rolled strip surface defects is of great significance. In order to improve the efficiency and accuracy of surface defect detection, a lightweight network based on coordinate attention and self-interaction (CASI-Net), which integrates channel domain, spatial information, and a self-interaction module, is proposed to automatically identify six kinds of hot-rolled steel strip surface defects. In this paper, we use coordinate attention to embed location information into channel attention, which enables the CASI-Net to locate the region of defects more accurately, thus contributing to better recognition and classification. In addition, features are converted into aggregation features from the horizontal and vertical direction attention. Furthermore, a self-interaction module is proposed to interactively fuse the extracted feature information to improve the classification accuracy. The experimental results show that CASI-Net can achieve accurate defect classification with reduced parameters and computation.
提出了一种基于无人机数据采样的人脸识别研究方法.针对无人机采集的图像或视频数据进行人脸识别应用,采用深度学习算法对此进行研究,通过线下采集获取目标人脸,对采集到的目标人脸进行数据增强扩充数据集,进而增加入物识别准确率,使用训练好的Facenet网络对目标人脸进行特征提取,获得目标人物人脸特征并建立人脸特征库.在人脸检测阶段,当接收端接收到无人机采集的图像数据后,利用YOLOv5进行检测,识别人物所在区域,随后裁剪出人脸区域,传入Facenet网络进行人脸识别,获得采集到的人脸特征向量,然后结合人脸库与采集到的人脸特征向量.采用SVM进行数据分类,实现对不同类别的目标人物人脸分类,通过实验论证了此方法的可行性.
Forest pests and diseases are a global problem. The key to control forestry diseases is to accurately identify the species and severity of pests. How to use artificial intelligence and image recognition technology to detect forestry pests is an important challenge and opportunity. This paper presents a new method for forestry pest identification based on YOLOv5 algorithm. In addition, in order to unify the system and expand the flexibility of the future system, we adopted the B/S/S structure to develop the pest identification system. The system uses the camera to shoot images and transmits the data to the background recognition. The experimental results show that our system can detect the target pests more accurately and conveniently, which is helpful for the actual prevention and control of forestry pests.