This paper outlines project TwinERGY's suggested approach to collaborative mapping of emerging energy systems with relevant stakeholders, including in particular participant consumers. The approach is based on the use of the established Causal Loop Diagram (CLD) from within the remit of System Dynamics/System Thinking techniques, as the basis of group model building. We explain how CLD is a relevant modelling technique for the problem domain of energy systems and why its qualitative nature that highlights interdependencies makes it suitable for use with participant stakeholders. Finally, we illustrate modelling examples relevant to actual project testbed deployments and initial experiment scenarios with the use of the online CLD tool LOOPY.
Abstract For many respiratory diseases, a primary mode of transmission is inhalation via aerosols and droplets. The COVID-19 pandemic has accelerated studies of aerosol dispersion in indoor environments. Most studies of aerosol dispersion present computational fluid dynamics results, which rarely include detailed experimental verification, and many of the computations are complex, making them hard to scale to larger spaces. This study presents a comparison of computational simulations and measurements of aerosol dispersion within a typical ventilated classroom. Measurements were accomplished using a custom-built low-cost sensor network composed of 15 commercially available optical particle sizers, which provided size-resolved information about the number concentrations and temporal dynamics of 0.3–40 µm diameter particles. Measurement results are compared to the computed dispersal and loss rates from a steady-state Reynolds-Averaged Navier–Stokes k-epsilon model. The results show that a newly developed aerosol-transport-model can accurately simulate the dispersion of aerosols and faithfully predict measured aerosol concentrations at different locations and times. The computational model was developed with scalability in mind such that it may be adapted for larger spaces. The experiments highlight that the fraction of aerosol recycled in the ventilation system depends on the aerosol droplet size and cannot be predicted by the recycled-to-outside air ratio. Moreover, aerosol recirculation is not negligible, as some computational approaches assume. Both modeling and measurements show that, depending on the location within the room, the maximum aerosol concentration can be many times higher than the average concentration, increasing the risk of infection.
Clinical screening of myocardial infarction is important for preventative treatment and risk stratification in cardiology practice, however current detection by electrocardiogram Q-wave analysis provides only modest accuracy for assessing prior cardiac events. We set out to evaluate the ability of a deep neural network trained on the electrocardiogram to identify patients with clinical history of myocardial infarction. We assessed 608 patients at two academic centers with adjudicated history of myocardial infarction. Surface electrocardiograms were used to train a neural network-based model that classifies patients with and without a history of infarction. Endpoints were assessed by clinical record review and accuracy of the model was compared against the manual assessment of pathologic Q waves. The neural network outperformed the accuracy of pathologic Q waves (62%). In training, the model accuracy converged to >98%. Validation was performed by cross-validation (k=5) with validation accuracy 71 ± 5%. Receiver-operator characteristics analysis resulted in a c-statistic of 0.730. Deep learning of a 12-lead ECG can identify features of prior myocardial injury more accurately than clinical Q-wave analysis and may serve as a valuable clinical screening tool.
Deep learning models have become a popular mode to classify electrocardiogram (ECG) data. Investigators have used a variety of deep learning techniques for this application. Herein, a detailed examination of deep learning methods for ECG arrhythmia detection is provided. Approaches used by investigators are examined, and their contributions to the field are detailed. For this purpose, journal papers have been surveyed according to the methods used. In addition, various deep learning models and experimental studies are described and discussed. A five-class ECG dataset containing 100,022 beats was then utilized for further analysis of deep learning techniques. The constructed models were examined with this dataset, and results are presented. This study therefore provides information concerning deep learning approaches used for arrhythmia classification, and suggestions for further research in this area.
The novel coronavirus 2019 (COVID-2019), which first appeared in Wuhan city of China in December 2019, spread rapidly around the world and became a pandemic. It has caused a devastating effect on both daily lives, public health, and the global economy. It is critical to detect the positive cases as early as possible so as to prevent the further spread of this epidemic and to quickly treat affected patients. The need for auxiliary diagnostic tools has increased as there are no accurate automated toolkits available. Recent findings obtained using radiology imaging techniques suggest that such images contain salient information about the COVID-19 virus. Application of advanced artificial intelligence (AI) techniques coupled with radiological imaging can be helpful for the accurate detection of this disease, and can also be assistive to overcome the problem of a lack of specialized physicians in remote villages. In this study, a new model for automatic COVID-19 detection using raw chest X-ray images is presented. The proposed model is developed to provide accurate diagnostics for binary classification (COVID vs. No-Findings) and multi-class classification (COVID vs. No-Findings vs. Pneumonia). Our model produced a classification accuracy of 98.08% for binary classes and 87.02% for multi-class cases. The DarkNet model was used in our study as a classifier for the you only look once (YOLO) real time object detection system. We implemented 17 convolutional layers and introduced different filtering on each layer. Our model (available at (https://github.com/muhammedtalo/COVID-19)) can be employed to assist radiologists in validating their initial screening, and can also be employed via cloud to immediately screen patients.
In this study, a deep-transfer learning approach is proposed for the automated diagnosis of diabetes mellitus (DM), using heart rate (HR) signals obtained from electrocardiogram (ECG) data. Recent progress in deep learning has contributed significantly to improvement in the quality of healthcare. In order for deep learning models to perform well, large datasets are required for training. However, a difficulty in the biomedical field is the lack of clinical data with expert annotation. A recent, commonly implemented technique to train deep learning models using small datasets is to transfer the weighting, developed from a large dataset, to the current model. This deep learning transfer strategy is generally employed for two-dimensional signals. Herein, the weighting of models pre-trained using two-dimensional large image data was applied to one-dimensional HR signals. The one-dimensional HR signals were then converted into frequency spectrum images, which were utilized for application to well-known pre-trained models, specifically: AlexNet, VggNet, ResNet, and DenseNet. The DenseNet pre-trained model yielded the highest classification average accuracy of 97.62%, and sensitivity of 100%, to detect DM subjects via HR signal recordings. In the future, we intend to further test this developed model by utilizing additional data along with cloud-based storage to diagnose DM via heart signal analysis.
Sleep disorder is a symptom of many neurological diseases that may significantly affect the quality of daily life. Traditional methods are time-consuming and involve the manual scoring of polysomnogram (PSG) signals obtained in a laboratory environment. However, the automated monitoring of sleep stages can help detect neurological disorders accurately as well. In this study, a flexible deep learning model is proposed using raw PSG signals. A one-dimensional convolutional neural network (1D-CNN) is developed using electroencephalogram (EEG) and electrooculogram (EOG) signals for the classification of sleep stages. The performance of the system is evaluated using two public databases (sleep-edf and sleep-edfx). The developed model yielded the highest accuracies of 98.06%, 94.64%, 92.36%, 91.22%, and 91.00% for two to six sleep classes, respectively, using the sleep-edf database. Further, the proposed model obtained the highest accuracies of 97.62%, 94.34%, 92.33%, 90.98%, and 89.54%, respectively for the same two to six sleep classes using the sleep-edfx dataset. The developed deep learning model is ready for clinical usage, and can be tested with big PSG data.
Background and objectiveFor diagnosis of arrhythmic heart problems, electrocardiogram (ECG) signals should be recorded and monitored. The long-term signal records obtained are analyzed by expert cardiologists. Devices such as the Holter monitor have limited hardware capabilities. For improved diagnostic capacity, it would be helpful to detect arrhythmic signals automatically. In this study, a novel approach is presented as a candidate solution for these issues.MethodsA convolutional auto-encoder (CAE) based nonlinear compression structure is implemented to reduce the signal size of arrhythmic beats. Long-short term memory (LSTM) classifiers are employed to automatically recognize arrhythmias using ECG features, which are deeply coded with the CAE network.ResultsBased upon the coded ECG signals, both storage requirement and classification time were considerably reduced. In experimental studies conducted with the MIT-BIH arrhythmia database, ECG signals were compressed by an average 0.70% percentage root mean square difference (PRD) rate, and an accuracy of over 99.0% was observed.ConclusionsOne of the significant contributions of this study is that the proposed approach can significantly reduce time duration when using LSTM networks for data analysis. Thus, a novel and effective approach was proposed for both ECG signal compression, and their high-performance automatic recognition, with very low computational cost.
Depression affects large number of people across the world today and it is considered as the global problem. It is a mood disorder which can be detected using electroencephalogram (EEG) signals. The manual detection of depression by analyzing the EEG signals requires lot of experience, tedious and time consuming. Hence, a fully automated depression diagnosis system developed using EEG signals will help the clinicians. Therefore, we propose a deep hybrid model developed using convolutional neural network (CNN) and long-short term memory (LSTM) architectures to detect depression using EEG signals. In the deep model, temporal properties of the signals are learned with CNN layers and the sequence learning process is provided through the LSTM layers. In this work, we have used EEG signals obtained from left and right hemispheres of the brain. Our work has provided 99.12% and 97.66% classification accuracies for the right and left hemisphere EEG signals respectively. Hence, we can conclude that the developed CNN-LSTM model is accurate and fast in detecting the depression using EEG signals. It can be employed in psychiatry wards of the hospitals to detect the depression using EEG signals accurately and thus aid the psychiatrists.
In this paper, we propose a new pooling method for deep convolutional neural networks. Previously introduced pooling methods either have very simple assumptions or they depend on stochastic events. Different from those methods, RegP pooling intensely investigates the input data. The main idea of this approach is finding the most distinguishing parts in regions of the input by investigating neighborhood regions to construct the pooled representation. RegP pooling improves the efficiency of the learning process, which is clearly visible in the experimental results. Further, the proposed pooling method outperformed other widely used hand-crafted pooling methods on several benchmark datasets.
Myocardial infarction (MI), commonly known as heart attack, causes irreversible damage to heart muscles and even leads to death. Rapid and accurate diagnosis of MI is critical to avoid death. Blood tests and electrocardiogram (ECG) signals are used to diagnose acute MI. However, for an increase in blood enzyme values, a certain time must pass after the attack. This time lag may delay MI diagnosis. Hence, ECG diagnosis is still very important. Manual ECG interpretation requires expertise and is prone to inter-observer variability. Therefore, computer aided diagnosis may be useful in automatic detection of MI on ECG. In this study, a deep learning model with an end-to-end structure on the standard 12-lead ECG signal for the diagnosis of MI is proposed. For this purpose, the most commonly used technique, convolutional neural network (CNN) is used. Our trained CNN model with the proposed architecture yielded impressive accuracy and sensitivity performance over 99.00% for MI diagnosis on all ECG lead signals. Thus, the proposed model has the potential to provide high performance on MI detection which can be used in wearable technologies and intensive care units. (C) 2019 Elsevier B.V. All rights reserved.
The brain disorders may cause loss of some critical functions such as thinking, speech, and movement. So, the early detection of brain diseases may help to get the timely best treatment. One of the conventional methods used to diagnose these disorders is the magnetic resonance imaging (MRI) technique. Manual diagnosis of brain abnormalities is time-consuming and difficult to perceive the minute changes in the MRI images, especially in the early stages of abnormalities. Proper selection of the features and classifiers to obtain the highest performance is a challenging task. Hence, deep learning models have been widely used for medical image analysis over the past few years. In this study, we have employed the AlexNet, Vgg-16, ResNet-18, ResNet-34, and ResNet-50 pre-trained models to automatically classify MR images in to normal, cerebrovascular, neoplastic, degenerative, and inflammatory diseases classes. We have also compared their classification performance with pre-trained models, which are the state-of-art architectures. We have obtained the best classification accuracy of 95.23% ± 0.6 with the ResNet-50 model among the five pre-trained models. Our model is ready to be tested with huge MRI images of brain abnormalities. The outcome of the model will also help the clinicians to validate their findings after manual reading of the MRI images.
Background and objective: Deep learning structures have recently achieved remarkable success in the field of machine learning. Convolutional neural networks (CNN) in image processing and long-short term memory (LSTM) in the time-series analysis are commonly used deep learning algorithms. Healthcare applications of deep learning algorithms provide important contributions for computer-aided diagnosis research. In this study, convolutional long-short term memory (CLSTM) network was used for automatic classification of EEG signals and automatic seizure detection. Methods: A new nine-layer deep network model consisting of convolutional and LSTM layers was designed. The signals processed in the convolutional layers were given as an input to the LSTM network whose outputs were processed in densely connected neural network layers. The EEG data is appropriate for a model having 1-D convolution layers. A bidirectional model was employed in the LSTM layer. Results: Bonn University EEG database with five different datasets was used for experimental studies. In this database, each dataset contains 23.6[Formula: see text]s duration 100 single channel EEG segments which consist of 4097 dimensional samples (173.61[Formula: see text]Hz). Eight two-class and three three-class clinical scenarios were examined. When the experimental results were evaluated, it was seen that the proposed model had high accuracy on both binary and ternary classification tasks. Conclusions: The proposed end-to-end learning structure showed a good performance without using any hand-crafted feature extraction or shallow classifiers to detect the seizures. The model does not require filtering, and also automatically learns to filter the input as well. As a result, the proposed model can process long duration EEG signals without applying segmentation, and can detect epileptic seizures automatically by using the correlation of ictal and interictal signals of raw data.
The social media has become one of the most widely used communication tools for people to share their opinions with others. The irony, with a simple definition, is the creative use of language, and it has recently attracted the attention of computer scientists. There is a vast amount of raw data, collected from social media resources, containing ironical statements. It is very difficult to analyze the rapidly growing data manually. Additionally, the character size limitations and typographical errors of online social media tools make the traditional methods of classification insufficient for detection task. In this study, the detection of irony in online social media is modeled as a classification problem, and the success of supervised machine learning methods in real data is assessed. Bayesian Network (BayesNet), OneR, Stochastic Gradient Descent (SGD), Logistic Model Tree (LMT), Multi-Layer Perceptron (MLP), Radial Basis Function Networks (RBF), Voted Perceptron, IBk, Randomizable Filtered Classifier (RFC), Isolation Forest, Fuzzy Lattice Reasoning (FLR), and Bagging algorithms are applied for the first time on irony detection problem and a comprehensive evaluation is provided.
Images obtained from the real world environments usually have various distortions in image quality. For example, when an object in motion is filmed, or when an environment is being filmed on the move, motion tracking effects occur on the image. Increasing the recognition performance of expert systems, which perform image recognition on data obtained under such conditions, is an important research area. In this study, we propose a Convolutional Neural Network (CNN) based Deep System Model (CNN-DSM) for accurate classification of images under challenging conditions. In the proposed model, a new layer is designed in addition to the classical CNN layers. This layer works as an enhancement layer. For the performance evaluations, various real world surface images were selected from the Curet database. Finally, results are presented and discussed.
Extreme learning machine (ELM) and deep learning methods are well-known with their efficiency, accuracy, and speed. In this study, we focus on the application of ELM to a deep learning structure for person recognition with facial expressions. For this purpose, a new convolutional neural network (CNN) model containing Kernel ELM classifiers was constructed. In this model, ELM was not used only as a fully connected layer replacement and energy function was employed to generate feature maps for the ELM. There are two advantages of the proposed model. First, it is fast and successful in face recognition studies. Second, it can drastically improve the performance of a partially-trained CNN model. Consequently, the proposed model is very suitable for CNN models, where the learning process requires a lot of time and computational power. The model is tested with the Grimace data set and experimental results are presented in details.
Magnetic resonance imaging (MRI) is the most common imaging technique used to detect abnormal brain tumors. Traditionally, MRI images are analyzed manually by radiologists to detect the abnormal conditions in the brain. Manual interpretation of huge volume of images is time consuming and difficult. Hence, computer-based detection helps in accurate and fast diagnosis. In this study, we proposed an approach that uses deep transfer learning to automatically classify normal and abnormal brain MR images. Convolutional neural network (CNN) based ResNet34 model is used as a deep learning model. We have used current deep learning techniques such as data augmentation, optimal learning rate finder and fine-tuning to train the model. The proposed model achieved 5-fold classification accuracy of 100% on 613 MR images. Our developed system is ready to test on huge database and can assist the radiologists in their daily screening of MR images. (C) 2018 Elsevier B.V. All rights reserved.
In this study, a feature vector optimization based method has been proposed for classification of the heartbeat types. Electrocardiogram (ECG) signals of five different heartbeat type were used for this aim. Firstly, wavelet transform (WT) method were applied on these ECG signals to generate all feature vectors. Optimizing these feature vectors is provided by performing particle swarm optimization (PSO), genetic search, best first, greedy stepwise and multi objective evoluationary algorithms on these vectors. These optimized feature vectors are later applied to the classifier inputs for performance evaluation. A comprehensive assessment was presented for the determination of optimized feature vectors for ECG signals and best-performing classifier for these optimized feature vectors was determined.
Electroencephalogram (EEG) is widely used to monitor the brain activities. The manual examination of these signals by experts is strenuous and time consuming. Hence, machine learning techniques can be used to improve the accuracy of detection. Nowadays, deep learning methodologies have been used in medical field to diagnose the health conditions precisely and aid the clinicians. In this study, a new deep one-dimensional convolutional neural network (1D CNN) model is proposed for the automatic recognition of normal and abnormal EEG signals. The proposed model is a complete end-to-end structure which classifies the EEG signals without requiring any feature extraction. In this study, we have used the EEG signals from temporal to occipital (T5–O1) single channel obtained from Temple University Hospital EEG Abnormal Corpus (v2.0.0) EEG dataset to develop the 1D CNN model. Our developed model has yielded the classification error rate of 20.66% in classifying the normal and abnormal EEG signals.
The electric industry's planned shift to smart grid metering infrastructure raised several concerns especially about preserving the privacy. Various data perturbation and aggregation solutions are being developed to address these concerns. The drawback of these solutions is that a simple random noise scheme cannot protect privacy, and there is a need for more advanced perturbation techniques to increase hardware costs of smart metering devices. The proposed data aggregation scheme combines the power of perturbation techniques with crypto-systems in an efficient and lightweight way so that it becomes applicable for devices with limited hardware, such as smart meters. We investigated the privacy preserving capabilities of the proposed aggregation scheme with Holt-Winters and Seasonal Trend Decomposition using Loess prediction methods. The results indicate that the proposed scheme is resilient to both filtering and true value attacks.
Mehmet Kaya合作论文数Department of Computer Engineering, Firat University1