The large amounts of data continuously generated online offer opportunities to identify and analyse trends in various aspects of society. For instance, data from online social media are frequently used as a means of analysing informal interactions, opinions, and feelings of groups of people. Additionally, bibliometric data can be used to investigate more formal trends that occur in scientific research. A popular approach to analysing such complex semi-structured data is the construction of complex networks based on keywords or concept extraction. However, such keyword-based complex network data are often shared in a preprocessed form, with little information about the underlying process used to construct it. Indeed, key decisions are normally made at an early stage in the construction of complex networks from raw data, and can have a significant impact on subsequent analysis and interpretation. In this paper, we highlight the sensitivity of results to data preprocessing decisions by looking at two different case studies which employ networks constructed from underlying semi-structured data. The experiments conducted show high sensitivity to data preprocessing for many commonly adopted metrics. These results demonstrate the need for transparent reporting of data lineage and preprocessing decisions.
Data quality problems are present in all real-world, large-scale datasets. Each of these potential problems can be addressed in multiple ways through data cleaning. However, there is no single best data cleaning approach that always produces a perfect result, meaning that a choice needs to be made about which approach to use. At the same time, machine learning (ML) models are being trained and tested on these cleaned datasets, usually with one single data cleaning pipeline applied. In practice, however, data cleaning pipelines are updated regularly, often without retraining of production models. It is therefore common to apply different test (or production) data than the data on which the models were originally trained. The changes in these new test data and the data cleaning process applied can have potential ramifications for model performance. In this article, we show the impact that altering a data cleaning pipeline between the training and testing steps of an ML workflow can have. Through the fitting and evaluation of over 6,000 models, we find that mismatches between cleaning pipelines on training and test data can have a meaningful impact on regression model performance. Counter-intuitively, such mismatches can improve test set performance and potentially alter model selection choices.
A spreading process can be observed when particular information, substances, or diseases spread through a population over time in social and biological systems. It is widely believed that contact interactions among individual entities play an essential role in the spreading process. Although contact interactions are often influenced by geometrical conditions, little attention has been paid to understand their effects, especially on contact duration among pedestrians. To examine how the pedestrian flow setups affect contact duration distribution, we have analyzed trajectories of pedestrians in contact interactions collected from pedestrian flow experiments of uni-, bi- and multi-directional setups. Based on turning angle entropy and efficiency, we have classified the type of motion observed in the contact interactions. We have found that the majority of contact interactions in the unidirectional flow setup can be categorized as confined motion, hinting at the possibility of long-lived contact duration. However, ballistic motion is more frequently observed in the other flow conditions, yielding frequent, brief contact interactions. Our results demonstrate that observing more confined motions is likely associated with the increase of parallel contact interactions regardless of pedestrian flow setups. This study highlights that the confined motions tend to yield longer contact duration, suggesting that the infectious disease transmission risk would be considerable even for low transmissibility. These results have important implications for crowd management in the context of minimizing spreading risk.This work is an extended version of Kwak et al. (2023) presented at the 2023 International Conference on Computational Science (ICCS).
Epidemic models have become increasingly useful, especially in the wake of the recent COVID-19 pandemic, emphasizing the crucial role of human behavior in the spread of disease. There has been a recent rise in the usage and popularity of generative artificial intelligence (GenAI), such as ChatGPT especially with its ability to mimic human behavior. In this study, we demonstrate a novel application of GenAI for epidemic modeling. We employed GenAI for creating agents living in a hypothetical town in simulations and simulating their behavior within the context of an ongoing pandemic. We performed a series of simulations to quantify the impact of agent traits and the availability of information for health condition, virus, and government guidelines on the disease spread patterns in terms of peak time and epidemic duration. We also characterized the most influential factors in agents' decision-making using random forest model.
A common form of analysis of textual data is entity co-occurrence, where networks of entities and their connections within the text are constructed and their topology analysed. As the analysis is focused on the entities and their relations, the tools used to extract them can have a potentially large effect on the results. A frequently used method as part of these analyses is entity linking, where extracted entities are mapped to a knowledge graph. Many established entity linking tools have been created for long text following standard spelling and grammar rules. As a result, the tools struggle on short, unstructured text such as tweets. On such text, it can be difficult to choose between tools and parameter settings, especially since ground truth is often unavailable. Given these challenges in entity linking on text and the direct influence of extracted entities on subsequent network analysis, we propose the need to apply multiple tools to create a more holistic set of results. We verify this assertion through a set of experiments. Using a dataset of approximately 21 million English-language tweets, we construct multiple entity co-occurrence networks using two tools (Fast Entity Linker and DBpedia Spotlight) and numerous confidence thresholds for each. We find that standard network analysis metrics, such as size, connectivity, and centrality are all heavily influenced by the choice of entity linking tool.
A spreading process can be observed when a particular behavior, substance, or disease spreads through a population over time in social and biological systems. It is widely believed that contact interactions among individual entities play an essential role in the spreading process. Although the contact interactions are often influenced by geometrical conditions, little attention has been paid to understand their effects especially on contact duration among pedestrians. To examine how the pedestrian flow setups affect contact duration distribution, we have analyzed trajectories of pedestrians in contact interactions collected from pedestrian flow experiments of uni-, bi- and multi-directional setups. Based on standardized maximal distance, we have classified types of motions observed in the contact interactions. We have found that almost all motion in the unidirectional flow setup can be characterized as subdiffusive motion, suggesting that the empirically measured contact duration tends to be longer than one estimated by ballistic motion assumption. However, Brownian motion is more frequently observed from other flow setups, indicating that the contact duration estimated by ballistic motion assumption shows good agreement with the empirically measured one. Furthermore, when the difference in relative speed distributions between the experimental data and ballistic motion assumption is larger, more subdiffusive motions are observed. This study also has practical implications. For instance, it highlights that geometrical conditions yielding smaller difference in the relative speed distributions are preferred when diseases can be transmitted through face-to-face interactions.
External supervision services play an important role in combating corruption by detecting potential collusive bribery. This work aims at studying the dynamics of collusive bribery when participants have the option of engaging the external supervision services. To do so, we construct a basic model where collusive bribery can happen between the defecting participants who aim to escape from a punishment by offering a bribe to rule enforcers who monitor interactions among all participants. Among rule enforcers, only the corrupt ones accept the bribe and ignore the violations. The cooperative participants can engage the external supervision service at a certain cost to avoid the risk of potential collusive bribery. Under the framework of evolutionary game theory, we find that a higher initial fraction of honest enforcers is more likely to lead to a trusting cooperating equilibrium. We also find that, when allowing random exploration of available strategies, increasing the exploration rate of rule enforcers is effective in combating corruption for both infinite and finite populations. Lastly, we find that minimizing the cost of external supervision services is not always good. When the system evolves into a cooperating equilibrium, a low cost of external supervision service induces unnecessary costs of seeking external supervision. When the strategy profiles exhibit stable oscillations, there exists an optimal cost of external supervision, considering the trade-off between minimizing the chance of exposing cooperative participants to collusive bribery and strengthening the punishment on the corrupt enforcers. Premised on the results, we discuss practical management suggestions.& COPY; 2023 The Authors. Published by Elsevier Inc. This is an open access article under the CC BY license ( http://creativecommons.org/licenses/by/4.0/ )
The successful application of computational models presupposes access to accurate, relevant, and representative datasets. The growth of public data, and the increasing practice of data sharing and reuse, emphasises the importance of data provenance and increases the need for modellers to understand how data processing decisions might impact model output. One key step in the data processing pipeline is that of data integration and entity resolution, where entities are matched across disparate datasets. In this paper, we present a new formulation of data integration in complex networks that incorporates integration uncertainty. We define an approach for understanding how different data integration setups can impact the results of network diffusion models under this uncertainty, allowing one to systematically characterise potential model outputs in order to create an output distribution that provides a more comprehensive picture.
Complex networks are a powerful way to reason about systems with non-trivial patterns of interaction. The increased attention in this research area is accelerated by the increasing availability of complex network data sets, with data often being reused as secondary data sources. Typically, multiple data sources are combined to create a larger, fuller picture of these complex networks and in doing so scientists have to make sometimes subjective decisions about how these sources should be integrated. These seemingly trivial decisions can sometimes have significant impact on both the resultant integrated networks and any downstream network models executed on them. We highlight the importance of this impact in online social networks and dark networks, two use-cases where data are regularly combined from multiple sources due to challenges in measurement or overlap of networks. We present a method for systematically testing how different, realistic data integration approaches can alter both the networks themselves and network models run on them, as well as an associated Python package (NIDMod) that implements this method. A number of experiments show the effectiveness of our method in identifying the impact of different data integration setups on network diffusion models.
We study how the presence of committed volunteers influences the collective helping behavior in emergency evacuation scenarios. In this study, committed volunteers do not change their decision to help injured persons, implying that other evacuees may adapt their helping behavior through strategic interactions. An evolutionary game theoretic model is developed which is then coupled to a pedestrian movement model to examine the collective helping behavior in evacuations. By systematically controlling the number of committed volunteers and payoff parameters, we have characterized and summarized various collective helping behaviors in phase diagrams. From our numerical simulations, we observe that the existence of committed volunteers can promote cooperation but adding additional committed volunteers is effective only above a minimum number of committed volunteers. This study also highlights that the evolution of collective helping behavior is strongly affected by the evacuation process.
Evacuation planning for hospital emergency departments is challenging because of the large number of patients with limited mobility due to severe illness. For trolley-ridden patients, elevators are often the only available mode for vertical evacuations. Thus, allocation of trolley-ridden patients to elevators is important to reduce vertical evacuation time with limited number of elevators. We developed a simulation model of vertical evacuation using elevators and applied the model to the future Singapore General Hospital emergency department as a case study. In the case study, we divided trolley-ridden patients into several groups based on their locations and evaluated the maximum evacuation time for various allocation setups. Simulation results show that evacuation on the lower level is sensitive to the allocation on the upper level. The overlapping utilization of the shared elevator by each level may lead to long queuing time at the lower levels and consequently increase the overall evacuation time.
Due to phenomena such as urban heat islands, outdoor thermal comfort of the cities' residents emerges as a growing concern. A major challenge for mega-cities in changing climate is the design of urban spaces that ensure and promote pedestrian thermal comfort. Understanding pedestrian behavioural adaptation to urban thermal environments is critically important to attain this goal. Current research in pedestrian behaviour lacks controlled experimentation, which limits the quantitative modelling of such complex behaviour. Combining well-controlled experiments with human participants and computational methods inspired by behavioural ecology and decision theory, we examine the effect of sun exposure on route choice in a tropical city. We find that the distance walked in the shade is discounted by a factor of 0.86 compared to the distance walked in the sun, and that shadows cast by buildings have a stronger effect than trees. The discounting effect is mathematically formalised and thus allows quantification of the behaviour that can be used in understanding pedestrian behaviour in changing urban climates. The results highlight the importance of assessment of climate through human responses to it and point the way forward to explore scenarios to mitigate pedestrian heat stress.
Understanding how contact patterns arise from crowd movement is crucial for assessing the spread of infection at mass gathering events. Here we study contact patterns from Wi-Fi mobility data of large sports and entertainment events in the Johan Cruijff ArenA stadium in Amsterdam. We show that crowd movement behaviour at mass gathering events is not homogeneous in time, but naturally consists of alternating periods of movement and rest. As a result, contact duration distributions are heavy-tailed, an observation which is not explained by models assuming that pedestrian contacts are analogous to collisions in the kinetic gas model. We investigate the effect of heavy-tailed contact duration patterns on the spread of infection using various random walk models. We show how different types of intermittent movement behaviour interact with a time-dependent infection probability. Our results point to the existence of a crossover point where increased contact duration presents a higher level of transmission risk than increasing the number of contacts. In addition, we show that different types of intermittent movement behaviour give rise to different mass-action kinetics, but also show that neither one of two mass-action mechanisms uniquely describes events.
Incentives are usually introduced by the regulator entity (third-party), to promote cooperation in a market. The implementation of incentives is always costly and thus might fail to be enforced sustainably. This work aims at exploring the effects of incentives from an institutional perspective, while coping with the scenario where the third-party is part of the system but not composed by players. The evolutionary game theory (EGT) framework is applied to identify the incentives that lead to pure cooperation. In contrast to traditional EGT, this paper introduces an elimination mechanism that can reduce the market size. The incentives identified in the EGT analysis are further examined in simulation experiments which measure the market size, affluence and sustainability. The findings show: (1) light punishment leads to a reduction of the market size, yet heavier punishment is beneficial to the market size and wealth; (2) mixed incentives will generally lead to different wealth of the third party and of the participants. While under moderate strength, the wealth of both parties is the same and their overall wealth is maximal; (3) for sustainability, pure punishment (resp. reward) is sustainable (resp. unsustainable), the sustainability of mixed incentives depends on both their strength and agents’ rationality level.
Deployment and management of environmental infrastructures, such as charging infrastructure for Electric Vehicles (EV), is a challenging task. For policy makers, it is particularly difficult to estimate the capacity of current deployed public charging infrastructure for a given EV user population. While data analysis of charging data has shown added value for monitoring EV systems, it is not valid to linearly extrapolate charging infrastructure performance when increasing population size.We developed a data-driven agent-based model that can explore future scenarios to identify non-trivial dynamics that may be caused by EV user interaction, such as competition or collaboration, and that may affect performance metrics. We validated the model by comparing EV user activity patterns in time and space.We performed stress tests on the 4 largest cities the Netherlands to explore the capacity of the existing charging network. Our results demonstrate that (i) a non-linear relation exists between system utilization and inconvenience even at the base case; (ii) from 2.5x current population, the occupancy of non-habitual charging increases at the expense of habitual users, leading to an expected decline of occupancy for habitual users; and (iii) from a ratio of 0.6 non-habitual users to habitual users competition effects intensify. For the infrastructure to which the stress test is applied, a ratio of approximately 0.6 may indicate a maximum allowed ratio that balances performance with inconvenience. For policy makers, this implies that when they see diminishing marginal performance of KPIs in their monitoring reports, they should be aware of potential exponential increase of inconvenience for EV users.
Excess school segregation is a phenomena observed across many countries and one common explanation from the literature is the hypothesis that parents might want to live in a diverse neighbourhood, but when it comes to their children, they are less tolerant with respect to school compositions. This study uses an agent-based model where households face residential decisions depending on neighbourhood compositions and make school choices based on distance and school compositions. Results indicate that increased school segregation relative to residential segregation can be observed in large parts of the parameter space, even when the tolerance for households belonging to the other group is equal for neighbourhood and school compositions. Our results demonstrate that asymmetric preferences are not a requirement for excess school segregation and show that residential segregation combined with distance preferences play a key role in this increase.
The Kumbh Mela festival is the largest mass gathering in the world that is celebrated every three years. In 2016, it attracted over 70 million people to Ujjain, India. The Mahakal temple is the "heart"of the festival that attracts a huge number of pilgrims and needs to accommodate with massive crowds. These types of events pose significant safety challenges as large-scale mass gatherings are often associated with risks such as crowd crushes. There have been a number of serious incidents documented in recent history such as the Hajj crush at Mina, Mecca, Saudi Arabia (2006 and 2015), the Lame Horse crush during a fire at Perm, Russia (2009), the Love Parade disaster at Duisburg, Germany (2010), and the Kumbh Mela stampede at Allahabad, Uttar Pradesh, India (2013) to name a few. Safety assurance at events of such tremendous size is closely connected with crowd control and understanding the general behaviour of the crowd. One of the basic challenges in understanding crowd dynamics is being able to predict crowd flows at a particular location based on past/present flows from another location. There are several existing methods and models used to predict and manage crowd flow. In this paper, we introduce a novel method for short-term crowd flow prediction and show that it decreases the prediction error by 13% as compared to existing methods. The model is based on ensemble learning where we demonstrate that a combination of complementary methods with different a-priory assumptions can create better estimations. Utilizing a unique data set derived from CCTV camera recordings of pilgrims that we collected during the Kumbh Mela 2016 festival, we tested different methods from artificial intelligence and computational modelling, such as simple shift of time-series (time-shift), agent-based modelling, machine learning methods, and show how combinations of these different methods as an ensemble provide synergy to obtain better predictions. Our results demonstrate that agent-based modelling, when combined with other models, provides better predictive power especially in complex scenarios. These results point to something fundamental about the information contained within and generated by these methods. We anticipate that our research could be a starting point for further research of informational synergetic aspects of models and predictors.
Jaeyoung Kwak1,∗ Michael H. Lees, Wentong Cai, Ahmad Reza Pourghaderi, and Marcus E.H. Ong 1 Complexity Institute, Nanyang Technological University, Singapore 2 Informatics Institute, University of Amsterdam, The Netherlands 3 School of Computer Science and Engineering, Nanyang Technological University, Singapore 4 Health Systems Research Center (HSRC), Singapore Health Services, Singapore 5 Department of Emergency Medicine, Singapore General Hospital, Singapore and 6 Health Services and Systems Research (HSSR), Duke-NUS Medical School, Singapore (Dated: January 8, 2021)
Emergency evacuation of patients from a hospital can be challenging in the event of a fire. Most emergency evacuation studies are based on the assumption that pedestrians are ambulant and can egress by themselves. However, this is often not the case during emergency evacuations in healthcare facilities such as hospitals and nursing homes. To investigate emergency evacuations in such healthcare facilities, we performed a series of controlled experiments to study the dynamics of patient beds in horizontal movement. We considered a patient bed because it is one of the commonly used devices to transport patients within healthcare facilities. Through a series of controlled experiments, we examined the change of velocity in corner turning movements and speed reductions in multiple trips between both ends of a straight corridor. Based on the experimental results, we then developed a mathematical model of total evacuation time prediction for a patient bed horizontally moving in a healthcare facility. Factoring uncertainty in the horizontal movement, we produced the probability distribution of movement duration and estimated the probability that an evacuation can be safely performed within certain amount of time. In addition, we predicted that the evacuation time would be longer than the prediction results from an existing model which assumes constant movement speed. Our results from the model demonstrated good agreement with our experimental results.
Brian Logan合作论文数School of Computer Science and Information Technology
University of Nottingham12