Efficient full-state quantum circuit simulations are useful tools for the design of quantum algorithms. Multi-node distributed systems are commonly employed as such simulations require a large amount of computation power and memory space. In distributed systems, communication overhead can be the performance bottleneck. This paper presents a distributed simulation framework called QuanTrans. A quantum circuit is composed of many levels of quantum gates. The simulation is conducted level by level. For circuits with particular structures, it employs a hybrid simulation approach to replace intermediate multi-level communications with one level of final merge operation, whose communication volume is comparable to that of one level of simulation in previous work. A circuit without such structures is sliced to find applicable sub-circuits with a single or multiple consecutive level(s). One level of communication is required for each sub-circuit, so we further propose a polynomial-time optimal circuit slicing algorithm. It can transform any circuit such that the number of sliced sub-circuits is the minimum after transformation. Experimental results show that QuanTrans can effectively reduce communication time and simulation time.
Log-structured merge-tree (LSM-tree) key-value stores rely on caching to mitigate multi-component lookups and long tails, yet block and KP caches are prone to compactioninduced expiry, and all three cache types suffer from scan pollution under LRU eviction. We present AutoThermKV, a two-level in-memory architecture that decouples fast admission from hot-item protection. The front tier (HotFilter) uses a 64 Baligned bitmap/key/value page layout with Quick Space Reservation for near-constant admission cost; the back tier (HotCommitted) retains proven hot items via a lightweight LRU and a secondtouch promotion rule. Implemented atop RocksDB and evaluated on YCSB-like workloads with controllable temporal locality, AutoThermKV achieves up to 2.58 × throughput speedup, 2.60 × average-latency reduction, and tail-latency improvements of up to 20 × (p99) and 36 (p999) under modest memory budgets.
CNNs, which involve intensive matrix computations, often face memory bandwidth bottlenecks that PIM architec-tures aim to overcome. RM, with its high density, low power consumption, and excellent endurance, is particularly suited for storing matrix data in such architectures. We propose a software- level data placement strategy, tile blocking, designed to optimize the shift-based access mechanism inherent in RM. We integrate this strategy into a hardware-software co-design framework for CNN feature extraction. Our approach enhances data parallelism and significantly reduces the number of shift operations, thereby achieving energy-efficient computation on RM-based PIM sys-tems. Experimental results demonstrate that our strategy reduced the average number of shifts by approximately 81.64%, reduced the average energy by approximately 38.68 %, and reduced the average execution time by approximately 44.7%.
Full‐state quantum circuit simulators play a significant role in the design and validation of quantum algorithms. With an increasing demand for the number of quantum bits (qubits), achieving efficient simulations under memory constraints emerges as a technical challenge since a state vector with elements should be maintained in each simulation step, where denotes the number of qubits. Previous work, CompQSim, partitions a state vector into blocks and uses block compression to conduct larger‐scale in‐memory simulations on supercomputers. Since the effectiveness of compressors depends on the distinctive characteristics exhibited by the circuits during simulations, an adaptive algorithm is designed to employ data compression and secondary storage astutely. The costs associated with the block processing, including the (de)compression and I/O, constitute a major portion of simulation time. To minimize such costs, two novel simulation algorithms, called BlkQSim and HyQSim are proposed. BlkQSim uses a block‐oriented simulation order to reduce the block processing costs, while HyQSim can further reduce these costs by employing different simulation algorithms on qubits. This study conducts rigorous cost analysis and presents extensive experimental results, which show that compared with CompQSim, BlkQSim and HyQSim can achieve more than 4 and 107 speedups in block processing time, respectively.
Modular quantum architectures have emerged as a promising solution for scalable quantum computing systems. Executing circuits in such distributed systems necessitates non-local operations between modules, incurring significant communication overhead. In this work, an optimized quantum circuit mapping technique called DQTetris is proposed to reduce inter-module communications. DQTetris employs a hierarchical framework that first seeks a global communication-free qubit mapping assignment under module capacity constraints. If infeasible, it searches for subcircuits with local communication-free qubit assignments via layer-wise gate pruning. Executing adjacent subcircuits with different qubit assignments incurs inter-module data teleportation. DQTetris minimizes these overheads by reducing qubit reassignment events through optimal circuit segmentation, qubit assignment selection, and adaptive gate teleportation. Experiments show that compared with existing methods, DQTetris can achieve average reductions in communication costs ranging from 28% to 75% across various benchmarks.
State vector simulation is useful for designing and analyzing quantum algorithms. The challenge is that the size of the state vector increases exponentially with the number of quantum bits (qubits) and the entire state vector should be updated when simulating each quantum gate. Gate fusion, a circuit minimization technique, helps reduce simulation time by combining multiple quantum gates into one. However, the gate matrix will be large if the fused gate acts on too many qubits, which may increase the simulation costs. Previous work limits the size of fused gates based on the number of input qubits, but the impact of qubits’ types is neglected. This paper proposes a novel two-stage gate fusion strategy, namely QMin, based on the observation that control input qubits can reduce the simulation cost of a gate, which has not been discussed before. Specifically, QMin designs a pattern-controlled logic gate structure to fuse target gates apart from their control qubits. For the first target-oriented fusion stage, QMin defines beneficial mergeable gate types based on the required multiplication operations. The second tensor-oriented fusion stage merges gates under a constraint on the gate size to further reduce the number of gates. Experimental results on various circuits show that QMin can achieve more than 2.03 times speedup on average in total execution time compared with previous methods.
Racetrack Memory (RTM), as a promising next-generation memory technology, offers high storage density and low access latency. It is a potential alternative to DRAM in main-memory applications. However, the data access pattern of RTM differs from traditional memory. Its “shift before access” characteristic presents challenges for efficient memory management and rapid data access. This article proposes a novel address remapping algorithm for RTM to improve data access efficiency in these contexts. By analyzing memory access locality and computing weights based on trace patterns, our method distributes data across multiple banks to reduce access contention caused by sequential access within a single bank. In addition, we introduce a workload balancing mechanism to achieve wear leveling, which further optimizes overall parallelism and reduces performance bottlenecks in the RTM storage system. We evaluate the proposed algorithm on 15 real-world SPEC2006 benchmarks, which demonstrates that address remapping reduces the number of shifts by 10.9 % and the total bank energy by 10.1 %. Furthermore, our strategy leads to a 10.2 % reduction in the average latency of single trace. These results highlight the potential of RTM in main-memory applications where low energy consumption and high throughput are crucial. Additionally, they illustrate the effectiveness of our approach in optimizing RTM performance for real-world, latency-sensitive workloads.
In light of the remarkable success of large language models (LLMs) in natural language understanding and generation, a trend of applying LLMs to professional domains with specialized requirements stimulates interest across various fields. It is desirable to further understand the level of intelligence that can be achieved by LLMs in solving domain-specific problems, as well as the resources that need to be invested accordingly. This paper studies the problem of generating high-quality test questions with specified knowledge points and target cognitive levels in AI-assisted teaching and learning. Our study shows that LLMs, even those as immense as GPT-4 or Bard, can hardly fulfill the design objectives, lacking clear focus on cognitive levels pertaining to specific knowledge points. In this paper, we explore the opportunity of enhancing the capability of LLMs through system design, instead of training models with substantial domain-specific data, consuming mass computing and memory resources. We propose a novel design scheme that orchestrates a dual-LLM engine, consisting of a question generation model and a cognitive-level evaluation model, built with fine-tuned, lightweight baseline models and prompting technology to generate high-quality test questions. The experimental results show that the proposed design framework, TwinStar, outperforms the state-of-the-art LLMs for effective test question generation in terms of cognitive-level adherence and knowledge relevance. TwinStar implemented with ChatGLM2-6B improves the cognitive-level adherence by almost 50% compared to Bard and 21% compared to GPT-4.0. The overall improvement in the quality of test questions generated by TwinStar reaches 12.0% compared to Bard and 2% compared with GPT-4.0 while our TwinStar implementation consumes only negligible memory space compared with that of GPT-4.0. An implementation of TwinStar using LLaMA2-13B shows a similar trend of improvement.
Mobile devices have become ubiquitous in daily life. In contrast to traditional servers, mobile devices suffer from limited memory resources, leading to a significant degradation in the user experience. This paper demonstrates that the primary cause of memory consumption lies in anonymous pages associated with application heaps. Existing schemes are ineffective in deduplicating these pages due to the limited occurrence of the same anonymous pages. This paper presents Sparrow, a similar-page aware deduplication solution for mobile systems. Sparrow shows that memory pages still have the potential to deduplicate, even though the same pages are rare. An interesting observation inspires this, that is, a high number of pages having the partially-same contents. We have implemented Sparrow on real-life smartphones. Experimental results indicate that 30.45% more space can be saved with Sparrow.
Automatic test paper design is critical in education to reduce workloads for educators and facilitate an efficient teaching process. However, current designs fail to satisfy the realistic teaching requirements of educators, including the consideration of both test quality and efficiency. This is the main reason why teachers still manually construct tests in most teaching environments. In this paper, the quality of tests is quantitatively defined while considering multiple objectives, including a flexible coverage of knowledge points, cognitive levels, and question difficulty. Then, a model based on the technique of linear programming is delicately designed to explore the optimal results for this newly defined problem. However, this technique is not efficient enough, which cannot obtain results in polynomial time. With the consideration of both test quality and generation efficiency, this paper proposes a genetic algorithm (GA) based method, named dynamic programming guided genetic algorithm with adaptive selection (DPGA-AS). In this method, a dynamic programming method is proposed in the population initialization part to improve the efficiency of the genetic algorithm. An adaptive selection method for the GA is designed to avoid prematurely falling into the local optimal for better test quality. The question bank used in our experiments is assembled based on college-level calculus questions from well-known textbooks. The experimental results show that the proposed techniques can construct test papers with both high effectiveness and efficiency. The computation time of the test assembly problem is reduced from 3 hours to 2 seconds for a 5000-size question bank as compared to a linear programming model with similar test quality. The test quality of the proposed method is better than the other baselines.
Hotspot issue is ubiquitous in the in-memory key-value stores, which seriously affects its performance. The efficiency of the index structure is the key to the performance of the in-memory key-value store, and the access of hotspot data must be through the search of the index structure. However, the existing index structures do not consider the hotspot issue, they treat and manage all the data equally, and cannot break through the performance bottleneck of the system. Index structures of type B+-Tree are common in in-memory key-value stores, but the existing B+-tree index structures do not consider the frequent structure change caused by node restructuring, which will seriously degrade the performance of the index structure. In this paper, we propose LH-Index, an efficient flattened index structure with lazy restructuring and hotness awareness. First, we use a search method combining linear search and binary search based on a partitioning strategy and endow nodes in LH-Index with a hotness awareness ability to search hotspot data quickly. Meanwhile, we use a lazy restructuring strategy for LH-Index to reduce the performance degradation due to frequent structure change. In addition, in order to meet the requirements of most scenarios, LH-Index is extended to DRAM/NVM hybrid memory by separate storage. Our evaluation shows that LH-Index achieves up to 1.85x search throughput and the lowest tail latency relative to other index structures under highly-skewed workloads, and it also has the highest throughput under mixed workloads.
Scratch-pad memory (SPM) has been widely used in embedded systems because it allows software-controlled data placement. By designing data placement strategies, optimal solutions with minimal memory access latency for loops on SPM-DRAM architecture can be explored. Although existing works effectively reduce the latency by using fine-grained data placement methods, they fail in solving the case of inconsecutive array access. Meanwhile, fine-grained strategy can lead to excessive memory activation overhead, making it less efficient. Therefore, in this paper, we first propose a finegrained dynamic programming algorithm, called FiDP, to tackle unsolved case and minimize latency. In order to mitigate the frequent activation before data access, we then add a medium-grained scheme to our strategy. It can achieve a better solution than FiDP by strictly formulating an integer linear programming (ILP) problem and considering multiple granularities, which is called MuILP. Furthermore, to compensate for the high time complexity of ILP, we develop a heuristic multi-granularity data placement algorithm, called HMuDP, which achieves a near-optimal solution with lower complexity. Experimental results show that our FiDP reduces the total latency by 75.90%, 47.70% and 12.34% compared with LRU-cache, a greedy-based comparison method (called Uday) and a dynamic programming-based comparison method (called DLAA). Besides, our MuILP and HMuDP yield less latency than FiDP with 45.10% and 43.14% average improvement, respectively.
Intermittent embedded devices and systems are widely used in various scenarios, but they often experience power failures due to unstable power supplies. Non-volatile memory (NVM) is gaining popularity in embedded systems due to its byte-addressability, low access latency, and high density. As a result, backups can be stored in NVM, and global data are directly manipulated in NVM in this architecture. However, NVM has limited write endurance and modifications to global data frequently occur which results in a significant number of writes. As a result, the extensive NVM accesses may lead to poor performance for intermittent programs. This paper presents an energy -efficient approach, called shadow -stack to minimize NVM write overhead while ensuring consistency. Furthermore, we propose a series of principles to assist programmers in rewriting the programs. And we prove the correctness of these principles using formal methods. Experimental results demonstrate that shadow -stack achieves an approximately 95.1%, 81.3%, and 76.6% improvement in NVM writes overhead compared with log -based, Coach, and Clank, respectively on average. Simultaneously, shadowstack also significantly reduces energy and time consumption compared with log -based approach by up to 19.4x and 6.87x, Coach by up to 4.2x and 2.46x, and Clank by up to 3.4x and 2.26x respectively.
Embedded systems experience execution interruption due to power failures. After a power failure restarts, recovering the interrupted program from the initial state may lead to non-termination execution. To rapid recovery of program execution under power failures, the execution states are backed up by non-volatile memory (NVM) under power failures for embedded systems. However, frequent checkpoints will shorten the lifetime of the NVM and result in significant NVM write overhead, leading to low energy utilization in a power cycle. In this paper, we propose an incremental checkpoint approach called Call-Stack-Based to mitigate the NVM write overhead. It does not introduce additional run-time overhead when compared to other state-of-the-art methods. We introduce the pseudo-function call-stack-based strategy to further mitigate non-termination issues during execution. Simultaneously, we also propose an adaptive call-stack-based optimization strategy, a technique aimed at optimizing checkpoints within loops to enhance overall performance. To further prevent the NVM contents from becoming cluttered and taking up unnecessary space, we introduce a method to clean up irrelevant data on the NVM that is not required for restoration. In conclusion, the evaluation results demonstrate an average reduction of 99.88% and 88.71% in NVM write overhead for Call-Stack-Based backup compared to the Always-Based and Step-Based, respectively.
Personalized learning path recommendation is widely studied to address the cognitive overload and learning disorientation problem in e-learning platforms. Yet, how to recommend learning materials for learners so that targeting their learning objectives with the highest efficiency has not been addressed. Driven by this problem, this paper proposes a prototype to generate the most efficient learning strategies in the learning process for reaching learning objectives, it takes the learning ability of learners into consideration, and adaptively generates the optimal strategy in the learning process. A case that knowledge concepts have hierarchical relationships based on difficulty in one knowledge topic is studied, which is named series learning in this paper. Specifically, a learning state transition model is designed for selecting the optimal learning strategies in the learning process with the consideration of the changing learning ability of learners. Based on this model, a dynamically programming (DP) based method and a greedy-based method are designed to generate learning strategies with high efficiency. Experiments are conducted in both simulated and real learning scenarios. Results show that the proposed scheme significantly outperforms the baseline method.
Benefiting from numerous attractive characteristics, persistent memory (PM) has become a promising substitute for DRAM. Unfortunately, PM suffers from limited endurance of memory cells, especially with the unbalanced wears induced by applications. Even though several wear-leveling aware allocators have been proposed to prolong the lifespan of PM, they fail to perceive the endurance variation among memory cells, which may severely damage the weak cells. In this paper, we propose V-WAFA, a fine-grained PM allocator that considers endurance variation to improve the lifespan of PM. First, V-WAFA adopts a priority-based wear-leveling strategy to mitigate the side-effect of endurance variation among pages. Second, V-WAFA utilizes fine-grained space management and allocation strategy inside pages. Briefly, V-WAFA divides pages into basic units and allocates the basic units of a page in a rotational manner to evenly distribute fine-grained updates on memory cells. We implement V-WAFA in Linux 4.4.4 and evaluate it by running standard workloads on Redis, a typical in-memory key-value store. Evaluation results show that the wear-leveling effect of V-WAFA exceeds that of malloc, nvm_malloc, WAlloc, NVMalloc, and WAFA for 7.02×, 6.91×, 5.7×, 5.68×, and 3.78×, respectively. V-WAFA also achieves similar performance with state-of-the-art PM allocators on Redis running YCSB workloads.
Quantum circuit simulation is an important tool for evaluating designed quantum algorithms. Full-state simulation gives the entire state vectors produced by the running of algorithms. Distributed simulation aims to take advantage of resources on multiple machines (a.k.a. nodes) for high-performance simulation. As a quantum circuit may have many levels, simulation on each level is called a step. The reduction in the cost on each step results in a significant saving in total cost. In existing distributed full-state simulations, the communication cost in each step dominates. In this paper, we propose a new simulation technique, namely QuanPath, which completely eliminates communications and synchronizations on each step until the final merge step. Each node can compute its portion of the state vector independently in parallel. We present detailed mathematical analyses to guarantee the correctness of QuanPath. In the final merge step, an efficient communication scheme is further designed. Experimental results show that when simulating quantum algorithms, QuanPath achieves thousands times of reduction in communication cost and obtains dozens times of simulation acceleration compared with existing techniques. In addition, QuanPath realizes almost linear speedup, so it presents good scalability.
Nonvolatile memory (NVM) has the potential as the medium for scratchpad memory (SPM) in embedded devices. Racetrack memory (RM), in particular, is a developing memory technology that possesses high density and read latency comparable to SRAM. The RM’s access operations, however, are based on shift operations. Multiple shift operations will lead to long access latency and high energy. In this article, SRAM is borrowed to help the shifts reduction. Thus, a novel hybrid SRAM+RM SPM is presented to make use of SRAM’s random access and RM’s high density. But, there are some challenges to the proposed architecture: 1) the large capacity of SRAM is not available due to its low density and 2) due to the drawbacks of RM mentioned above, data that are randomly accessed are not expected to be stored on RM. Therefore, a data placement scheme and an instruction scheduling strategy are presented for the proposed architecture. First, an access instruction scheduling strategy is introduced to obtain a relatively sequential access sequence to help with the shifts and SRAM size reduction; second, to help with data placement, a metric for representing the data access cost is proposed; third, a data placement strategy based on the metric is proposed; and finally, a solution for decreasing SRAM size is suggested to maximize the capacity of SPM (or minimize the size of SPM). Experiments show that the suggested scheme can significantly improve the performance of the hybrid SPM while also reducing the shifts on RM with minimal SRAM.
Non-volatile memory (NVM) is expected to be the second tier of memory in two-tier memory systems. However, because of the limited write endurance, it is vital to reduce the number of writes on NVM. Large-scale nested loops are the performance bottleneck in programs since the data cannot be held on the first tier of memory and then causes many write operations on NVM. Loop tiling groups iterations and loop interchange changes the execution order of the loop to improve data locality and thus reduce communication with NVM. However, research that combines loop interchange and loop tiling for minimizing writes on NVM is uncommon. In this paper, we propose a new loop tiling scheme and combine the loop interchange to solve these issues. Specifically, we propose a strategy to generate the legal tile shape, which is a parallelogram, first. Then, we propose an optimal tile size selection technique to minimize the write operations on NVM. In addition, we adopt the loop interchange technique to help loop tiling generate an optimal tile size for multi-dimensional loops. Finally, we schedule the accessing operations and computations in a pipeline fashion to cover the NVM latency. Experiments show that the proposed scheme can reduce the write on NVM efficiently. In addition, for 2-dimensional loops, NVM latency can be completely hidden.
Predicting hard disk failure effectively and efficiently can prevent the high costs of data loss for data storage systems. Disk failure prediction based on machine learning and artificial intelligence has gained notable attention, because of its good capabilities. Improving the accuracy and performance of disk failure prediction, however, is still a challenging problem. When disk failure is about to occur, the time is limited for the prediction process, including building models and predicting. Faster training would promote the efficiency of model updates, and late predictions not only have no value but also waste resources. To improve both the prediction quality and modeling timeliness, a two-layer classification-based feature selection scheme is proposed in this paper. An attribute filter calculating the importance of attributes was designed, to remove attributes insensitive to failure identification, where importance is gained based on the idea of classification tree models. Furthermore, by determining the correlation between features based on the correlation coefficient, an attribute classification method is proposed. In experiments, the models of machine learning and artificial intelligence were applied, and they included naïve Bayesian, random forest, support vector machine, gradient boosted decision tree, convolutional neural networks, and long short-term memory. The results showed that the proposed technique could improve the prediction accuracy of ML/AI-based hard disk failure prediction models. Specifically, utilizing random forest and long short-term memory with the proposed technique showed the best accuracy. Meanwhile, the proposed scheme could reduce training and prediction latency by 75% and 83%, respectively, in the best case compared with the baseline methods.