Studying open clusters (OCs) is essential for a comprehensive understanding of the structure and evolution of the Milky Way. Many previous studies have systematically searched for OCs near the solar system within 1.2 kpc or 20 degrees of galactic latitude. However, few studies searched for OCs at higher galactic latitudes and deeper distances. In this study, based on a hybrid unsupervised clustering algorithm (Friends-of-Friends and pyUPMASK) and a binary classification algorithm (Random Forest), we extended the search region (i.e., galactic latitude |b|>=20 degrees) and performed a fine-grained blind search of Galactic clusters in Gaia DR3. After cross-matching, the newly discovered cluster candidates are fitted using isochrone fitting to estimate the main physical parameters (age and metallicity) of these clusters. These cluster candidates were then checked using manual visual inspection. Their statistical properties were compared with previously exposed cluster catalogs as well. In the end, we found 1,179 new clusters with considerable confidence within 5kpc.
The Square Kilometre Array (SKA) would be the world's largest radio telescope with eventually over a square kilometre of collecting area. However, there are enormous challenges in its data processing. The use of modern distributed computing techniques to solve the problem of massive data processing in the SKA is one of the most important challenges. In this study, basing on the Dask distribution computational framework, and taking the visibility function integral processing as an example, we adopt a multi-level parallelism method to implement distributed averaging over time and channel. Dask Array was used to implement super large matrix or arrays with supported parallelism. To maximize the usage of memory, we further exploit the data parallelism provided by Dask that intelligently distributes the computational load across a network of computer agents and has a built-in fault tolerance mechanism. The validity of the proposed pattern was also verified by using the Common Astronomy Software Application (CASA), wherein we analyze the smearing effects on images reconstructed from different resolution visibilities.
Data archiving is one of the most critical issues for modern astronomical observations. With the development of a new generation of radio telescopes, the transfer and archiving of massive remote data have become urgent problems to be solved. Herein, we present a practical and robust file-level flow-control approach, called the Unlimited Sliding-Window (USW), by referring to the classic flow-control method in the TCP protocol. Based on the USW and the Next Generation Archive System (NGAS) developed for the Murchison Widefield Array telescope, we further implemented an enhanced archive system (ENGAS) using ZeroMQ middleware. The ENGAS substantially improves the transfer performance and ensures the integrity of transferred files. In the tests, the ENGAS is approximately three to twelve times faster than the NGAS and can fully utilize the bandwidth of network links. Thus, for archiving radio observation data, the ENGAS reduces the communication time, improves the bandwidth utilization, and solves the remote synchronous archiving of data from observatories such as Mingantu spectral radioheliograph. It also provides a better reference for the future construction of the Square Kilometer Array (SKA) Science Regional Center.
The execution framework would significantly decrease the operation costs and improve the execution performance, but developing applications of the execution framework is not an easy job. In this chapter, we present a series of examples to demonstrate how to design and develop execution framework technology-based applications.
With the era of big data coming, whether in computer operating system or mobile operating system, the shortcomings of traditional way of file management become increasingly obvious. For example, data access and data retrieval across devices are very inconvenient. At the same time, storage space in disks and cloud storage services is underutilized. To address these issues, we propose Rio, a personal storage system in multi-device and cloud storage. Cloud storage services, treated as one storage device in Rio, together with shared devices form a storage pool. In Rio, users can store, retrieve and access data through RESTful URI, no matter in which device or cloud services data are stored. Rio also sets up redundant storage in idle space to improve disk storage utilization. In the experiment, we compared Rio with U disk, FTP, Dropbox and other common data sharing methods. Then we tested Rio’s data access performance and system overhead. The results show that Rio increases the accessibility of data greatly and only costs small system overhead.
Astronomy has become one of the biggest consumers of computing resources in the past 10 years. Therefore, new computational solutions (both hardware and software) are emerging, dedicated to the various fields of science. For example, in radio astronomy, instruments are becoming extremely large, much like the square kilometer array and its precursor telescopes. Thus, it is expected that astronomical experiments will become larger in all dimensions: larger data collections, more accurate data analysis and processing, and more detailed results. The significant increase of these large-size experiments performed by instruments built around the world requires not only huge processing power, but also clever system design. We realize that execution framework technology is becoming a significant component for modern astronomical data processing.
: With the progress of sky survey projects, traditional database technology cannot satisfy the requirements of massive astronomical data storage and retrieval performance. In this paper, aiming at the high concurrency and performance of massive astronomical data storage and cone search, database middleware technology is used. When massive data reaches the limit of traditional database storage, it can be stored in the form of sub-database and sub-table through middleware technology. In the database cluster, the characteristics of the relational databases and distributed technology are fully integrated. In this article, the application of MySQL database integrated DIF plug-in technology to establish a pseudo-spherical index in a distributed database can meet the needs of spatial indexing in massive astronomical data.
望远镜的观测日志在用户进行数据处理以及台站对观测数据进行存储、归档和发布时都非常重要,观测日志往往能提供很多信息以供用户判断观测数据的质量.在观测过程中,观测日志通过观测助手或用户手工记录,存在信息不全、笔误等多种可能,且纸质的观测日志也不利于后期数据的归档和发布.针对丽江2.4 m望远镜云南暗弱天体成像光谱仪的观测数据,设计研发了一套自动记录观测日志的辅助系统,该系统可以自动记录观测数据的日志信息,并提供修改错误信息的功能;系统中以用户的观测时间申请书编号为唯一代码对数据进行管理,从而实现了根据不同用户进行观测数据打包的功能.在保护观测数据权限的同时,降低了笔误带来的影响,提高了观测日志的准确性,最终提高望远镜的观测效率.
随着新一代天文观测技术的快速发展,观测设备所获得的科学数据迅猛增长,传统的外挂式存储设备已经难以满足海量观测数据的近实时存储和同步数据处理的需求.基于廉价硬件的分布式存储系统是解决当前天文观测数据存储的有效手段.由于廉价硬件节点发生故障的概率相对较高,为了确保科学观测和数据的可靠存储,提出了一种基于Paxos的改进的分布式软件多副本复制算法.实验表明,在针对大于1 MB的天文FITS图像文件存储过程中,算法虽然增加少量的存储延迟,但能够容忍多种软硬件异常下多个副本的强一致性,较好地解决当前海量天文数据存储中的多副本数据存储的一致性问题.
平方千米阵列(Square Kilometre Array, SKA)望远镜建成后将具有超高的灵敏度、超快的巡天速度以及宽视场,进而产生超海量的观测数据。SKA天文台与各国区域数据中心间的海量数据同步传输是当前SKA建设中的一个难点。SKA先导项目使用的下一代归档存储系统(Next Generation Archive System, NGAS)在应用测试中存在效率低下,性能不足等问题。提出了一种基于ZeroMQ的数据存储与同步方法,通过采用更加高效的异步消息机制实现同步传输数据,回避了NGAS原有的采用HTTP协议的局限。实验结果表明,新方法在平均数据归档存储效率方面比原有方法快了近40倍,能够基本满足10 GB带宽的全速传输需要,取得了较好的使用效果。
随着天文技术的发展,天文数据处理软件的需求也不断更迭变化,导致软件运行环境渐趋复杂.对于开发者和使用者,急需提出一种对复杂天文数据处理软件敏捷化封装和部署的方法.我国明安图射电频谱日像仪已进入常规观测,与之配套的数据处理软件也已完成开发并投入使用.由于该软件的部署涉及操作系统环境、 图形处理器运行环境及底层依赖软件等配置问题,导致安装过程既繁琐又容易出错.结合容器技术的特点,提出了一种基于Docker容器对日像仪软件系统进行敏捷封装与部署的方法,并对该方法的设计进行介绍,通过实验验证了其可用性,以及相比于传统虚拟机可获得较优异的性能表现.该方法可为未来天文数据处理软件的封装部署提供参考.可以预见,未来容器技术将成为天文海量数据处理的基础支撑技术.
射电干涉阵列宽视场成像网格化处理过程中必须考虑w项的影响.w-projection和w-stacking是两种重要的宽视场成像网格化处理算法,w-plane参数是算法中影响计算速度和成图质量的一个重要因素.研究了w-projection和w-stacking两种网格化算法,利用SKA-1低频阵台站数据和ASKAP软件包进行模拟观测,对两种算法在不同w-plane参数取值情况下的成图速度和成图质量进行了定量分析对比.结果进一步表明,w-plane是性能改善的重要参数.针对w-projection算法,w-plane取值应比一般给定的经验值大才能得到较好的成像效果.w-stacking算法虽然有很大的速度优势,但算法实现中w-plane的影响更为显著,给出了推荐的w-plane取值.本文的工作是大视场成像算法的基础性研究工作,对未来平方千米阵列科学数据处理中的管线设计有较好的参考价值.
观测控制系统是当前的一个研究热点,底层通信是观测控制系统架构的一个重要环节。但传统的观测控制系统一般采用裸套接技术实现,缺少统一的传输控制机制,在密集数据通信时经常存在延迟,影响实时控制的需要;同时缺少广播与组播机制,限制了观测控制系统的设计。针对观测控制系统的要求,研究了基于ZeroMQ不同通信模型及对应的天文控制模式,分析了不同的通信控制架构的可用性,在此基础上通过实验对相应的通信模型进行测试,验证其在天文仪器分布控制中的可用性。测试结果进一步说明,ZeroMQ构建观测控制系统的底层通信架构是可行的,能够满足观测控制系统对设备的各种控制需求。
With the rapid development of mobile computing, wearable wrist-worn has become more and more popular, but the current vibrotactile feedback patterns of most wrist-worn devices are too simple to enable effective interaction in nonvisual scenarios. In this paper, we propose the Dancing wristband prototype system, which provides multiple vibration patterns for users to recognize multi-semantic information in eyes-free scenarios easily. With four vibrating motors placed in different positions in the wristband, Dancing wristband can produce five vibration patterns(positional vibration: up and down; diagonal vibration: horizontal; circular vibration (four motors vibrate four times sequentially in a ring); and total vibration (all motors vibrate simultaneously at once)). According to the lab experimental results, users can distinguish the five patterns with the rate of over 75%, which proves that these five vibration patterns can be used to output multi-semantic information. The system can be applied to eyes-free interaction scenarios for wrist-worn devices.
: Optical and Near-infrared Solar Eruption Tracer(ONSET) can get a lot of sun image data every day. By real-time frame selection to these observation data, on the one hand can reduce the storage pressure, extend the observation time, the other hand can also improve the quality of subsequent image reconstruction. In this paper, a set of real-time processing image frame selection module based on GPU is designed and implemented for the frame selection in real-time observation process, and it has achieved high-speed parallel processing of gradient method and spectral ratio method in the module. This paper has discussed the implementation of the module in detail, and compared the speed of the two frame selection methods by experiment. Experimental results have shown that the module is stable and reliable. From the implementation efficiency, the best overall execution time of frame selection for nearly full view image is 1.2 seconds, and that achieve an elevated seven times more than the original serial implementation. For partial view image is 0.7 seconds, and that makes an average increase of five times. Implementation and current performance of the overall module have been able to meet the requirements of real-time observation and processing.
The independent control of telescope is an important part of modern astronomical observation technology. In the current mainstream autonomous control system,the open source RTS2 has the characteristics of modularity, plug-and-play, fast response and stable operation, resulting in its widely application in the autonomous control system. As RTS2 is mainly based on the Linux platform,which is mainly based on the CLI for remote access control, the requirements for the observers are strict. In this paper, the RTS2 system is thoroughly analyzed, and the JSON API is modified to use JSON as the data transmission format. The microcomputer application in the mobile terminal is used as the carrier,and the data access and function call of the RTS2 telescope control system are carried out across different platforms. The control system is transplanted to WeChat Micro-program,so that astronomical researchers can quickly and easily use the mobile terminal in the WeChat platform for telescope remote control and real-time monitoring telescope autonomous control system status. With this model, it can be extended to other autonomous control architectures such as ASCOM,so as to realize a remote control of mobile terminal based on micro-application.
Traditional genetic algorithms have some disadvantages in the one-dimensional multi-peaked function optimization problems. For example, it is easy to fall into local extremes, the rate of convergence is low and the stability is not ideal. This paper proposes a new adaptive genetic algorithm. Nonlinear functions are used to measure the probabilities of crossover and mutation operators. In addition, a modified algorithm flow based on the adaptive differential evolution algorithm and an elitist strategy are applied. Compared with other existing algorithms, the results of experiments indicate that the proposed algorithm has a higher convergence probability, a smaller number of iterations and a more reliable stability.
: It’s urgent to carry out high-performance scientific data processing with a single machine in the development and application of astronomical software. However, due to the different configurations of machines, the traditional CUDA + GPU technology has obvious limitations in portability and seamlessness. According to gridding algorithm in MingantU SpEctral Radioheliograph (MUSER) data processing, the OpenCL technology is used in parallel to implement multi-thread programming. The experimental results show that the gridding algorithm based on OpenCL can not only can run on various GPUs, but also merely on CPUs. While choosing execution on GPU, the execution efficiency of gridding algorithm is approximately equal with it based on CUDA. At the same time, the algorithm is not limited to the NVIDIA’s GPU, which has solved the problem of environmental dependence of CUDA+GPU. And the algorithm also has an acceptable execution efficiency high implementation with the merely CPU, which is suitable for development and testing astronomy software with a single machine , but also and will facilitate the application and promotion of astronomical software.
The Fifth Plenary Session of the 18th Communist Party of China Central Committee requests us to make efforts to actively put forward and organize international big science programs and engineering projects in the coming 13th Five-Year Plan,and all walks of life pay wide attention to the international big science.On the basis of the relevant literature,this paper introduces the features and differences of small science,big science and international big science.And this paper briefly introduces the development course and the goal of the ITER,as well as the course,the goal,and the task of China's participation in ITER.This paper focuses on the analysis of the loss and gain of China's participation in the ITER program,and some strategies are put forward for China participating or initiating international big science.