移动通信技术、因特网应用技术、计算机软硬件的研发,并提供技术咨询、技术转让、技术服务;计算机应用软件服务,并提供技术服务;计算机软硬件产品及配件的生产、销售;计算机设备租赁;计算机信息系统集成服务;自有房屋租赁;设计、制作、代理、发布广告;增值电信业务(按照《增值电信业务经营许可证》上范围经营)。(依法须经批准的项目,经相关部门批准后方可开展经营活动)一般项目:云计算设备制造;云计算设备销售;互联网数据服务;信息技术咨询服务;教育咨询服务(不含涉许可审批的教育培训活动);会议及展览服务;第一类医疗器械销售;第二类医疗器械销售(除依法须经批准的项目外,凭营业执照依法自主开展经营活动)
To address issues such as low availability of computing power in ultra-large scale computing clusters of intelligent computing centers, low maturity of domestically produced technologies, bottlenecks in large-scale networking efficiency, and complex operations and maintenance, a system based on cloud computing technology for constructing a ten-thousand card cluster in an intelligent computing center was proposed. A ten-thousand card cluster was constructed using 18 432 NPU units and an optimized RDMA network. A multi-plane network architecture was adopted, in conjunction with SDN technology to achieve RDMA network tenant isolation. The network load balancing strategy was optimized, resulting in a link load balancing error of less than 10% and an All-Reduce bandwidth of over 35 GB/s. By employing the optimized distributed storage protocol, the model’s breakpoint recovery time was reduced to half of its original duration. The validation results demonstrate that the domestic NPU ten-thousand card cluster, with the collaborative optimization of software and hardware, can not only meet the training needs of large models with hundreds of billions of parameters but also support the training tasks of large models with trillions of parameters.