为解决电力数据分析系统在大数据时代面临的严重的性能与可伸缩性瓶颈,更好地满足生产、营销等系统的需求,分析了云计算技术的优势,提出了基于云计算的电力大数据分析系统体系结构及关键技术。基于分布式并行计算框架Hadoop和Hive,面向电力大数据特征,设计了多维索引、SQL自动翻译工具和支持数据更新的混合存储模型3项性能提升技术,实现对传统电力数据分析系统的升级优化。在浙江电力用电信息采集系统的实际部署经验表明,和传统电力数据分析系统相比,该系统以1/8的硬件成本,获得平均5倍的性能优势。证明了云计算技术能够显著提升电力大数据查询与分析性能并有效降低成本。
大数据是当今IT重要的发展趋势,其发展将对电力企业的信息化建设产生深远的影响,而Hadoop作为大数据领域最有影响力的开源产品,被国内外各厂商广泛使用.随着电力用电信息采集系统建设的进展,不断增加的数据量使得传统的线损分析方法已经无法满足业务要求.文章通过并行计算技术,采用Hadoop平台实现台区线损分析系统的并行化改造,用以提升台区线损应用的计算效率.通过选取某省电力公司线损分析系统实际数据进行对比,实验证实新的并行线损分析系统性能远远超出传统Oracle架构的线损系统,为未来并行计算技术在电量与线损管理系统的应用提供依据.
In Smart Grid applications, as the number of deployed electric smart meters increases, massive amounts of valuable meter data is generated and collected every day. To enable reliable data collection and make business decisions fast, high throughput storage and high-performance analysis of massive meter data become crucial for grid companies. Considering the advantage of high efficiency, fault tolerance, and price-performance of Hadoop and Hive systems, they are frequently deployed as underlying platform for big data processing. However, in real business use cases, these data analysis applications typically involve multidimensional range queries (MDRQ) as well as batch reading and statistics on the meter data. While Hive is high-performance at complex data batch reading and analysis, it lacks efficient indexing techniques for MDRQ.In this paper, we propose DGFIndex, an index structure for Hive that efficiently supports MDRQ for massive meter data. DGFIndex divides the data space into cubes using the grid file technique. Unlike the existing indexes in Hive, which stores all combinations of multiple dimensions, DGFIndex only stores the information of cubes. This leads to smaller index size and faster query processing. Furthermore, with pre-computing user-defined aggregations of each cube, DGFIndex only needs to access the boundary region for aggregation query. Our comprehensive experiments show that DGFIndex can save significant disk space in comparison with the existing indexes in Hive and the query performance with DGFIndex is 2-50 times faster than existing indexes in Hive and HadoopDB for aggregation query, 2-5 times faster than both for non-aggregation query, 2-75 times faster than scanning the whole table in different query selectivity.
国际合作业务应用系统是国家电网公司信息化SG186工程综合管理类的重要组成部分,目前已成为国家电网公司办理国际合作业务的日常办公平台。从项目建设背景、系统功能设计、系统架构、项目取得成果及未来规划几个方面,详细阐述了整个系统的研究与实施历程。
短信平台是为满足公司企业内部办公信息互动并与外部沟通而建立的短信智能通信系统。电网企业一体化短信平台是一套支持多种网络制式,通过因特网或专线直接将短信数据传输至移动短信网关,具备短信收发等常用功能并集成了个人设置、统计报表等功能的大容量短消息协同办公系统。用一体化的短信平台承载各业务系统的短信业务,实现了对短信业务的集中管控,减少运维节点,提高管控程度,实现协同办公,同时统一费率,节约费用,发挥了公司集团化运作优势。
论述了IPv6网络的技术发展背景及目前的发展情况,介绍了IPv6网络的关键技术。主要包括双栈、隧道、路由.DNS.网管等技术。构建了国家电网公司IPv6试验网络,对IPv6技术体制下的双栈功能.隧道功能、静态路由协议、动态OSPFv3和BGP4+路由协议、DNS和网管系统等进行了系统性研究,并结合国家电网公司实际需求,进行了流媒体点播的应用测试,根据试验网的研究成果对国家电网公司信息网的全网发展提出了相关建议。
<正>在喜庆丰收的金秋时节,在党的十七大即将召开之际。"2007电力行业信息化年会"于2007年9月6日- 8日在青海省西宁市胜利召开。本届年会由中国电机工程学会电力信息化专业委员会和国电信息中心联合主办,青海省电力公司协办。国家电力监管委员会信息中心、国家电网公司信息工作办公室、南方电网公司信息中心以及五大发电集团的信息部门等单位为会议的支持单位。电力系统各单位有关领导、信息化工作者、论文作者、IT厂商共计296名代表参加了会议。
随着互联网全球应用的广泛和普及,以IPv4为核心的第1代互联网技术面临日益严重的"技术瓶颈"。从介绍下一代互联网技术(即NGI)产生的背景着手,阐述以IPv6技术为核心的下一代互联网的主要技术优势,以及国内外研究应用的发展现状,并结合国家电网公司信息化工作实际以及网络现状,提出基于国家电网公司信息化发展目标的NGI网络研究建设的重点内容。
For the purpose of protecting the encryption transmission of the important information, the encryption telecommuting system with the function of encryption transmission and certificate authentication for electric power industry was studied and constructed, which is accord with the national commercial encryption level. Two kinds of technical scheme, SSL VPN and IPSec VPN, were analyzed, and IPSec VPN was adopted. The data encryption transmission technology realized by hardware chip was adopted to realize hardware encryption, which was authenticated by the national cryptogram management committee. The enhanced authentication based on certificate authentication method was adopted. Multi-access methods were realized, such as telephone dial up, CDMA wireless dial up, GPRS wireless dial up, enterprise LAN. The practically running encryption telecommuting system for electric power industry is established in a certain scope, which is capable of ensuring the security and secrecy of the important information transmission.
对远程办公系统的体系结构、关键技术、设计方案及与统一安全认证系统的集成进行了研究.在一定规模与范围内建立了具有远程用户安全认证、数据加密传输功能的远程办公系统.