量测数据驱动的分布式计算架构及优化策略研究
DOI:
CSTR:
作者:
作者单位:

1.广东电网有限责任公司;2.南京南瑞信息通信科技有限公司

作者简介:

通讯作者:

中图分类号:

基金项目:

2024年企业级量测数据中心建设项目(037800HJ24020005)


Research on Distributed Computing Architecture and Optimization Strategies Driven by Measurement Data
Author:
Affiliation:

1.Guangdong Power Grid Company Limited;2.Nanjing NARI Information and Communication Technology Co,Ltd

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    针对电力量测数据高并发处理与低延迟响应的矛盾,本文提出一种面向实时量测的分布式计算架构。通过分析Flink与Spark Streaming特性,构建基于任务优先级与资源负载自适应的调度模型,实现流数据动态资源管理。该模型事件检测精度达96.92%,吞吐量峰值132.5 GB/min,协议处理能力3492 packets/s,计算资源开销降低31.7%。实际测试表明,其故障恢复时间缩短至153.1ms(最低116ms),数据处理完整性达98.77%(峰值99.9%)。在72小时持续运行中,该模型仍保持124.7 GB/min吞吐量与94.8%检测精度,综合资源优化率达31.7%(计算复杂度降低20.9%,内存开销降低48.1%),验证了其在多电压等级复杂工况下的鲁棒性与弹性优化能力,为电力系统实时分析平台构建提供有效参考。

    Abstract:

    To address the contradiction between high-concurrency processing and low-latency response of electric power measurement data, this paper proposes a distributed computing architecture oriented toward real-time measurement. By analyzing the characteristics of Flink and Spark Streaming, a scheduling model based on task priority and adaptive resource load is constructed to achieve dynamic resource management for streaming data. The model attains an event detection accuracy of 96.92%, a peak throughput of 132.5 GB/min, protocol processing capability of 3492 packets/s, and a 31.7% reduction in computing resource overhead. Actual tests show that the fault recovery time is shortened to 153.1 ms (minimum 116 ms), and data processing integrity reaches 98.77% (peak 99.9%). During 72 hours of continuous operation, the model maintained a throughput of 124.7 GB/min and a detection accuracy of 94.8%, with a comprehensive resource optimization rate of 31.7% (20.9% reduction in computational complexity and 48.1% reduction in memory overhead), verifying its robustness and elastic optimization capability under complex multi-voltage level conditions, and providing effective reference for building real-time analysis platforms in power systems.

    参考文献
    相似文献
    引证文献
引用本文
分享
相关视频

文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2025-10-17
  • 最后修改日期:2025-11-07
  • 录用日期:2025-11-07
  • 在线发布日期:
  • 出版日期:
文章二维码