面向灾害应急场景下边缘云服务请求突发、新场景样本有限导致的资源预缓存决策困难问题,该文提出一种基于元强化学习(meta-reinforcement learning, Meta-RL)的服务资源预缓存方法。该方法将资源预缓存过程建模为Markov决策过程(Markov decision process, MDP),以近端策略优化算法(proximal policy optimization, PPO)为基础策略框架,并从服务保障能力与资源成本效益2个维度构建综合评价指标,通过多任务训练学习可迁移的策略初始化参数,实现新场景下缓存策略的少样本快速适应。仿真结果表明,基于元强化学习的近端策略优化算法(METAPPO)在场景变化后仍具有优异的收敛性能。该方法能够提升灾害应急边缘云服务资源预缓存的快速适应能力,为少样本条件下的应急边缘智能服务资源配置提供支撑。
Objective: In disaster emergencies, edge cloud service resource pre-caching faces two major challenges. First, post-disaster service demands exhibit strong burstiness and temporal dynamics. Insufficient pre-cached resources may cause request queuing and prolonged response latency, whereas excessive pre-caching wastes computing resources and incurs additional operating costs. Second, because disaster events are rare, historical data are insufficient for newly affected regions, new service types, and newly deployed edge nodes. Conventional prediction and reinforcement learning methods therefore struggle to obtain effective pre-caching policies rapidly under few-sample conditions. To address these challenges, this paper proposes an edge cloud service resource pre-caching method based on meta-reinforcement learning (Meta-RL). Methods: Because user behavior data from real disaster scenarios are scarce, this paper analyzes service traffic in routine operational settings and trains the agent through interactions with daily service environments. The goal is to learn transferable workload evolution patterns and adapt quickly to emergency service modes. User request traffic is analyzed across Internet data centers (IDCs) and service types. The results show that traffic variations among IDCs exhibit correlations at monthly and intraday scales, indicating transferable common structures across regional workloads. Meanwhile, differences in request baselines, peak intensities, and fluctuation ranges reveal environmental heterogeneity. Across service types, different services share temporal trends but differ in request scale, peak duration, dispersion degree, and tail-load distribution. These observations indicate that daily service scenarios provide transferable experience, whereas data distribution differences hinder independent reinforcement learning training. Therefore, a Meta-RL framework is constructed to learn transferable policy initialization parameters through multitask training. Results: In the proposed framework, the edge cloud service resource pre-caching process is formulated as a Markov decision process. The agent determines the number of resources to pre-cache in the next time slot based on the current resource queue length and request waiting queue length. The reward function jointly constrains redundant cached resources and waiting requests, guiding the agent to balance service responsiveness and resource efficiency. To evaluate this trade-off, a comprehensive pooling indicator is designed from request hit capability and resource waste rate. The hit rate measures the ability of pre-cached resources to immediately satisfy user requests, whereas the waste rate characterizes the proportion of cached resources that remain unused. For policy optimization, proximal policy optimization (PPO) is adopted as the basic framework, and a meta proximal policy optimization (METAPPO) algorithm is developed. METAPPO performs task-specific adaptation through inner-loop updates and optimizes shared initial policy parameters via outer-loop updates, improving adaptability to new IDCs, service types, and emergency tasks. Conclusions: Simulation experiments compare METAPPO with PPO and other baseline methods across edge cloud service environments. The results show that METAPPO accelerates convergence across multiple scenarios. After a scenario change, METAPPO still exhibits favorable convergence performance, demonstrating that the meta-learning mechanism improves policy adaptation efficiency. Although some conventional methods may achieve competitive steady-state performance after sufficient training, they usually require more historical samples and longer training processes. Conversely, METAPPO leverages cross-task experience from daily service scenarios and rapidly generates effective resource pre-caching policies under few-sample conditions, supporting fast resource allocation adaptation in multiregion, multiservice, and newly emerging emergency edge cloud scenarios.