As renewable penetration in data-center power supply increases, stochastic renewable output can cause tie-line power fluctuations between data centers (DCs) and the utility grid. This paper proposes a privacy-preserving multi-time-scale tie-line power smoothing method for multiple DCs. A two-stage first-order low-pass filter decomposes tie-line fluctuations into high- and low-frequency regulation targets. Server task shifting tracks the high-frequency target, while uninterruptible power supply (UPS) regulation compensates the low-frequency residual under practical energy and power constraints. Second, a federated adaptive proximal policy optimization (Fed-AdaPPO) framework is developed. Proximal policy optimization (PPO) provides stable policy optimization in the continuous action space, and the upper confidence bound (UCB)-guided adaptive exploration improves task-shifting exploration. Critically, only Critic gradients are aggregated across DCs; Actor networks, raw workload data, and user-sensitive information remain local. This design reduces the risk of exposing local state-action mappings. Results show that coordinated server-cluster and UPS regulation reduces the standard deviation of tie-line power by at least 33.4% while maintaining service quality and data privacy.