报告题目: Decentralized Reduced Rank Regression for Response Partition

报告人：毛晓军（上海交通大学长聘教轨副教授）

报告时间：2024年10月18日 15:00-16:00

报告地点：文波楼401会议室

摘要: Distributed learning in decentralized networks has been extensively studied and applied in various machine-learning scenarios. However, previous research primarily focused on data partitioning based on samples. In this paper, we address the less explored scenario of response partition, where different components of the response vector are collected and stored across multiple nodes in a multi-agent network. To mitigate the information loss resulting from response partitioning, we use the Reduced Rank Regression (RRR) model to establish connections between the response components. Subsequently, we formulate an optimization problem that involves both local and global parameters within the framework of matrix factorization, capturing both inter-node and intra-node correlations. To solve this problem efficiently, we propose an algorithm based on Decentralized Gradient Descent with Gradient Tracking (DGGT), which incorporates an additional step for local estimation. The theoretical analysis yields non-asymptotic error bounds for both estimation error and consensus error. As the number of iterations tends to infinity, the statistical error rate converges to the optimal performance achieved in the centralized case. Furthermore, we validate the effectiveness of our method through simulations and real-world applications. The numerical results not only align with our theoretical findings but also demonstrate the superiority of our approach over local reduced-rank regression methods.

报告人简介: 毛晓军，上海交通大学长聘教轨副教授。他的研究领域包括分布式统计推断，推荐系统和高维数据分析。主要研究成果发表于AOS,  JASA,  JMLR,  IEEE  (TIT,  TSP,  TIFS),  ICML,  NeurIPS,  《管理世界》等顶级期刊及会议上。先后主持国家自然科学基金优秀青年基金项目、面上项目，入选第九届中国科协青年人才托举工程等。