| 引用本文: | 孙博良,李国辉.一种具有遗忘特性的在线学习算法框架.[J].国防科技大学学报,2014,36(4):188-194.[点击复制] |
| SUN Boliang,LI Guohui.An online learning algorithmic framework with forgetting property[J].Journal of National University of Defense Technology,2014,36(4):188-194[点击复制] |
|
| |
|
|
| 本文已被：浏览 9414次 下载 6605次 |
| 一种具有遗忘特性的在线学习算法框架 |
| 孙博良, 李国辉 |
|
(国防科技大学 信息系统与管理学院，湖南 长沙 410073)
|
| 摘要: |
| 基于凸优化中的对偶理论，提出了一种具有遗忘特性的在线学习算法框架。其中，Hinge函数的Fenchel对偶变换是将基本学习问题由批量学习转化为在线学习的关键。新的算法过程是通过以不同方式提升含有约束变量的对偶问题实现的：(1)梯度提升；(2)贪婪提升。回顾了以往的相关研究工作，并指出了与之的区别与联系。人造数据集和真实数据集上的实验结果证实了算法框架的有效性。算法可以很好地处理数据流中的分类面漂移问题，为设计和分析新的在线学习算法提供了一个新的思路。 |
| 关键词: 在线学习 Fenchel对偶 梯度提升 贪婪提升 |
| DOI：10.11887/j.cn.201404032 |
| 投稿日期：2013-11-12 |
| 基金项目: |
|
| An online learning algorithmic framework with forgetting property |
| SUN Boliang, LI Guohui |
|
(College of Information System and Management, National University of Defense Technology, Changsha 410073, China)
|
| Abstract: |
| Based on the notion of duality in convex optimization, a novel online learning algorithmic framework with forgetting property is proposed. The Fenchel conjugate of hinge functions is a key to transfer the basic learning problem from batch to online. New online learning algorithms were derived by different dual ascending procedures: (1) gradient ascent; (2) greedy ascent. Earlier researches were reviewed. Detailed experiments on synthetic and real-world datasets verified the effectiveness of the approaches. An important conclusion is that our derived online learning algorithms can handle the settings where the target hypothesis is not fixed but drifts with the sequence of examples, which paves a way to the design and analysis of online learning algorithms. |
| Keywords: online learning Fenchel conjugate gradient ascent greedy ascent |
|
|
