Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Research › peer-review
In recent applications, first-order optimization methods are often applied in the non-stationary setting when the minimum point is drifting in time, addressing a so-called parameter tracking, or non-stationary optimization (NSO) problem. In this paper, we propose a new method for NSO derived from Nesterov's Fast Gradient. We derive theoretical bounds on the expected estimation error. We illustrate our results with simulation showing that the proposed method gives more accurate estimates of the minimum points than the unmodified Fast Gradient or Stochastic Gradient in case of deterministic drift while in purely random walk all methods behave similarly. The proposed method can be used to train convolutional neural networks to obtain super-resolution of digital surface models.
Original language | English |
---|---|
Title of host publication | 2019 American Control Conference, ACC 2019 |
Publisher | Institute of Electrical and Electronics Engineers Inc. |
Pages | 1476-1481 |
ISBN (Print) | 9781538679265 |
State | Published - 1 Jul 2019 |
Event | 2019 American Control Conference, ACC 2019 - Philadelphia, United States Duration: 10 Jul 2019 → 12 Jul 2019 |
Name | Proceedings of the American Control Conference |
---|---|
Volume | 2019-July |
ISSN (Print) | 0743-1619 |
Conference | 2019 American Control Conference, ACC 2019 |
---|---|
Country/Territory | United States |
City | Philadelphia |
Period | 10/07/19 → 12/07/19 |
ID: 46583267