論文

2006年11月

A maximum likelihood approach to density estimation with semidefinite programming

NEURAL COMPUTATION
  • Tadayoshi Fushiki
  • ,
  • Shingo Horiuchi
  • ,
  • Takashi Tsuchiya

18
11
開始ページ
2777
終了ページ
2812
記述言語
英語
掲載種別
研究論文(学術雑誌)
DOI
10.1162/neco.2006.18.11.2777
出版者・発行元
MIT PRESS

Density estimation plays an important and fundamental role in pattern recognition, machine learning, and statistics. In this article, we develop a parametric approach to univariate (or low-dimensional) density estimation based on semidefinite programming (SDP). Our density model is expressed as the product of a nonnegative polynomial and a base density such as normal distribution, exponential distribution, and uniform distribution. When the base density is specified, the maximum likelihood estimation of the polynomial is formulated as a variant of SDP that is solved in polynomial time with the interior point methods. Since the base density typically contains just one or two parameters, computation of the maximum likelihood estimate reduces to a one- or two-dimensional easy optimization problem with this use of SDP. Thus, the rigorous maximum likelihood estimate can be computed in our approach. Furthermore, such conditions as symmetry and unimodality of the density function can be easily handled within this framework. AIC is used to choose the best model. Through applications to several instances, we demonstrate flexibility of the model and performance of the proposed procedure. Combination with a mixture approach is also presented. The proposed approach has possible other applications beyond density estimation. This point is clarified through an application to the maximum likelihood estimation of the intensity function of a nonstationary Poisson process.

リンク情報
DOI
https://doi.org/10.1162/neco.2006.18.11.2777
Web of Science
https://gateway.webofknowledge.com/gateway/Gateway.cgi?GWVersion=2&SrcAuth=JSTA_CEL&SrcApp=J_Gate_JST&DestLinkType=FullRecord&KeyUT=WOS:000240735600009&DestApp=WOS_CPL
ID情報
  • DOI : 10.1162/neco.2006.18.11.2777
  • ISSN : 0899-7667
  • eISSN : 1530-888X
  • Web of Science ID : WOS:000240735600009

エクスポート
BibTeX RIS