TR2003-22

Classification with Free Energy at Raised Temperatures


    •  Singh, R., Warmuth, M., Raj, B., Lamere, P., "Classification with Free Energy at Raised Temperatures", Eurospeech, September 2003.
      BibTeX TR2003-22 PDF
      • @inproceedings{Singh2003sep,
      • author = {Singh, R. and Warmuth, M. and Raj, B. and Lamere, P.},
      • title = {Classification with Free Energy at Raised Temperatures},
      • booktitle = {Eurospeech},
      • year = 2003,
      • month = sep,
      • url = {https://www.merl.com/publications/TR2003-22}
      • }
  • Research Areas:

    Artificial Intelligence, Speech & Audio

Abstract:

In this paper we describe a generalized classification method for HMM-based speech recognition systems, that uses free energy as a discriminant function rather than conventional probabilities. The discriminant function incorporates a single adjustable temperature parameter T. The computation of free energy can be motivated using an entropy regularization, where the entropy grows monotonically with the temperature. In the resulting generalized classification scheme, teh values of T = 0 and T = 1 give the conventional Viterbi and forward algorithms, respectively, as special cases. We show experimentally that if the test data are mismatched with the classifier, classification at temperatures higher than one can lead to significant improvements in recognition performance. The temperature parameter is far more effective in improving performance on mismatched data than a variance scaling factor, which is another apparent single adjustable parameter than has a very similar analytical form.

 

  • Related News & Events

    •  NEWS    Eurospeech 2003: 2 publications by MERL researchers and others
      Date: September 1, 2003
      Where: Eurospeech
      Brief
      • The papers "Classification with Free Energy at Raised Temperatures" by Singh, R., Warmuth, M., Raj, B. and Lamere, P. and "Design of the CMU Sphinx-4 Decoder" by Lamere, P., Kwok, P., Walker, W., Gouvea, E., Singh, R., Raj, B. and Wolf, P.P. were presented at Eurospeech.
    •