TR2003-22
Classification with Free Energy at Raised Temperatures
-
- "Classification with Free Energy at Raised Temperatures", Eurospeech, September 2003. ,
-
Research Areas:
Abstract:
In this paper we describe a generalized classification method for HMM-based speech recognition systems, that uses free energy as a discriminant function rather than conventional probabilities. The discriminant function incorporates a single adjustable temperature parameter T. The computation of free energy can be motivated using an entropy regularization, where the entropy grows monotonically with the temperature. In the resulting generalized classification scheme, teh values of T = 0 and T = 1 give the conventional Viterbi and forward algorithms, respectively, as special cases. We show experimentally that if the test data are mismatched with the classifier, classification at temperatures higher than one can lead to significant improvements in recognition performance. The temperature parameter is far more effective in improving performance on mismatched data than a variance scaling factor, which is another apparent single adjustable parameter than has a very similar analytical form.
Related News & Events
-
NEWS Eurospeech 2003: 2 publications by MERL researchers and others Date: September 1, 2003
Where: EurospeechBrief- The papers "Classification with Free Energy at Raised Temperatures" by Singh, R., Warmuth, M., Raj, B. and Lamere, P. and "Design of the CMU Sphinx-4 Decoder" by Lamere, P., Kwok, P., Walker, W., Gouvea, E., Singh, R., Raj, B. and Wolf, P.P. were presented at Eurospeech.