A New Discriminative HMM Training Procedure

A training procedure is proposed for improving the discriminative power of a maximum likelihood (ML) Hidden Markov Model (HMM) without sacrificing its classification capability. The proposed discriminative HMM consists of a conventionally trained ML model and a discriminative model. The training data is utilized in two different modes. In the first mode, conventional ML models, denoted as master models, are trained. In the second mode, discriminative models, denoted as slave models, are trained by aligning training tokens of a certain word with all but the correct word master models and the model parameters are estimated by maximizing the conditional likelihood of the training tokens given the fact that they are aligned with incorrect-word master models.