A method of determining the accuracy of a speech recognition system can include identifying from a log of the speech recognition system a text result and attributes associated with the text result. An audio representation from which the text result was derived can be accessed. The audio representation can be processed with a reference speech recognition engine to determine a second text result. The text result can be compared with the second text result to determine an accuracy of the speech recognition system.