A call directing system receives an incoming call from a caller. The caller is prompted to speak, thus enabling a prosody analyzer to generate an analysis of a prosody of the caller's voice. This analysis provides a basis for generating a caller profile that describes caller preferences of the caller. Based on the analysis of the prosody of the caller's voice and the generated caller profile, the call is directed to a particular call recipient.