A method and system (40) for sharing speech processing resources (54) over a (communication network (21) for handling multiple client types (100, 101, etc.) and multiple media protocol types. The system can include a router (400) coupled to the communication network, a speech response system (500) coupled to the router, and a server (600) coupled to the speech response system and the router. The server can include at least one processor programmed to determine a media protocol and a client type of a client used for speech communication with the server, adapt at least one among encoding or decoding for the speech communication based on the media protocol and the client type, and dynamically and adaptively configure of the speech processing resources based on the media protocol and the client type.