The original Siri voice I read elsewhere was just a bunch of odd pieces. Most of it was not even words, but from their they were able to have Siri say anything they wanted.
What I found the most alarming was the way they could type in words and phrases that the person never said and they sounded seamless! Apparently they need a minimum of 20 minutes of speech and they can synthesise just about anything...