Actually one more point I’d like to make — even though I just told you that you should just try this and see if it works, there’s another model that seems to approximate what you’re trying to do a little more closely than plain old RNNs. Take a look at what people are accomplishing with WaveNets…