Text Generation with Neural Networks

In my bachelor thesis I’m looking into ways to generate text with deep neural networks. To be more specific, I’m trying to create non-goal-driven conversational agent trained on corpus of data from microblogging service like Twitter.
There are several reasons for development of such agent (apart from having to cope with very interesting and challenging problem). It may be used for tasks without directly measurable goal (such as language learning), for fun (as a character in computer game) or more meta stuff (like human simulator that trains other goal-driven system).
The fastest-developing field in domain of natural language processing (with neural nets) is right now machine translation. I’m going to try utilize some of the current state-of-the-art approaches from machine translation in the task of response generation by conversational agent.