Piqle
PIQLE is a set of Java classes for quickly experimenting reinforcement learning schemes. For understanding what the algorithms have learned, one can use Weka classification/clustering algorithms : the (s,a,Q(s,a)) values can be formatted in ARFF files.