Yeah I vaguely remember learning about those in grad school because Minsky deigned to cross the Charles and guest lecture for that one. It always seemed like you had to embed so many expectations in the reinforcement discriminators that you were basically still writing the program, just in an obnoxiously inconvenient way. Though I suppose you could make the argument that this is what diffusers are.