I don't think he swatted them all away. He let some things slip by, although I've no doubt it was not spontaneous "let my guard down and got caught accidentally" on Paul's part.
I got the clear impression from Paul that he only revealed what he wanted to, not what Howard manipulated him into revealing. This is unlike what happens with his other guests.
