Jurafsky's 3rd edition draft of his NLP book and Simon Prince's DL book both have chapters on transformers, and the latter also on diffusion. Both have official free pdf versions.

https://web.stanford.edu/~jurafsky/slp3/

https://udlbook.github.io/udlbook/