I may be way off here, but doesn't USB do what you want? Like if I have a Teensy and I want to plug a USB device into it, isn't that relatively simple? And fast?
These are on-board communication channels. I guess you could run USB traces, but you would end up using I2C or SPI (via a USB chip) for devices that don't have built-in USB - which is many.
