Why stop at the session? With @colin-fraser.net‘s Frankenmodel we can have inference providers bid on every token in real time!
Yeah. Self-hosting isn't going to happen much, but complete commodification of inference probably is going to be. I can see stuff like automatic bidding on individual sessions happening, even