I'm really curious to hear about the user experience cause chat threads for llm interaction are the mainstream which is cause of how its inherently designed. However, I wanted to do something different that feels more interactive but I think the experience lacks in feedback from the llm. I'm curious to hear your thoughts.
Also I think the hardest thing to get right was the sandbox streaming, trying to minimize for cold boots and keep sessions from dropping out, so if anyone has questions about that I'm happy to talk about it.
I'm really curious to hear about the user experience cause chat threads for llm interaction are the mainstream which is cause of how its inherently designed. However, I wanted to do something different that feels more interactive but I think the experience lacks in feedback from the llm. I'm curious to hear your thoughts.
Also I think the hardest thing to get right was the sandbox streaming, trying to minimize for cold boots and keep sessions from dropping out, so if anyone has questions about that I'm happy to talk about it.
[dead]
[dead]