LLM APIs are a Synchronization Problem

The blog post discusses the complexities of using large language model (LLM) APIs, arguing that they present a synchronization problem akin to distributed state management. It critiques the current message-based API design and suggests that these abstractions may not be appropriate for the underlying technology, advocating for a shift towards a state synchronization API that can manage hidden states and improve developer experience.