The author discusses the challenges and considerations of incorporating large language model (LLM) assistance into software design, particularly in a spaced-repetition flashcard app and research curation services. They emphasize the importance of user-driven functionalities for unpredictable tasks, while balancing the benefits and costs of server-side automation. The author reflects on the evolving role of AI in service design, illustrating the need for developers to adapt to user needs and changing technologies.