The author expresses frustration over limitations with ChatGPT's memory, particularly regarding the free plan's constraints. They also mention challenges faced while writing a story without access to a computer and inadequate support from alternative tools.