Open challenges in LLM research

1 · Chip Huyen · Aug. 16, 2023, 4:38 p.m.
Never before in my life had I seen so many smart people working on the same goal: making LLMs better. After talking to many people working in both industry and academia, I noticed the 10 major research directions that emerged. The first two directions are probably the most talked about today. I’m the most excited about numbers 3 (multimodality), 5 (new architecture), and 6 (GPU alternatives). Open challenges in LLM research 1. Reduce and measure hallucinations 2. Optimize context length and c...