Building LLM applications for production

A question that I’ve been asked a lot recently is how large language models (LLMs) will change MLOps workflows. After working with several companies who have adopted prompt engineering into their workflows and personally going down a rabbit hole building my applications, I realized two things: It’s easy to make something cool with LLMs, but very hard to make something production-ready with them. LLM limitations are exacerbated by a lack of engineering rigor in prompt engineering, partially due ...

Submit