Using ONNX to integrate local AI models into .NET

· Christopher Lopes · June 3, 2024, midnight
Summary
This blog post details the author's experience replicating a generative AI application using ONNX on both Windows and Linux. The author outlines steps to download a model using Git LFS, set up a .NET Console application with necessary packages, load the model, create an interactive chat system, and output responses generated by the model. While the outcome works effectively on an older laptop, the author suggests its limited practical use but notes the potential of incorporating custom models from scikit-learn with ONNX.
AUTHOR