๐ฉโ๐ป Join our community of thousands of amazing developers!
Summary I add parallization for Pen.el using GNU parallel. This means parallelization can happen across servers, for example, or take advantage of tmux. Simply set n-simultaneous-requests to a number in pen.yaml. 1 2 # lm-complete-generic is parallelised for increased prompting throughput n-simultaneous-requests: 5 code http://github.com/semiosis/pen.el/blob/master/scripts/lm-complete Demo --...