HuggingFace with Pen.el. Select the right transformer

Summary I add support for HuggingFace transformers via the inference API. I also provide a mechanism for determining which API and engine to use depending on the situation. Python generation Microsoft CodeGPT 1 2 3 4 5 6 7 8 title: ms-codegpt-small-py include: Generic completion 50 tokens prompt-version: 1 lm-command: "hf-complete.sh" engine: "microsoft/CodeGPT-small-py" # https://huggingface.co/transformers/_modules/transformers/generation_utils.html # num_return_sequences has to be 1, but is ...

Submit