Running Llama2 Models in Vanilla Minecraft With Pure Commands

I made a program that converts any llama2 large language model into a minecraft datapack, and you can run inference right inside the game. It's still semi-finished, Currently I've only implemented argmax sampling, so the output tends to stuck in loops sometimes. Adding top-p sampling will probably improve this a lot. The tokenizer is also missing for now, it can only generate text from scratch. Inference speed is...quite slow. With a 15M parameter model, it takes roughly 20 minutes to produce a single token. If you want to try it out yourself, you can download "stories15M.bin" and "tokenizer.bin" from llama2.c , and follow the instructions in my repository down below. I will keep working on this project, hopefully one day I will be able to bring a usable chat model in Minecraft. Github Rep