mlc-llm

Here are 4 public repositories matching this topic...

codebase for "MELTing Point: Mobile Evaluation of Language Transformers"

android ios benchmarks energy-consumption jetson llamacpp llm-inference mlc-llm llmfarm

Dockerfiles for poetry/mlc-llm(rk3588)/...

docker poetry rk3588 mlc-llm

Guide I wrote mostly for myself on how to run mlc-llm on the Orange Pi 5 Pro

opencl orange-pi llm rk3588 orange-pi-5 mlc-llm

An example of integrating local LLMS using mlc-llm into an iOS app

swift ios local llm mlc-llm llama3-1

Add a description, image, and links to the mlc-llm topic page so that developers can more easily learn about it.

To associate your repository with the mlc-llm topic, visit your repo's landing page and select "manage topics."