[Bug] Can't finish the build process on windows

[jeanhubdesv]

🐛 Bug

When I try to build using mlc_llm package cmd on windows I am facing an error:

To Reproduce

Create all env variables as explained here https://llm.mlc.ai/docs/deploy/android.html
and run this mlc_llm package in terminal

Environment

• Windows 11 Pro
• MLC-LLM cloned using git clone https://github.com/mlc-ai/mlc-llm.git
• TVM-Unity installed using python -m pip install --pre -U -f https://mlc.ai/wheels mlc-ai-nightly
• Python 3.11.1

[tqchen]

the error was due to lack of cmake dependency, can you install cmake via conda?

[jeanhubdesv]

Thank you for your feedback. I did that but it's failing now somewhere else.
I am going to try on a linux machine.

[AkulRT]

Facing the same issue here.

I'm not sure what I'm doing any wrong, any help would be greatly appreciated.

[tqchen]

https://llm.mlc.ai/docs/deploy/android.html#additional-guides-for-windows-users
Please try the above tips, just confirmed with a windows

[Nikhil34712]

what is that win2 error file not found the model was compiled but it should be packaged to create appication using android studio right?? but its not packaging i tried in windows , linux i tried first compiling with mlc_llm compile comand and give the path of compiled model in mlc-package-config.json file still its showing error file not found

[tqchen]

in this case, seems you didn't specify TVM_NDK_CC env variable to the right compiler

[Nikhil34712]

in this case, seems you didn't specify TVM_NDK_CC env variable to the right compiler
I specified same as in the mlc-llm official document like TVM_NDK_CC: %ANDROID_NDK%/toolchains/llvm/prebuilt/windows-x86_64/bin/aarch64-linux-android24-clang I tried this path I tried with normal clang path I tried with clang++ path even though it’s not working

[tqchen]

In this case it was looking for llvm-ar, please check if you have llvm-ar in that path

If you can list files under %ANDROID_NDK%/toolchains/llvm/prebuilt/windows-x86_64/bin that would be helpful to see if you can find files similar to llvm-ar

[Nikhil34712]

yeah llvm-ar is available in same path though its not working

[tqchen]

Thanks @Nikhil34712 , do you mind go into file ndk.py as indicated in the error message and print out the cmd. See there is a subprocess.Popen, you can try to print out cmd part and see what it tries to do. Then it should give hints about why it fails

[Nikhil34712]

Hey @tqchen thanks fro replying but do mlc_llm supports MiniCPM-V when i am compiling the model or converting the weights its showing that you have to choose only these models i have attached the files can you please address this?? and i included the commands for minicpm-v
MODEL_NAME=MiniCPM-V
QUANTIZATION=q4f16_1
MODEL_TYPE=minicpm_v
mlc_chat convert_weight --model-type ${MODEL_TYPE} ./dist/models/${MODEL_NAME}-hf/ --quantization $QUANTIZATION -o dist/$MODEL_NAME/
mlc_chat gen_config --model-type ${MODEL_TYPE} ./dist/models/${MODEL_NAME}-hf/ --quantization $QUANTIZATION --conv-template LM --sliding-window-size 1024 -o dist/${MODEL_NAME}/
mlc_chat compile --model-type ${MODEL_TYPE} dist/${MODEL_NAME}/mlc-chat-config.json --device android -o ./dist/libs/${MODEL_NAME}-android.tar
cd ./android/library
./prepare_libs.sh
cd -
these are the commnads they given