feat: Support llm.c as a WasmEdge plugin

[hydai]

Summary

Motivation

WasmEdge runtime provides inference support for AI models and LLMs (large language models, such as llama3 and phi-3-mini). We believe training a new model is important. Wasm can do both the inference and training jobs. We would like to build a WasmEdge plugin which uses llm.c as the backend, and a set of WASI extensions like WASI-NN for developers to use.

Details

Objectives

The primary objectives of this project are to create a WasmEdge plugin and an SDK to use these functions with the following features:

• Train GPT-2
• Test and Verify the trained GPT-2
• Allow users to use Rust/C/C++ language to develop an application for using this plugin

Deliverables

Upon successful completion of this project, the following deliverables are expected:

1. A Rust language framework for WasmEdge applications to train the GPT-2
2. A WasmEdge plugin that implements and integrates the llm.c features.
3. Documentation and sample applications

Appendix

• llm.c
• WASI-NN
• WASI-NN Rust SDK