Skip to content

LMDeploy Release V0.4.1

Compare
Choose a tag to compare
@lvhan028 lvhan028 released this 07 May 08:20
· 43 commits to main since this release
14e9953

What's Changed

馃殌 Features

馃挜 Improvements

馃悶 Bug fixes

  • fix local variable 'response' referenced before assignment in async_engine.generate by @irexyc in #1513
  • Fix turbomind import in windows by @irexyc in #1533
  • Fix convert qwen2 to turbomind by @AllentDan in #1546
  • Adding api_key and model_name parameters to the restful benchmark by @NiuBlibing in #1478

馃摎 Documentations

馃寪 Other

New Contributors

Full Changelog: v0.4.0...v0.4.1