1 min read
中文大模型 LoRA 微调框架

支持 ChatGLM3 / Qwen / Baichuan2 / Yi · BLEU-ROUGE 评估 · Docker 部署

  • Python
  • PyTorch
  • LoRA / QLoRA
  • PEFT
  • Gradio

A full pipeline from data preprocessing to deployment for efficiently fine-tuning mainstream Chinese LLMs.

  • Multi-model: ChatGLM3, Qwen, Baichuan2, Yi
  • Efficient training: LoRA + QLoRA quantized fine-tuning
  • Evaluation: built-in BLEU / ROUGE metrics
  • UI + tracking: Gradio compare interface, Weights & Biases experiment tracking, Docker one-click deploy