A high-throughput and memory-efficient inference and serving engine for LLMs
Repository dossier
hiyouga/LlamaFactory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
Brief / README 摘要
查看原文Follow us and give us a star ⭐: https://github.com/Prism-Shadow/penguin-harness https://github.com/user-attachments/assets/9b7033e8-f08a-4c3f-bd33-547896664e6e 👋 Join our WeChat and NPU user groups. *Fine-tuning a large language model can be easy as...** https://github.com/user-attachments/assets/3991a3a8-4276-4d30-9cab-4cb0c4b9b99e Start local training: Please refer to usage Start cloud training: Colab (free): https://colab.research.google.com/drive/1eRTPn37ltBbYsISy9Aw2NuI2Aq5CQrD9?usp=sharing PAI-DSW (free trial): https://gallery.pai-ml.com/#/preview/deepLearning/nlp/llama_factory AMD GPU…
Topics / 标签
相关推荐
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack.
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
🤯 LobeHub is your Chief Agent Operator, organizing your agents into 7×24 operations by hiring, scheduling, and reporting on your entire AI team.