🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
Repository dossier
labmlai/annotated_deep_learning_paper_implementations
🧑🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠
Brief / README 摘要
查看原文*Note**: use the Annotated Implementation Skill with coding agents to implement any paper. This is a collection of simple PyTorch implementations of neural networks and related algorithms. These implementations are documented with explanations, The website renders these as side-by-side formatted notes. We believe these would help you understand these algorithms better. We are actively maintaining this repo and adding new implementations almost weekly. for updates. JAX implementation Multi-headed attention Triton Flash Attention Transformer building blocks Transformer XL Relative multi-headed a…
Topics / 标签
相关推荐
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
List of Computer Science courses with video lectures.
A high-throughput and memory-efficient inference and serving engine for LLMs
Tensors and Dynamic neural networks in Python with strong GPU acceleration