01 - Understanding Attention: The Core of Transformers
Complete guide to Understanding Attention: The Core of Transformers: architecture, practical implementation and best practices for developers and technical teams.
Advanced deep learning: quantization, pruning, knowledge distillation, edge device deployment, ONNX Runtime, TensorRT, and optimization for embedded and mobile devices.
This series collects 10 articles (approximately 162 minutes of total reading time), designed for a level Advanced. The main topics covered are Deep Learning, edge deployment, quantization, ONNX.
Complete guide to Understanding Attention: The Core of Transformers: architecture, practical implementation and best practices for developers and technical teams.
Complete guide to Fine-Tuning Transformers: LoRA, QLoRA, DoRA: architecture, practical implementation and best practices for developers and technical teams.
Complete guide to Model Quantization: GPTQ, AWQ, SmoothQuant: architecture, practical implementation and best practices for developers and technical teams.
Complete guide to Knowledge Distillation: Compress Models Efficiently: architecture, practical implementation and best practices for developers and technical teams.
Complete guide to Neural Network Pruning: Structured and Unstructured: architecture, practical implementation and best practices for developers and technical teams.
Complete guide to Running Local LLMs: Ollama Setup and Deployment: architecture, practical implementation and best practices for developers and technical teams.
Complete guide to LLM on Edge: Deploying on Raspberry Pi and Jetson: architecture, practical implementation and best practices for developers and technical teams.
Complete guide to Vision Transformers: Architecture and Training: architecture, practical implementation and best practices for developers and technical teams.
Complete guide to Automated Neural Architecture Search: Techniques and Tools: architecture, practical implementation and best practices for developers and technical teams.
Complete guide to Optimizing Deep Learning: Memory and Speed Trade-offs: architecture, practical implementation and best practices for developers and technical teams.
Have you read all the articles? Check how much you've learned by taking this series' quizzes.