Understanding Dim and Alpha: Key Concepts for LoRA Training
Introduction If you’re experimenting with LoRA training, you’ve likely come across different software tools, each using slightly different terminology to refer to the dimensions and scaling parameters of your model. Whether you’re using ai-toolkit, Kohya-ss, or another tool, understanding these parameters is crucial for getting the best results from your model. This article aims to …
Read more “Understanding Dim and Alpha: Key Concepts for LoRA Training”