Skip to main content
Version: 24.8.0

LoraSettings

CLASS - LoraSettings(

  • rank: int =  2
  • alpha: int =  1
  • dropout_rate: float =  0.05

)

LoRA Low-Rank Adaptation of Large Language Models. https://arxiv.org/abs/2106.09685

Class Variables

  • rank (int) - Please refer to the paper.
  • alpha (int) - Please refer to the paper.
  • dropout_rate (float) - Please refer to the paper.