When Should You Fine-Tune the LLM Instead of Using Frozen Embeddings and Adapting the Scikit-Learn Head?
LoRA fine-tuning vs frozen embeddings for LLM classification: frozen was faster at 82% accuracy; LoRA was stronger but took three times longer.
LoRA fine-tuning vs frozen embeddings for LLM classification: frozen was faster at 82% accuracy; LoRA was stronger but took three times longer.