frozen embeddings

Model Comparisons

When Should You Fine-Tune the LLM Instead of Using Frozen Embeddings and Adapting the Scikit-Learn Head?

LoRA fine-tuning vs frozen embeddings for LLM classification: frozen was faster at 82% accuracy; LoRA was stronger but took three times longer.

Oct 29, 2026