An Ensemble Routing Method Makes LLM Inference Prompt-Adaptive and Cost-Aware.
PISA and PISA-E route LLM prompts and ensembles by cost and quality, lowering inference costs by 36% in-distribution and 25% out-of-distribution.
PISA and PISA-E route LLM prompts and ensembles by cost and quality, lowering inference costs by 36% in-distribution and 25% out-of-distribution.