MMFlash accelerates speculative decoding for vision-language models.
MMFlash targets visually dependent tokens in multimodal speculative decoding with sparse attention, yielding lossless speedups up to 3.58 times.
MMFlash targets visually dependent tokens in multimodal speculative decoding with sparse attention, yielding lossless speedups up to 3.58 times.