Skip to content

Add Fun-ASR-Nano (Speech LLM) to the list #276

Description

@LauraGPT

Suggestion

This awesome list of multimodal LLMs should include Fun-ASR-Nano — a speech LLM that combines audio understanding with language generation.

Fun-ASR-Nano

  • Architecture: SenseVoice encoder + Qwen3-0.6B decoder
  • Parameters: 800M total
  • Languages: 31 languages, dialects, accents
  • Task: End-to-end speech recognition with LLM-based decoding
  • GitHub: https://github.com/FunAudioLLM/Fun-ASR (1.2K stars)

SenseVoice (Audio Encoder)

Why relevant to this list

Fun-ASR-Nano represents the "audio modality + LLM" paradigm — using a pre-trained audio encoder (SenseVoice) connected to a language model decoder (Qwen3), similar to how vision-language models connect CLIP/SigLIP to LLMs. This is a key architecture pattern in the multimodal LLM space.

The broader FunASR ecosystem: https://github.com/modelscope/FunASR (16.6K stars)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions