Features:

• Add inference support for Qwen3-TTS Base models (both Qwen3-TTS-12Hz-0.6B-Base BF16 and Qwen3-TTS-12Hz-1.7B-Base BF16), supporting zero-shot voice cloning(the performance may not be optimal, will improve in future releases)
• Add both API and CLI support for Qwen3-TTS Base models
• Add bitsandbytes NF4 quantization support for both Qwen3-ASR-0.6B and Qwen3-ASR-1.7B (weights are currently available on huggingface Qwen3-ASR-0.6B-BNB-NF4 Qwen3-ASR-1.7B-BNB-NF4)
• Add streaming(both input and output) support for audio transcription

Performance:

• Improve ASR transcription performance, achieved 10x faster than realtime speed using 1.7B models

Improvements:

• OpenAI Compatible API JSON format input support for LLM/VLM by using jinja engine from llama.cpp

Credits:

• Thanks to llama.cpp for the jinja engine

Full Changelog: 0.1.3...0.1.4