Instructions to use Alibaba-NLP/Tongyi-DeepResearch-30B-A3B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Alibaba-NLP/Tongyi-DeepResearch-30B-A3B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Alibaba-NLP/Tongyi-DeepResearch-30B-A3B") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("Alibaba-NLP/Tongyi-DeepResearch-30B-A3B") model = AutoModelForCausalLM.from_pretrained("Alibaba-NLP/Tongyi-DeepResearch-30B-A3B", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=256) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Alibaba-NLP/Tongyi-DeepResearch-30B-A3B with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Alibaba-NLP/Tongyi-DeepResearch-30B-A3B" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Alibaba-NLP/Tongyi-DeepResearch-30B-A3B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Alibaba-NLP/Tongyi-DeepResearch-30B-A3B
- SGLang
How to use Alibaba-NLP/Tongyi-DeepResearch-30B-A3B with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Alibaba-NLP/Tongyi-DeepResearch-30B-A3B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Alibaba-NLP/Tongyi-DeepResearch-30B-A3B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Alibaba-NLP/Tongyi-DeepResearch-30B-A3B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Alibaba-NLP/Tongyi-DeepResearch-30B-A3B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use Alibaba-NLP/Tongyi-DeepResearch-30B-A3B with Docker Model Runner:
docker model run hf.co/Alibaba-NLP/Tongyi-DeepResearch-30B-A3B
what's the base model?
Thanks for sharing! is the base model a qwen-3 32B? or it's a more specialized model on deep research?
We then ran CPT, SFT, and RL to specialize it for deep-research tasks.
We tested it on our own dataset of 1,000 prompts focusing on action interpretation and sequencing. This is not a public benchmark.
Under the same parameter settings, the performance is Qwen3-Next-80B-A3B > Qwen3-30B-A3B > Tongyi-DeepResearch-30B-A3B.
vLLM offline inference without quantization: temperature=0.6, top_p=0.95, top_k=20, repetition_penalty=1.0, presence_penalty=0.0, seed=42
Is this performance trend common across other tasks?
The base model is Qwen3-30B-A3B-Thinking-2507.
The paper https://arxiv.org/pdf/2509.13310 says otherwise:
"Starting from Qwen’s pre-trained foundation models (e.g., Qwen3-30B-A3B-Base), our enhanced training pipeline consists of"
So just wanted to confirm which one is it? Thanks for the help!
Thank you for your attention. For AgentFounder and Tongyi Deep Research, our model's starting point is Qwen3-30B-A3B-Base, upon which we conduct Agentic Continual pre-training. In addition, our other post-training work may be based on Qwen3-30B-A3B-Thinking-2507, see the description in the paper for details.