A New Way to Distill Local AI Models: OPTD?
How to Distill a Small Local LLM (w OPTD).
Inside the Transformer: A New Way to Distill Local AI Models.
All rights w/ authors:
On-Policy Transition Distillation
Runyang You1 Yongqi Li1† Tiezheng Yu2 Wenjie Li1
from
1 The Hong Kong Polytechnic University
2 Huawei Technologies Ltd.
runyang.y@outlook.com, liyongqi0@gmail.com
#airesearch
#aiexplaiend
#aitechnology