Our paper has been accepted to the 2027 IEEE 24th Consumer Communications & Networking Conference (CCNC). This paper proposes a method for bandwidth-constrained dynamic split inference for large multimodal models using sink-aware mixed-precision quantization. This research is joint work with Prof. Nishio (Institute of Science Tokyo).
Chen Yen-Hsiu, Kento Uchida, Shinichi Shirakawa, and Takayuki Nishio: Bandwidth-Constrained Dynamic Split Inference for Large Multimodal Models via Sink-Aware Mixed-Precision Quantization, 2027 IEEE 24th Consumer Communications & Networking Conference (CCNC), Las Vegas, NV, USA, January 9-12, 2027. (Accepted)