System | JJ's Blog

📝 ThunderAgent: A Simple, Fast and Program-Aware Agentic Inference System - ICML'26 Spotlight

📝 DroidSpeak: KV Cache Sharing Across Fine-tuned Model Variants - NSDI'26

📝 Empirical Recipes for Efficient and Compact Vision-Language Models

📝 Empower Vision Applications with LoRA LMM - Eurosys'25

📝 Venus: An Efficient Edge Memory-and-Retrieval System for VLM-based Online Video Understanding - INFOCOM'26

📝 Elastic On-Device LLM Service - MobiCom '25

📝 RServe: Overlapping Encoding and Prefill for Efficient LMM Inference

📝 ModServe - Modality- and Stage-Aware Resource Disaggregation for Scalable Multimodal Model Serving - SoCC'25

📝 Jupiter: Fast and Resource-Efficient Collaborative Inference of Generative LLMs on Edge Devices - INFOCOM'25

📝 Breaking the Wall: Unifying Edge GPUs and NPUs into Pipeline Parallelism for Efficient LLM Fine-Tuning

📝 Efficiently Serving Large Multimodal Models Using EPD Disaggregation - ICML'25

📝 ElasticMM: Efficient Multimodal LLMs Serving with Elastic Multimodal Parallelism - NeurIPS'25 Oral