Skip to content

Pull requests: ModelTC/LightLLM

New pull request New
25 Open 757 Closed
25 Open 757 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[opt]opti-qwen2-vl-vit
#1004 opened Aug 8, 2025 by SangChengC Loading…
6
Fix
#1003 opened Aug 8, 2025 by sufubao Loading…
4
pd with nixl backend (rebase main)
#1002 opened Aug 7, 2025 by kingder Loading…
9
Support Qwen models' dp>1 in PD
#999 opened Aug 5, 2025 by zhhangBian Loading…
4
Fix error illegal memory access when max_total_token_num is too large
#998 opened Aug 4, 2025 by sufubao Loading…
15
Disk cache and cpu Cache feature
#997 opened Aug 4, 2025 by hiworldwzj Loading…
27
add rmsnorm-add fusion kernel
#996 opened Aug 4, 2025 by theNiemand Loading…
8
Dp balancer
#991 opened Jul 29, 2025 by shihaobai Loading…
5
Add shm size check
#978 opened Jul 22, 2025 by flyinglandlord Loading…
5
Asynchicache
#977 opened Jul 21, 2025 by jinbiaoyu Loading…
13
Fp8 deepseek
#975 opened Jul 17, 2025 by blueswhen Loading…
4
feat: support more PD node select func
#970 opened Jul 14, 2025 by zhhangBian Loading…
6
feat: add stop string matching
#969 opened Jul 14, 2025 by blueswhen Loading…
5
cuda graph pool with LRU
#964 opened Jul 8, 2025 by STwangyingrui Loading…
10
Add fake balance for EP mode
#962 opened Jul 8, 2025 by STwangyingrui Loading…
3
Multimodal improve
#951 opened Jul 1, 2025 by shihaobai Loading…
10
feat: Support decode chunk PD serving mode
#944 opened Jun 25, 2025 by zhhangBian Loading…
5
deepseek && qwen tp performance tuning
#934 opened Jun 19, 2025 by shihaobai Loading…
10
pd with nixl backend
#856 opened Apr 23, 2025 by kingder Loading…
3 tasks done
Support disk radix cache
#837 opened Apr 18, 2025 by jayfeather9 Loading…
edp with cc+acc is done
#669 opened Dec 16, 2024 by charlotteroes Loading…
[feature] add deepseekv2 edp support, based on pr628
#662 opened Dec 10, 2024 by Vincent-syr Loading…
feat(misc): Profiler support
#611 opened Nov 20, 2024 by WuSiYu Loading…
feat: add cohere model for v1 and plus
#416 opened May 28, 2024 by PannenetsF Loading…
feat: add load_from_weight_dict interface
#318 opened Jan 25, 2024 by bingo787 Loading…
ProTip! Mix and match filters to narrow down what you’re looking for.