Skip to content

Pull requests: EricLBuehler/mistral.rs

New pull request New
49 Open 751 Closed
49 Open 751 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Refactor multiproc TP impl
#1180 opened Mar 9, 2025 by EricLBuehler Loading…
1
FlashMLA support
#1159 opened Feb 25, 2025 by EricLBuehler Loading…
1
Add a MISTRALRS_NO_CUBLASLT env var
#1151 opened Feb 16, 2025 by EricLBuehler Loading…
1
Implement Qwen 2.5 VL models Additions to model or architectures new feature New feature or request
#1139 opened Feb 14, 2025 by EricLBuehler Loading…
5
MPI support for multi-node
#1133 opened Feb 12, 2025 by EricLBuehler Loading…
1
I-quant support (IQ4_XS, etc)
#1120 opened Feb 3, 2025 by EricLBuehler Loading…
1
MiniCPM-O 2.6 audio support
#1089 opened Jan 23, 2025 by EricLBuehler Loading…
4
Add an easy cli
#1087 opened Jan 23, 2025 by EricLBuehler • Draft
1
Move supports_attn_softmax logic to build.rs
#1085 opened Jan 23, 2025 by EricLBuehler • Draft
5
Integrate NCCL
#1066 opened Jan 17, 2025 by EricLBuehler • Draft
3
paged-attn:cuda fallback bf16 for compute_cap < 8.0
#1040 opened Jan 8, 2025 by haricot • Draft
1
Refactor transformer implementations, unifying common components
#1030 opened Jan 6, 2025 by p-e-w • Draft
1
Distributed inference with NCCL
#1017 opened Dec 31, 2024 by EricLBuehler Loading…
1
#1008: Working <|image|> injection
#1015 opened Dec 30, 2024 by bioshazard Loading…
1
KV Cache Quantization new feature New feature or request
#988 opened Dec 11, 2024 by EricLBuehler Loading…
4 of 7 tasks
1
Add BNB cuda gemv 4bit kernels
#970 opened Dec 4, 2024 by EricLBuehler Loading…
1
Bitsandbytes quantization ISQ support
#968 opened Dec 4, 2024 by EricLBuehler Loading…
1
Add Phi 3.5 MoE, Mixtral support for UQFF
#855 opened Oct 16, 2024 by EricLBuehler Loading…
1
Add a stresstest example
#844 opened Oct 12, 2024 by EricLBuehler Loading…
1
ADDED :- Badges in Readme
#840 opened Oct 11, 2024 by Ruhi14 Loading…
2
Docs update
#837 opened Oct 10, 2024 by FarukhS52 Loading…
1
Update README.md
#826 opened Oct 5, 2024 by kushal34712 Loading…
2
Update README.md
#825 opened Oct 5, 2024 by kushal34712 Loading…
1
Add ISQ support for FLUX
#817 opened Oct 2, 2024 by EricLBuehler Loading…
2
Integrate KBNF grammar
#815 opened Oct 2, 2024 by EricLBuehler Loading…
15
ProTip! What’s not been updated in a month: updated:<2025-02-08.