Hacker Next
Laguna XS 2.1 33B on a RTX 3090: 296 tok/s peak, 152 tok/s at 256K contextlucebox.com
19 points by GreenGames 3 days ago | 1 comment