Repository navigation
were you keep the llm in systme ram instad of pulling it dyrectly from storage #259
stickbrennan555-blip
started this conversation in
Ideas
Replies: 1 comment
|
Agreed, if I have enough system ram to accommodate all the LLM, why shouldn't I stream from RAM. |
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
and if you have bad systme storage like an hdd it woud be in fast memeory in your ram
All reactions