chore(ollama): allow for memory overprovisioning at times of high load/running larger models
This commit is contained in:
parent
7fca126657
commit
3924fb98fc
1 changed files with 3 additions and 2 deletions
|
@ -35,8 +35,9 @@ job "ollama" {
|
||||||
}
|
}
|
||||||
|
|
||||||
resources {
|
resources {
|
||||||
cpu = 100
|
cpu = 100
|
||||||
memory = 1024
|
memory = 256
|
||||||
|
memory_max = 4096
|
||||||
}
|
}
|
||||||
}
|
}
|
||||||
|
|
||||||
|
|
Loading…
Add table
Add a link
Reference in a new issue