You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The tool tip for Application General Settings => CPU Threads states, "Amount of processing threads to use bounded by 1 and number of logical processors". I believe this should read physical rather than logical processors.
I conducted a test on a CPU with 32 logical processors to demonstrate that when using only CPUs (no GPU) with localdocs turned on, the amount of time between sending the prompt and the start of the response decreased until 14 CPUs were reached, then rapidly increased once the 17th CPU and beyond was added. (Test was stopped at 22 logical processors.) See chart below.
The text was updated successfully, but these errors were encountered:
Documentation
The tool tip for Application General Settings => CPU Threads states, "Amount of processing threads to use bounded by 1 and number of logical processors". I believe this should read physical rather than logical processors.
I conducted a test on a CPU with 32 logical processors to demonstrate that when using only CPUs (no GPU) with localdocs turned on, the amount of time between sending the prompt and the start of the response decreased until 14 CPUs were reached, then rapidly increased once the 17th CPU and beyond was added. (Test was stopped at 22 logical processors.) See chart below.
The text was updated successfully, but these errors were encountered: