Running benchmark (Not Saved)...

Processing Prompt [BLAS] (924 / 924 tokens)
Generating (100 / 100 tokens)
[00:00:00] CtxLimit:1024/1024, Amt:100/100, Init:0.09s, Process:121.10s (131.1ms/T = 7.63T/s), Generate:58.88s (588.8ms/T = 1.70T/s), Total:179.99s (0.56T/s)
Benchmark Completed - v1.80.3 Results:
======
Flags: NoAVX2=True Threads=4 HighPriority=False Cublas_Args=None Tensor_Split=None BlasThreads=4 BlasBatchSize=512 FlashAttention=False KvCache=0
Timestamp: 0000-0000-0000 00:00:00.000000+00:00
Backend: koboldcpp_vulkan_noavx2.dll
Layers: 1
Model: mistral7b-erebus-v3.Q4_K_M
MaxCtx: 1024
GenAmount: 100
-----
ProcessingTime: 121.103s
ProcessingSpeed: 7.63T/s
GenerationTime: 58.883s
GenerationSpeed: 1.70T/s
TotalTime: 179.986s
Output:  1 1 1 1
-----
Running benchmark (Not Saved)...

Processing Prompt [BLAS] (924 / 924 tokens)
Generating (100 / 100 tokens)
[00:00:00] CtxLimit:1024/1024, Amt:100/100, Init:0.10s, Process:121.38s (131.4ms/T = 7.61T/s), Generate:58.76s (587.6ms/T = 1.70T/s), Total:180.14s (0.56T/s)
Benchmark Completed - v1.80.3 Results:
======
Flags: NoAVX2=True Threads=4 HighPriority=False Cublas_Args=None Tensor_Split=None BlasThreads=4 BlasBatchSize=256 FlashAttention=False KvCache=0
Timestamp: 0000-00-00 00:00:00.000000+00:00
Backend: koboldcpp_vulkan_noavx2.dll
Layers: 2
Model: mistral7b-erebus-v3.Q4_K_M
MaxCtx: 1024
GenAmount: 100
-----
ProcessingTime: 121.384s
ProcessingSpeed: 7.61T/s
GenerationTime: 58.760s
GenerationSpeed: 1.70T/s
TotalTime: 180.144s
Output:  1 1 1 1
-----
Running benchmark (Not Saved)...

Processing Prompt [BLAS] (924 / 924 tokens)
Generating (100 / 100 tokens)
[00:00:00] CtxLimit:1024/1024, Amt:100/100, Init:0.09s, Process:121.51s (131.5ms/T = 7.60T/s), Generate:56.51s (565.1ms/T = 1.77T/s), Total:178.01s (0.56T/s)
Benchmark Completed - v1.80.3 Results:
======
Flags: NoAVX2=True Threads=4 HighPriority=False Cublas_Args=None Tensor_Split=None BlasThreads=4 BlasBatchSize=256 FlashAttention=False KvCache=0
Timestamp: 0000-00-00 00:00:00.000000+00:00
Backend: koboldcpp_vulkan_noavx2.dll
Layers: 3
Model: mistral7b-erebus-v3.Q4_K_M
MaxCtx: 1024
GenAmount: 100
-----
ProcessingTime: 121.508s
ProcessingSpeed: 7.60T/s
GenerationTime: 56.507s
GenerationSpeed: 1.77T/s
TotalTime: 178.015s
Output:  1 1 1 1
-----
Running benchmark (Not Saved)...

Processing Prompt [BLAS] (924 / 924 tokens)
Generating (100 / 100 tokens)
[00:00:00] CtxLimit:1024/1024, Amt:100/100, Init:0.09s, Process:130.56s (141.3ms/T = 7.08T/s), Generate:59.34s (593.4ms/T = 1.69T/s), Total:189.90s (0.53T/s)
Benchmark Completed - v1.80.3 Results:
======
Flags: NoAVX2=True Threads=4 HighPriority=False Cublas_Args=None Tensor_Split=None BlasThreads=4 BlasBatchSize=128 FlashAttention=False KvCache=0
Timestamp: 0000-00-00 00:00:00.000000+00:00
Backend: koboldcpp_vulkan_noavx2.dll
Layers: 5
Model: mistral7b-erebus-v3.Q4_K_M
MaxCtx: 1024
GenAmount: 100
-----
ProcessingTime: 130.556s
ProcessingSpeed: 7.08T/s
GenerationTime: 59.344s
GenerationSpeed: 1.69T/s
TotalTime: 189.900s
Output:  1 1 1 1
-----