Processing Prompt (156 / 156 tokens)
Generating (100 / 100 tokens)
[21:07:36] CtxLimit:256/256, Amt:100/100, Init:0.10s, Process:57.91s (371.2ms/T = 2.69T/s), Generate:42.97s (429.7ms/T = 2.33T/s), Total:100.88s (0.99T/s)
Benchmark Completed - v1.80 Results:
======
Flags: NoAVX2=True Threads=4 HighPriority=False Cublas_Args=None Tensor_Split=None BlasThreads=4 BlasBatchSize=-1 FlashAttention=True KvCache=2
Timestamp: 2024-12-20 17:07:36.431221+00:00
Backend: koboldcpp_noavx2.dll
Layers: 0
Model: mistral7b-erebus-v3.Q4_K_M
MaxCtx: 256
GenAmount: 100
-----
ProcessingTime: 57.915s
ProcessingSpeed: 2.69T/s
GenerationTime: 42.967s
GenerationSpeed: 2.33T/s
TotalTime: 100.882s
Output:  1 1 1 1