OpenSourcesAI lab results ========================= What these files are -------------------- Raw result files from @opensourcesai/bench, the open-source benchmark tool (https://github.com/endoftheline818/opensourcesai-bench). Each file is the JSON the tool wrote at the end of one run against Ollama on one machine. The file name carries the run's start time in UTC; inside, "createdAt" is the exact time. Each file records the bench client, protocol and scoring versions, the Ollama version, the GPU, driver, CPU and OS, the model digest and quantization, every measured pass, and the figures derived from them. They back the "Measured on this card" sections of: https://opensourcesai.com/hardware/rtx-3080-10gb-local-llm/ https://opensourcesai.com/hardware/rtx-4070-ti-local-llm/ Who ran them ------------ CJ Zwart (https://opensourcesai.com/about/#author), on two machines he operates: 2570server, a Linux rig with an NVIDIA GeForce RTX 3080 10 GB, and a Windows desktop with an NVIDIA GeForce RTX 4070 Ti 12 GB. The field "system.gpu.model" in each file says which card ran it. Published as-is from the rigs ----------------------------- Every file here is a byte-for-byte copy of the file kept in the site's repository under docs/lab/bench-results/. Nothing was edited, rounded or removed. Before publication each file was checked for user names, home directory paths, host names, IP addresses, tokens, serial numbers and e-mail addresses. None was present, so nothing was redacted. The tool records the Ollama endpoint only as "loopback" and OLLAMA_HOST only as set or unset. License ------- The result files in this directory are published under the Creative Commons Attribution 4.0 International license (CC BY 4.0): https://creativecommons.org/licenses/by/4.0/ You may copy, share and build on them, including commercially, as long as you credit "CJ Zwart, OpenSourcesAI" and link to https://opensourcesai.com/methodology/#result-files The license covers these result files only, not the rest of the site. How the numbers are measured ---------------------------- https://opensourcesai.com/methodology/#measurement-protocol