p8v2 generation 1 -- derived view, per #hutter_metrics source: /home/admin/cmpr-src/tests/pprog/gen1.tsv target DSS: 1e+09 MEASURED columns are from the runs. Everything under EXTRAPOLATED is derived for a DSS of 1e+09 from a sample of the stated size and is not a measurement of anything at that size. == sample e64 (M = 64 bytes) variant axes fixed_B model_B trace_B a | model_B@DSS S/U k MEASURED MEASURED MEASURED MEASURED | EXTRAP EXTRAP EXTRAP v001 111111 25832 188 12 0.1875 | 937 0.187527 166.5 v002 211111 25832 188 12 0.1875 | 937 0.187527 166.5 v003 311111 25864 188 12 0.1875 | 937 0.187527 166.5 v004 121111 91368 188 12 0.1875 | 937 0.187592 166.5 v005 112111 25832 188 12 0.1875 | 937 0.187527 166.5 v006 111211 25832 188 12 0.1875 | 937 0.187527 166.5 v007 111311 25832 188 12 0.1875 | 937 0.187527 166.5 v008 111121 25944 188 12 0.1875 | 937 0.187527 166.5 v009 111131 25944 188 12 0.1875 | 937 0.187527 166.5 v010 111112 25832 188 12 0.1875 | 937 0.187527 166.5 v011 111113 25832 188 12 0.1875 | 937 0.187527 166.5 p7-order-1-markov ------ 17288 0 31 0.4844 | 0 0.484392 72.1 == sample e1k (M = 1000 bytes) variant axes fixed_B model_B trace_B a | model_B@DSS S/U k MEASURED MEASURED MEASURED MEASURED | EXTRAP EXTRAP EXTRAP v001 111111 25832 908 292 0.2920 | 2724 0.292029 122.5 v002 211111 25832 908 292 0.2920 | 2724 0.292029 122.5 v003 311111 25864 908 292 0.2920 | 2724 0.292029 122.5 v004 121111 91368 908 292 0.2920 | 2724 0.292094 122.5 v005 112111 25832 908 292 0.2920 | 2724 0.292029 122.5 v006 111211 25832 908 292 0.2920 | 2724 0.292029 122.5 v007 111311 25832 908 292 0.2920 | 2724 0.292029 122.5 v010 111112 25832 908 292 0.2920 | 2724 0.292029 122.5 v011 111113 25832 908 292 0.2920 | 2724 0.292029 122.5 v008 111121 25944 908 318 0.3180 | 2724 0.318029 114.0 v009 111131 25944 908 318 0.3180 | 2724 0.318029 114.0 p7-order-1-markov ------ 17288 0 611 0.6110 | 0 0.611017 49.0 == sample e10k (M = 10000 bytes) variant axes fixed_B model_B trace_B a | model_B@DSS S/U k MEASURED MEASURED MEASURED MEASURED | EXTRAP EXTRAP EXTRAP v008 111121 25944 4296 5882 0.5882 | 9666 0.588236 52.8 v001 111111 25832 4296 5901 0.5901 | 9666 0.590135 52.5 v002 211111 25832 4296 5901 0.5901 | 9666 0.590135 52.5 v003 311111 25864 4296 5901 0.5901 | 9666 0.590136 52.5 v004 121111 91368 4296 5901 0.5901 | 9666 0.590201 52.5 v005 112111 25832 4296 5901 0.5901 | 9666 0.590135 52.5 v009 111131 25944 4296 5928 0.5928 | 9666 0.592836 52.0 v010 111112 25832 1024 7834 0.7834 | 2304 0.783428 24.3 v011 111113 25832 380 7878 0.7878 | 855 0.787827 23.7 p7-order-1-markov ------ 17288 0 8354 0.8354 | 0 0.835417 17.9 v006 ? SKIPPED: D2/D3 settle one full window per candidate recorded byte, O(SC*W^2*256), quadratic in M; 10000 bytes is over the 1000 limit v007 ? SKIPPED: D2/D3 settle one full window per candidate recorded byte, O(SC*W^2*256), quadratic in M; 10000 bytes is over the 1000 limit == class (c) rate a, against sample size (MEASURED; read the trend, not any one point) variant e64 e1k e10k p7-order-1-markov 0.4844 0.6110 0.8354 v001 0.1875 0.2920 0.5901 v002 0.1875 0.2920 0.5901 v003 0.1875 0.2920 0.5901 v004 0.1875 0.2920 0.5901 v005 0.1875 0.2920 0.5901 v006 0.1875 0.2920 - v007 0.1875 0.2920 - v008 0.1875 0.3180 0.5882 v009 0.1875 0.3180 0.5928 v010 0.1875 0.2920 0.7834 v011 0.1875 0.2920 0.7878 == k=2 layer diagnostics (MEASURED; #hutter_metrics: the model is bounded at 262144 B, i.e. 2.6e-04 of S/U at 1e9, so a keep rule cannot be judged by compression at k=2) variant sample positions coverage hits removed added net/model_B p7-order-1-markov e64 0 0 0 0 0 - p7-order-1-markov e1k 0 0 0 0 0 - p7-order-1-markov e10k 0 0 0 0 0 - v001 e64 62 62 58 21 0 0.112 v001 e1k 998 998 833 356 3 0.389 v001 e10k 9998 9998 5349 3007 366 0.615 v002 e64 62 62 58 21 0 0.112 v002 e1k 998 998 833 356 3 0.389 v002 e10k 9998 9998 5349 3007 366 0.615 v003 e64 62 62 58 21 0 0.112 v003 e1k 998 998 833 356 3 0.389 v003 e10k 9998 9998 5349 3007 366 0.615 v004 e64 62 62 58 21 0 0.112 v004 e1k 998 998 833 356 3 0.389 v004 e10k 9998 9998 5349 3007 366 0.615 v005 e64 62 62 58 21 0 0.112 v005 e1k 998 998 833 356 3 0.389 v005 e10k 9998 9998 5349 3007 366 0.615 v006 e64 62 62 58 21 0 0.112 v006 e1k 998 998 833 356 3 0.389 v007 e64 62 62 58 21 0 0.112 v007 e1k 998 998 833 356 3 0.389 v008 e64 62 62 58 58 0 0.309 v008 e1k 998 998 806 806 0 0.888 v008 e10k 9998 9998 5367 5367 6 1.248 v009 e64 62 62 58 58 0 0.309 v009 e1k 998 998 806 806 0 0.888 v009 e10k 9998 9998 5321 5321 6 1.237 v010 e64 62 62 58 21 0 0.112 v010 e1k 998 998 833 356 3 0.389 v010 e10k 9998 3069 1718 791 83 0.691 v011 e64 62 62 58 21 0 0.112 v011 e1k 998 998 833 356 3 0.389 v011 e10k 9998 1971 1666 680 16 1.747 == cost (#hutter_run_costs: a cost is reported with the shape that causes it) O(M*N) shift + O(M) learn because p7 has no settling; the cost is the literal chain shift O(min(M,dumpcap)*W*256) because the trace is one causal pass; all settling is the diagnostic dump O(SC*W^2*256), quadratic in M because one full window settled per candidate recorded byte slowest rows: v007 e1k 4.4 s O(SC*W^2*256), quadratic in M v003 e10k 4.4 s O(min(M,dumpcap)*W*256) v006 e1k 4.3 s O(SC*W^2*256), quadratic in M v002 e10k 3.5 s O(min(M,dumpcap)*W*256) v004 e10k 1.8 s O(min(M,dumpcap)*W*256)