Bulat_Ziganshin Цитата: 1. сравнение сжатия srep+rep+lzma vs srep+lzma vs rep+lzma
исходные данные Nero-9.2.6.0_trial.tar
1883МБ статистика по Nero-9.2.6.0_trial.tar ниже
http://forum.ru-board.com/topic.cgi?forum=5&topic=1406&start=1760#20 http://forum.ru-board.com/topic.cgi?forum=5&topic=1406&start=1960#16 [more=nero.bat..]
timer.exe srep.exe Nero-9.2.6.0_trial.tar Nero_srep_512
timer.exe srep.exe -d Nero_srep_512 Nero_srep_512_d
md5sum\md5sum.exe -c Nero-9.2.6.0_trial_srep_512.md5
IF ERRORLEVEL 1 (echo Nero_srep_512_d bad) & (GOTO nodel1)
del /F /Q Nero_srep_512_d
:nodel1
timer.exe Arc.exe a Nero_rep_512.arc -mrep:1024m Nero-9.2.6.0_trial.tar -di -di+$#
timer.exe Arc.exe a Nero_srep_512_lzma.arc -msrep+lzma:1024m Nero-9.2.6.0_trial.tar -di -di+$#
timer.exe Arc.exe a Nero_rep_512_lzma.arc -mrep:1024m+lzma:1024m Nero-9.2.6.0_trial.tar -di -di+$#
timer.exe Arc.exe a Nero_lzma.arc -mlzma:1024m Nero-9.2.6.0_trial.tar -di -di+$#
timer.exe Arc.exe a Nero_srep_512_rep_512_lzma.arc -msrep+rep:1024m+lzma:1024m Nero-9.2.6.0_trial.tar -di -di+$#
timer.exe srep.exe -l64 Nero-9.2.6.0_trial.tar Nero_srep_64
timer.exe srep.exe -d Nero_srep_64 Nero_srep_64_d
md5sum\md5sum.exe -c Nero-9.2.6.0_trial_srep_64.md5
IF ERRORLEVEL 1 (echo Nero_srep_64_d bad) & (GOTO nodel2)
del /F /Q Nero_srep_64_d
:nodel2
timer.exe Arc.exe a Nero_rep_64.arc -mrep:1024m:64 Nero-9.2.6.0_trial.tar -di -di+$#
timer.exe Arc.exe a Nero_srep_64_lzma.arc -msrep:l64+lzma:1024m Nero-9.2.6.0_trial.tar -di -di+$#
timer.exe Arc.exe a Nero_rep_64_lzma.arc -mrep:1024m:64+lzma:1024m Nero-9.2.6.0_trial.tar -di -di+$#
timer.exe Arc.exe a Nero_srep_64_rep_64_lzma.arc -msrep:l64+rep:1024m:64+lzma:1024m Nero-9.2.6.0_trial.tar -di -di+$#
[/more]
[more=nero.log..]
timer.exe srep.exe Nero-9.2.6.0_trial.tar Nero_srep_512
Timer 3.01 Copyright (c) 2002-2003 Igor Pavlov 2003-07-10
138 mb used for hash
Compression ratio: 1974371328 -> 549576380: 27.84%. Cpu 20.032 mb/sec, real 17.784 mb/sec
Kernel Time = 4.671 = 00:00:04.671 = 4%
User Time = 98.593 = 00:01:38.593 = 88%
Process Time = 103.265 = 00:01:43.265 = 92%
Global Time = 111.235 = 00:01:51.235 = 100%
timer.exe srep.exe -d Nero_srep_512 Nero_srep_512_d
Timer 3.01 Copyright (c) 2002-2003 Igor Pavlov 2003-07-10
Compression ratio: 1974371328 -> 549576380: 27.84%. Cpu 175.744 mb/sec, real 37.858 mb/sec
Kernel Time = 7.984 = 00:00:07.984 = 15%
User Time = 11.265 = 00:00:11.265 = 21%
Process Time = 19.250 = 00:00:19.250 = 36%
Global Time = 52.390 = 00:00:52.390 = 100%
md5sum\md5sum.exe -c Nero-9.2.6.0_trial_srep_512.md5
Nero_srep_512_d: OK
IF ERRORLEVEL 1 (echo Nero_srep_512_d bad ) & (GOTO nodel1 )
del /F /Q Nero_srep_512_d
timer.exe Arc.exe a Nero_rep_512.arc -mrep:1024m Nero-9.2.6.0_trial.tar -di -di+$#
Timer 3.01 Copyright (c) 2002-2003 Igor Pavlov 2003-07-10
FreeArc 0.52 alpha (August 23a 2009) Creating archive: Nero_rep_512.arc using rep:1gb
Memory for compression 1280mb, decompression 1gb, cache 1mb
Started: 0.00 secs
Compressing 1 file of 1.974.371.328 bytes: 0.02 secs
Using rep:1gb
Memory for compression 1280mb, decompressi100.0%
Solid block compression results (32.078 seconds)
rep:1gb: 510.572.988 bytes in 32.078 seconds
Writing directory: 60.20 secs
Found 1 directory names: 60.23 secs
Directory written: 60.2
Compressed 1 file, 1.974.371.328 => 510.572.988 bytes. Ratio 25.8%
Compression time: cpu 45.48 secs, real 60.27 secs. Speed 32.761 kB/s
All OK
Kernel Time = 5.312 = 00:00:05.312 = 8%
User Time = 40.546 = 00:00:40.546 = 66%
Process Time = 45.859 = 00:00:45.859 = 75%
Global Time = 61.016 = 00:01:01.016 = 100%
timer.exe Arc.exe a Nero_srep_512_lzma.arc -msrep+lzma:1024m Nero-9.2.6.0_trial.tar -di -di+$#
Timer 3.01 Copyright (c) 2002-2003 Igor Pavlov 2003-07-10
FreeArc 0.52 alpha (August 23a 2009) Creating archive: Nero_srep_512_lzma.arc using srep+lzma:1gb:normal:32
Memory for compression 1792mb, decompression 1024mb, cache 1mb
Started: 0.00 secs
Compressing 1 file of 1.974.371.328 bytes: 0.02 secs
Using srep+lzma:1gb:normal:32
Memory for compression 1792mb, decompression 10.0%
Compressing 1.974.371.328 bytes with srep.exe $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
10.0%138 mb used for hash
Compression ratio: 1974371328 -> 549576380: 27.84%. Cpu 19.621 mb/sec, real 16.958 mb/sec
Errorlevel=0
99.9%
Solid block compression results (564.717 seconds)
srep: 549.576.381 bytes in 120.670 seconds
lzma:1gb:normal:32: 206.265.214 bytes in 444.047 seconds
Writing directory: 629.4100.0%
Found 1 directory names: 629.50 secs
Directory written: 629.5
Compressed 1 file, 1.974.371.328 => 206.265.214 bytes. Ratio 10.4%
Compression time: cpu 467.23 secs, real 629.53 secs. Speed 3.136 kB/s
All OK
Kernel Time = 9.937 = 00:00:09.937 = 1%
User Time = 457.671 = 00:07:37.671 = 72%
Process Time = 467.609 = 00:07:47.609 = 74%
Global Time = 630.391 = 00:10:30.391 = 100%
timer.exe Arc.exe a Nero_rep_512_lzma.arc -mrep:1024m+lzma:1024m Nero-9.2.6.0_trial.tar -di -di+$#
Timer 3.01 Copyright (c) 2002-2003 Igor Pavlov 2003-07-10
FreeArc 0.52 alpha (August 23a 2009) Creating archive: Nero_rep_512_lzma.arc using rep:1gb+tempfile+lzma:1gb:normal:32
Memory for compression 1792mb, decompression 1024mb, cache 1mb
Started: 0.00 secs
Compressing 1 file of 1.974.371.328 bytes: 0.02 secs
Using rep:1gb+tempfile+lzma:1gb:normal:32
Memory for compression 1792mb, decompression 99.9%
Solid block compression results (467.438 seconds)
rep:1gb: 510.572.988 bytes in 31.516 seconds
tempfile: 510.572.988 bytes in 1.063 seconds
lzma:1gb:normal:32: 205.510.000 bytes in 434.859 seconds
Writing directory: 499.63 secs
Found 1 directory names: 499.69 secs
Directory written: 499.7
Compressed 1 file, 1.974.371.328 => 205.510.000 bytes. Ratio 10.4%
Compression time: cpu 482.28 secs, real 499.72 secs. Speed 3.951 kB/s
All OK
Kernel Time = 6.718 = 00:00:06.718 = 1%
User Time = 475.953 = 00:07:55.953 = 95%
Process Time = 482.671 = 00:08:02.671 = 96%
Global Time = 500.453 = 00:08:20.453 = 100%
timer.exe Arc.exe a Nero_lzma.arc -mlzma:1024m Nero-9.2.6.0_trial.tar -di -di+$#
Timer 3.01 Copyright (c) 2002-2003 Igor Pavlov 2003-07-10
FreeArc 0.52 alpha (August 23a 2009) Creating archive: Nero_lzma.arc using lzma:1gb:normal:32
Memory for compression 1792mb, decompression 1024mb, cache 1mb
Started: 0.00 secs
Compressing 1 file of 1.974.371.328 bytes: 0.02 secs
Using lzma:1gb:normal:32
Memory for compression 1792mb, decompression 99.9%
Solid block compression results (644.094 seconds)
lzma:1gb:normal:32: 206.676.757 bytes in 644.094 seconds
Writing directory: 658.61 secs
Found 1 directory names: 658.61 secs
Directory written: 658.6
Compressed 1 file, 1.974.371.328 => 206.676.757 bytes. Ratio 10.4%
Compression time: cpu 225.28 secs, real 658.63 secs. Speed 2.998 kB/s
All OK
Kernel Time = 3.234 = 00:00:03.234 = 0%
User Time = 651.906 = 00:10:51.906 = 98%
Process Time = 655.140 = 00:10:55.140 = 99%
Global Time = 659.375 = 00:10:59.375 = 100%
timer.exe Arc.exe a Nero_srep_512_rep_512_lzma.arc -msrep+rep:1024m+lzma:1024m Nero-9.2.6.0_trial.tar -di -di+$#
Timer 3.01 Copyright (c) 2002-2003 Igor Pavlov 2003-07-10
FreeArc 0.52 alpha (August 23a 2009) Creating archive: Nero_srep_512_rep_512_lzma.arc using srep+rep:1gb+tempfile+lzma:1gb:normal:32
Memory for compression 1792mb, decompression 1024mb, cache 1mb
Started: 0.00 secs
Compressing 1 file of 1.974.371.328 bytes: 0.02 secs
Using srep+rep:1gb+tempfile+lzma:1gb:normal:32
Memory for compression 1792mb, decompression 10.0%
Compressing 1.974.371.328 bytes with srep.exe $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
10.0%138 mb used for hash
Compression ratio: 1974371328 -> 549576380: 27.84%. Cpu 19.645 mb/sec, real 17.048 mb/sec
Errorlevel=0
100.0%
Solid block compression results (573.296 seconds)
srep: 549.576.381 bytes in 120.062 seconds
rep:1gb: 540.834.752 bytes in 11.125 seconds
tempfile: 540.834.752 bytes in 1.031 seconds
lzma:1gb:normal:32: 206.603.674 bytes in 441.078 seconds
Writing directory: 641.34 secs
Found 1 directory names: 641.39 secs
Directory written: 641.4
Compressed 1 file, 1.974.371.328 => 206.603.674 bytes. Ratio 10.4%
Compression time: cpu 477.13 secs, real 641.42 secs. Speed 3.078 kB/s
All OK
Kernel Time = 11.562 = 00:00:11.562 = 1%
User Time = 465.921 = 00:07:45.921 = 72%
Process Time = 477.484 = 00:07:57.484 = 74%
Global Time = 641.859 = 00:10:41.859 = 100%
timer.exe srep.exe -l64 Nero-9.2.6.0_trial.tar Nero_srep_64
Timer 3.01 Copyright (c) 2002-2003 Igor Pavlov 2003-07-10
1101 mb used for hash
Compression ratio: 1974371328 -> 448006060: 22.69%. Cpu 12.125 mb/sec, real 11.138 mb/sec
Kernel Time = 4.812 = 00:00:04.812 = 2%
User Time = 162.859 = 00:02:42.859 = 91%
Process Time = 167.671 = 00:02:47.671 = 94%
Global Time = 177.625 = 00:02:57.625 = 100%
timer.exe srep.exe -d Nero_srep_64 Nero_srep_64_d
Timer 3.01 Copyright (c) 2002-2003 Igor Pavlov 2003-07-10
Compression ratio: 1974371328 -> 448006060: 22.69%. Cpu 178.980 mb/sec, real 39.686 mb/sec
Kernel Time = 9.796 = 00:00:09.796 = 19%
User Time = 11.046 = 00:00:11.046 = 22%
Process Time = 20.843 = 00:00:20.843 = 41%
Global Time = 49.969 = 00:00:49.969 = 100%
md5sum\md5sum.exe -c Nero-9.2.6.0_trial_srep_64.md5
Nero_srep_64_d: OK
IF ERRORLEVEL 1 (echo Nero_srep_64_d bad ) & (GOTO nodel2 )
del /F /Q Nero_srep_64_d
timer.exe Arc.exe a Nero_rep_64.arc -mrep:1024m:64 Nero-9.2.6.0_trial.tar -di -di+$#
Timer 3.01 Copyright (c) 2002-2003 Igor Pavlov 2003-07-10
FreeArc 0.52 alpha (August 23a 2009) Creating archive: Nero_rep_64.arc using rep:1gb:64
Memory for compression 1280mb, decompression 1gb, cache 1mb
Started: 0.00 secs
Compressing 1 file of 1.974.371.328 bytes: 0.02 secs
Using rep:1gb:64
Memory for compression 1280mb, decompressi 99.8%
Solid block compression results (49.297 seconds)
rep:1gb:64: 417.223.492 bytes in 49.297 seconds
Writing directory: 76.42 secs
Found 1 directory names: 76.44 secs
Directory written: 76.4
Compressed 1 file, 1.974.371.328 => 417.223.492 bytes. Ratio 21.1%
Compression time: cpu 62.63 secs, real 76.48 secs. Speed 25.814 kB/s
All OK
Kernel Time = 5.296 = 00:00:05.296 = 6%
User Time = 57.718 = 00:00:57.718 = 74%
Process Time = 63.015 = 00:01:03.015 = 81%
Global Time = 77.110 = 00:01:17.110 = 100%
timer.exe Arc.exe a Nero_srep_64_lzma.arc -msrep:l64+lzma:1024m Nero-9.2.6.0_trial.tar -di -di+$#
Timer 3.01 Copyright (c) 2002-2003 Igor Pavlov 2003-07-10
FreeArc 0.52 alpha (August 23a 2009) Creating archive: Nero_srep_64_lzma.arc using srep:l64+lzma:1gb:normal:32
Memory for compression 1792mb, decompression 1024mb, cache 1mb
Started: 0.00 secs
Compressing 1 file of 1.974.371.328 bytes: 0.02 secs
Using srep:l64+lzma:1gb:normal:32
Memory for compression 1792mb, decompression 10.0%
Compressing 1.974.371.328 bytes with srep.exe -l64 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
10.0%1101 mb used for hash
Compression ratio: 1974371328 -> 448006060: 22.69%. Cpu 11.932 mb/sec, real 10.841 10.0%
Errorlevel=0
99.9%
Solid block compression results (631.130 seconds)
srep:l64: 448.006.061 bytes in 186.380 seconds
lzma:1gb:normal:32: 208.076.180 bytes in 444.750 seconds
Writing directory: 694.84 secs
Found 1 directory names: 694.88 secs
Directory written: 694.8
Compressed 1 file, 1.974.371.328 => 208.076.180 bytes. Ratio 10.5%
Compression time: cpu 466.61 secs, real 694.89 secs. Speed 2.841 kB/s
All OK
Kernel Time = 9.015 = 00:00:09.015 = 1%
User Time = 457.890 = 00:07:37.890 = 65%
Process Time = 466.906 = 00:07:46.906 = 67%
Global Time = 695.407 = 00:11:35.407 = 100%
timer.exe Arc.exe a Nero_rep_64_lzma.arc -mrep:1024m:64+lzma:1024m Nero-9.2.6.0_trial.tar -di -di+$#
Timer 3.01 Copyright (c) 2002-2003 Igor Pavlov 2003-07-10
FreeArc 0.52 alpha (August 23a 2009) Creating archive: Nero_rep_64_lzma.arc using rep:1gb:64+tempfile+lzma:1gb:normal:32
Memory for compression 1792mb, decompression 1024mb, cache 1mb
Started: 0.00 secs
Compressing 1 file of 1.974.371.328 bytes: 0.02 secs
Using rep:1gb:64+tempfile+lzma:1gb:normal:32
Memory for compression 1792mb, decompression 100.0%
Solid block compression results (479.203 seconds)
rep:1gb:64: 417.223.492 bytes in 49.359 seconds
tempfile: 417.223.492 bytes in 0.500 seconds
lzma:1gb:normal:32: 207.625.910 bytes in 429.344 seconds
Writing directory: 508.03 secs
Found 1 directory names: 508.05 secs
Directory written: 508.0
Compressed 1 file, 1.974.371.328 => 207.625.910 bytes. Ratio 10.5%
Compression time: cpu 493.56 secs, real 508.08 secs. Speed 3.886 kB/s
All OK
Kernel Time = 6.531 = 00:00:06.531 = 1%
User Time = 487.406 = 00:08:07.406 = 95%
Process Time = 493.937 = 00:08:13.937 = 97%
Global Time = 508.687 = 00:08:28.687 = 100%
timer.exe Arc.exe a Nero_srep_64_rep_64_lzma.arc -msrep:l64+rep:1024m:64+lzma:1024m Nero-9.2.6.0_trial.tar -di -di+$#
Timer 3.01 Copyright (c) 2002-2003 Igor Pavlov 2003-07-10
FreeArc 0.52 alpha (August 23a 2009) Creating archive: Nero_srep_64_rep_64_lzma.arc using srep:l64+rep:1gb:64+tempfile+lzma:1gb:normal:32
Memory for compression 1792mb, decompression 1024mb, cache 1mb
Started: 0.00 secs
Compressing 1 file of 1.974.371.328 bytes: 0.02 secs
Using srep:l64+rep:1gb:64+tempfile+lzma:1gb:normal:32
Memory for compression 1792mb, decompression 10.0%
Compressing 1.974.371.328 bytes with srep.exe -l64 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
10.0%1101 mb used for hash
Compression ratio: 1974371328 -> 448006060: 22.69%. Cpu 11.892 mb/sec, real 10.891 mb/sec
Errorlevel=0
100.0%
Solid block compression results (649.427 seconds)
srep:l64: 448.006.061 bytes in 185.270 seconds
rep:1gb:64: 435.067.940 bytes in 20.047 seconds
tempfile: 435.067.940 bytes in 0.688 seconds
lzma:1gb:normal:32: 209.605.255 bytes in 443.422 seconds
Writing directory: 717.94 secs
Found 1 directory names: 717.95 secs
Directory written: 717.9
Compressed 1 file, 1.974.371.328 => 209.605.255 bytes. Ratio 10.6%
Compression time: cpu 487.19 secs, real 717.99 secs. Speed 2.750 kB/s
All OK
Kernel Time = 10.593 = 00:00:10.593 = 1%
User Time = 476.984 = 00:07:56.984 = 66%
Process Time = 487.578 = 00:08:07.578 = 67%
Global Time = 718.671 = 00:11:58.671 = 100%
[/more]
srep.exe Nero-9.2.6.0_trial.tar Nero_srep_512
524.1МБ Arc.exe a Nero_rep_512.arc -mrep:1024m Nero-9.2.6.0_trial.tar -di -di+$#
486.9МБ Arc.exe a Nero_srep_512_lzma.arc -msrep+lzma:1024m Nero-9.2.6.0_trial.tar -di -di+$#
196.7МБ Arc.exe a Nero_rep_512_lzma.arc -mrep:1024m+lzma:1024m Nero-9.2.6.0_trial.tar -di -di+$#
195.9МБ Arc.exe a Nero_srep_512_rep_512_lzma.arc -msrep+rep:1024m+lzma:1024m Nero-9.2.6.0_trial.tar -di -di+$#
197МБ Arc.exe a Nero_lzma.arc -mlzma:1024m Nero-9.2.6.0_trial.tar -di -di+$#
197.1МБ srep.exe -l64 Nero-9.2.6.0_trial.tar Nero_srep_64
427.2МБ Arc.exe a Nero_rep_64.arc -mrep:1024m:64 Nero-9.2.6.0_trial.tar -di -di+$#
397.8МБ Arc.exe a Nero_srep_64_lzma.arc -msrep:l64+lzma:1024m Nero-9.2.6.0_trial.tar -di -di+$#
198.4МБ Arc.exe a Nero_rep_64_lzma.arc -mrep:1024m:64+lzma:1024m Nero-9.2.6.0_trial.tar -di -di+$#
198МБ Arc.exe a Nero_srep_64_rep_64_lzma.arc -msrep:l64+rep:1024m:64+lzma:1024m Nero-9.2.6.0_trial.tar -di -di+$#
199.8МБ Arc.exe a Nero_lzma.arc -mlzma:1024m Nero-9.2.6.0_trial.tar -di -di+$#
197.1МБ srep vs rep: Дожатие srep принципиально хуже не становится.
Цитата: можно сказать, что разработка SREP закончена
на базе SREP можете сделать программку делающие diff двух файлов, наподобии xdelta?
Цитата: да, для ускорения работы добавлен ещё один массив в 1мб
filesize*20/L + 2*округлённое_вверх(filesize*8/L * 4/3)*1\2 +1 ?
ICESCREAM Цитата: А чем "@for %%i in (*.*) do @ srep бла-бла-бла" не устраивает?
и чего на выходе будет?
Добавлено: Цитата: статистика по Nero-9.2.6.0_trial.tar ниже
там затарина с сортировкой тип Размер
сегодняшний Nero-9.2.6.0_trial.tar без сортировки, как есть.
Добавлено: md5sum был этот
http://downloads.activestate.com/contrib/md5sum/Windows/md5sum.exe
так что если не будет работать, то вспоминай под какой ОС упаковал (xp/vista/linux). ну и разумеется избавься от этого архива, перепакуй или новой версией или с более высоким сжатием (ошибка была только в режиме -m1) 
). 
