To synthesize a load on the volume, use a tool such as Diskspd Utility. Connect to one of the cluster nodes with RDP and run the following with the Diskspd tool.
Test the data disk (GP2 Striping)
diskspd.exe -d60 -b4k -o1024 -t32 -L -Sh -r -w50 -W60 -c500G D:\test.dat
Test the Local NVMe
diskspd.exe -d60 -b4k -o1024 -t32 -L -Sh -r -w50 -W60 -c100G E:\test.dat
Example of output:
c:\Scripts\DiskSpd-2.0.21a\amd64>diskspd.exe -d60 -b4k -o1024 -t32 -L -Sh -r -w50 -W60 -c500G D:\test.dat
Command Line: diskspd.exe -d60 -b4k -o1024 -t32 -L -Sh -r -w50 -W60 -c500G D:\test.dat
Input parameters:
timespan: 1
-------------
duration: 60s
warm up time: 60s
cool down time: 0s
measuring latency
random seed: 0
path: 'D:\test.dat'
think time: 0ms
burst size: 0
software cache disabled
hardware write cache disabled, writethrough on
performing mix test (read/write ratio: 50/50)
block size: 4096
using random I/O (alignment: 4096)
number of outstanding I/O operations: 1024
thread stride size: 0
threads per file: 32
using I/O Completion Ports
IO priority: normal
System information:
computer name: EC2AMAZ-H3DM3EE
start time: 2019/04/08 14:53:16 UTC
Results for timespan 1:
*******************************************************************************
actual test time: 60.00s
thread count: 32
proc count: 4
CPU | Usage | User | Kernel | Idle
-------------------------------------------
0| 38.36%| 2.21%| 36.15%| 61.64%
1| 54.04%| 1.12%| 52.92%| 45.96%
2| 41.95%| 1.38%| 40.57%| 58.05%
3| 36.02%| 1.51%| 34.51%| 63.98%
-------------------------------------------
avg.| 42.59%| 1.56%| 41.04%| 57.41%
Total IO
thread | bytes | I/Os | MiB/s | I/O per s | AvgLat | LatStdDev | file
-----------------------------------------------------------------------------------------------------
0 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | D:\test.dat (500GiB)
1 | 77770752 | 18987 | 1.24 | 316.44 | 3138.533 | 1509.035 | D:\test.dat (500GiB)
2 | 95064064 | 23209 | 1.51 | 386.81 | 2550.313 | 2592.821 | D:\test.dat (500GiB)
3 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | D:\test.dat (500GiB)
4 | 71000064 | 17334 | 1.13 | 288.89 | 2767.587 | 3122.125 | D:\test.dat (500GiB)
5 | 84221952 | 20562 | 1.34 | 342.69 | 2844.420 | 1544.956 | D:\test.dat (500GiB)
6 | 70438912 | 17197 | 1.12 | 286.61 | 2844.255 | 3104.606 | D:\test.dat (500GiB)
7 | 82124800 | 20050 | 1.31 | 334.16 | 2753.855 | 2923.171 | D:\test.dat (500GiB)
8 | 80633856 | 19686 | 1.28 | 328.09 | 2569.018 | 2781.349 | D:\test.dat (500GiB)
9 | 90222592 | 22027 | 1.43 | 367.11 | 2799.517 | 1287.278 | D:\test.dat (500GiB)
10 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | D:\test.dat (500GiB)
11 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | D:\test.dat (500GiB)
12 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | D:\test.dat (500GiB)
13 | 90079232 | 21992 | 1.43 | 366.53 | 2815.712 | 1344.054 | D:\test.dat (500GiB)
14 | 76996608 | 18798 | 1.22 | 313.29 | 3176.342 | 1673.012 | D:\test.dat (500GiB)
15 | 90746880 | 22155 | 1.44 | 369.24 | 2795.094 | 1275.337 | D:\test.dat (500GiB)
16 | 94154752 | 22987 | 1.50 | 383.11 | 2730.676 | 1216.094 | D:\test.dat (500GiB)
17 | 79065088 | 19303 | 1.26 | 321.71 | 3369.441 | 1939.716 | D:\test.dat (500GiB)
18 | 92729344 | 22639 | 1.47 | 377.31 | 2687.653 | 1244.982 | D:\test.dat (500GiB)
19 | 80265216 | 19596 | 1.28 | 326.59 | 3116.637 | 1660.408 | D:\test.dat (500GiB)
20 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | D:\test.dat (500GiB)
21 | 96694272 | 23607 | 1.54 | 393.44 | 2651.571 | 1199.831 | D:\test.dat (500GiB)
22 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | D:\test.dat (500GiB)
23 | 91766784 | 22404 | 1.46 | 373.39 | 2722.170 | 1163.358 | D:\test.dat (500GiB)
24 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | D:\test.dat (500GiB)
25 | 73678848 | 17988 | 1.17 | 299.79 | 3434.341 | 1975.955 | D:\test.dat (500GiB)
26 | 89051136 | 21741 | 1.42 | 362.34 | 2748.422 | 1569.522 | D:\test.dat (500GiB)
27 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | D:\test.dat (500GiB)
28 | 90279936 | 22041 | 1.43 | 367.34 | 2597.673 | 1132.313 | D:\test.dat (500GiB)
29 | 95465472 | 23307 | 1.52 | 388.44 | 2631.771 | 1170.411 | D:\test.dat (500GiB)
30 | 72388608 | 17673 | 1.15 | 294.54 | 3418.554 | 1843.126 | D:\test.dat (500GiB)
31 | 91201536 | 22266 | 1.45 | 371.09 | 2724.442 | 1303.560 | D:\test.dat (500GiB)
-----------------------------------------------------------------------------------------------------
total: 1956040704 | 477549 | 31.09 | 7959.00 | 2847.207 | 1855.919
Read IO
thread | bytes | I/Os | MiB/s | I/O per s | AvgLat | LatStdDev | file
-----------------------------------------------------------------------------------------------------
0 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | D:\test.dat (500GiB)
1 | 39145472 | 9557 | 0.62 | 159.28 | 2871.748 | 1516.298 | D:\test.dat (500GiB)
2 | 47472640 | 11590 | 0.75 | 193.16 | 2307.922 | 2602.683 | D:\test.dat (500GiB)
3 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | D:\test.dat (500GiB)
4 | 34742272 | 8482 | 0.55 | 141.36 | 2493.940 | 2769.890 | D:\test.dat (500GiB)
5 | 42520576 | 10381 | 0.68 | 173.01 | 2544.343 | 1511.534 | D:\test.dat (500GiB)
6 | 35561472 | 8682 | 0.57 | 144.70 | 2555.819 | 2432.432 | D:\test.dat (500GiB)
7 | 41844736 | 10216 | 0.67 | 170.26 | 2486.031 | 2552.151 | D:\test.dat (500GiB)
8 | 40394752 | 9862 | 0.64 | 164.36 | 2271.303 | 2092.351 | D:\test.dat (500GiB)
9 | 45334528 | 11068 | 0.72 | 184.46 | 2544.296 | 1291.025 | D:\test.dat (500GiB)
10 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | D:\test.dat (500GiB)
11 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | D:\test.dat (500GiB)
12 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | D:\test.dat (500GiB)
13 | 45346816 | 11071 | 0.72 | 184.51 | 2538.966 | 1329.416 | D:\test.dat (500GiB)
14 | 38723584 | 9454 | 0.62 | 157.56 | 2889.435 | 1663.023 | D:\test.dat (500GiB)
15 | 45531136 | 11116 | 0.72 | 185.26 | 2549.080 | 1295.560 | D:\test.dat (500GiB)
16 | 47632384 | 11629 | 0.76 | 193.81 | 2463.294 | 1234.624 | D:\test.dat (500GiB)
17 | 39710720 | 9695 | 0.63 | 161.58 | 3086.691 | 1914.526 | D:\test.dat (500GiB)
18 | 46276608 | 11298 | 0.74 | 188.30 | 2436.858 | 1275.567 | D:\test.dat (500GiB)
19 | 40034304 | 9774 | 0.64 | 162.90 | 2847.241 | 1632.768 | D:\test.dat (500GiB)
20 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | D:\test.dat (500GiB)
21 | 48128000 | 11750 | 0.76 | 195.83 | 2391.629 | 1215.488 | D:\test.dat (500GiB)
22 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | D:\test.dat (500GiB)
23 | 45686784 | 11154 | 0.73 | 185.90 | 2474.939 | 1198.863 | D:\test.dat (500GiB)
24 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | D:\test.dat (500GiB)
25 | 37085184 | 9054 | 0.59 | 150.90 | 3115.358 | 1955.256 | D:\test.dat (500GiB)
26 | 44638208 | 10898 | 0.71 | 181.63 | 2486.438 | 1530.183 | D:\test.dat (500GiB)
27 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | D:\test.dat (500GiB)
28 | 45453312 | 11097 | 0.72 | 184.95 | 2380.755 | 1152.055 | D:\test.dat (500GiB)
29 | 47804416 | 11671 | 0.76 | 194.51 | 2385.113 | 1186.002 | D:\test.dat (500GiB)
30 | 35885056 | 8761 | 0.57 | 146.01 | 3120.600 | 1825.128 | D:\test.dat (500GiB)
31 | 45146112 | 11022 | 0.72 | 183.70 | 2464.019 | 1312.318 | D:\test.dat (500GiB)
-----------------------------------------------------------------------------------------------------
total: 980099072 | 239282 | 15.58 | 3987.96 | 2580.072 | 1732.051
Write IO
thread | bytes | I/Os | MiB/s | I/O per s | AvgLat | LatStdDev | file
-----------------------------------------------------------------------------------------------------
0 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | D:\test.dat (500GiB)
1 | 38625280 | 9430 | 0.61 | 157.16 | 3408.911 | 1452.475 | D:\test.dat (500GiB)
2 | 47591424 | 11619 | 0.76 | 193.65 | 2792.098 | 2560.184 | D:\test.dat (500GiB)
3 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | D:\test.dat (500GiB)
4 | 36257792 | 8852 | 0.58 | 147.53 | 3029.797 | 3405.259 | D:\test.dat (500GiB)
5 | 41701376 | 10181 | 0.66 | 169.68 | 3150.392 | 1518.425 | D:\test.dat (500GiB)
6 | 34877440 | 8515 | 0.55 | 141.91 | 3138.348 | 3641.717 | D:\test.dat (500GiB)
7 | 40280064 | 9834 | 0.64 | 163.90 | 3032.082 | 3240.889 | D:\test.dat (500GiB)
8 | 40239104 | 9824 | 0.64 | 163.73 | 2867.885 | 3305.838 | D:\test.dat (500GiB)
9 | 44888064 | 10959 | 0.71 | 182.65 | 3057.277 | 1230.895 | D:\test.dat (500GiB)
10 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | D:\test.dat (500GiB)
11 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | D:\test.dat (500GiB)
12 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | D:\test.dat (500GiB)
13 | 44732416 | 10921 | 0.71 | 182.01 | 3096.259 | 1299.925 | D:\test.dat (500GiB)
14 | 38273024 | 9344 | 0.61 | 155.73 | 3466.626 | 1632.525 | D:\test.dat (500GiB)
15 | 45215744 | 11039 | 0.72 | 183.98 | 3042.823 | 1204.914 | D:\test.dat (500GiB)
16 | 46522368 | 11358 | 0.74 | 189.30 | 3004.438 | 1133.245 | D:\test.dat (500GiB)
17 | 39354368 | 9608 | 0.63 | 160.13 | 3654.752 | 1923.120 | D:\test.dat (500GiB)
18 | 46452736 | 11341 | 0.74 | 189.01 | 2937.497 | 1161.076 | D:\test.dat (500GiB)
19 | 40230912 | 9822 | 0.64 | 163.70 | 3384.716 | 1644.216 | D:\test.dat (500GiB)
20 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | D:\test.dat (500GiB)
21 | 48566272 | 11857 | 0.77 | 197.61 | 2909.167 | 1126.411 | D:\test.dat (500GiB)
22 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | D:\test.dat (500GiB)
23 | 46080000 | 11250 | 0.73 | 187.50 | 2967.291 | 1072.175 | D:\test.dat (500GiB)
24 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | D:\test.dat (500GiB)
25 | 36593664 | 8934 | 0.58 | 148.90 | 3757.608 | 1944.027 | D:\test.dat (500GiB)
26 | 44412928 | 10843 | 0.71 | 180.71 | 3011.736 | 1564.493 | D:\test.dat (500GiB)
27 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | D:\test.dat (500GiB)
28 | 44826624 | 10944 | 0.71 | 182.40 | 2817.623 | 1067.856 | D:\test.dat (500GiB)
29 | 47661056 | 11636 | 0.76 | 193.93 | 2879.170 | 1100.355 | D:\test.dat (500GiB)
30 | 36503552 | 8912 | 0.58 | 148.53 | 3711.460 | 1813.546 | D:\test.dat (500GiB)
31 | 46055424 | 11244 | 0.73 | 187.40 | 2979.724 | 1243.045 | D:\test.dat (500GiB)
-----------------------------------------------------------------------------------------------------
total: 975941632 | 238267 | 15.51 | 3971.04 | 3115.481 | 1935.749
total:
%-ile | Read (ms) | Write (ms) | Total (ms)
----------------------------------------------
min | 190.492 | 1148.384 | 190.492
25th | 1605.550 | 2042.601 | 1764.053
50th | 2311.111 | 2792.113 | 2655.259
75th | 3205.614 | 3732.070 | 3487.849
90th | 4448.723 | 4950.397 | 4756.247
95th | 5233.421 | 5756.939 | 5500.298
99th | 7471.308 | 7909.274 | 7660.843
3-nines | 9238.294 | 9793.850 | 9459.589
4-nines | 72793.625 | 95617.195 | 86836.273
5-nines | 114287.914 | 116674.461 | 114787.047
6-nines | 114842.016 | 118962.094 | 118962.094
7-nines | 114842.016 | 118962.094 | 118962.094
8-nines | 114842.016 | 118962.094 | 118962.094
9-nines | 114842.016 | 118962.094 | 118962.094
max | 114842.016 | 118962.094 | 118962.094
c:\Scripts\DiskSpd-2.0.21a\amd64>diskspd.exe -d60 -b4k -o1024 -t32 -L -Sh -r -w50 -W60 -c100G E:\test.dat
Command Line: diskspd.exe -d60 -b4k -o1024 -t32 -L -Sh -r -w50 -W60 -c100G E:\test.dat
Input parameters:
timespan: 1
-------------
duration: 60s
warm up time: 60s
cool down time: 0s
measuring latency
random seed: 0
path: 'E:\test.dat'
think time: 0ms
burst size: 0
software cache disabled
hardware write cache disabled, writethrough on
performing mix test (read/write ratio: 50/50)
block size: 4096
using random I/O (alignment: 4096)
number of outstanding I/O operations: 1024
thread stride size: 0
threads per file: 32
using I/O Completion Ports
IO priority: normal
System information:
computer name: EC2AMAZ-H3DM3EE
start time: 2019/04/08 14:56:11 UTC
Results for timespan 1:
*******************************************************************************
actual test time: 60.00s
thread count: 32
proc count: 4
CPU | Usage | User | Kernel | Idle
-------------------------------------------
0| 100.00%| 5.60%| 94.40%| 0.00%
1| 100.00%| 3.96%| 96.04%| 0.00%
2| 100.00%| 3.83%| 96.17%| 0.00%
3| 100.00%| 3.41%| 96.59%| 0.00%
-------------------------------------------
avg.| 100.00%| 4.20%| 95.80%| 0.00%
Total IO
thread | bytes | I/Os | MiB/s | I/O per s | AvgLat | LatStdDev | file
-----------------------------------------------------------------------------------------------------
0 | 357847040 | 87365 | 5.69 | 1456.07 | 692.801 | 582.861 | E:\test.dat (100GiB)
1 | 429191168 | 104783 | 6.82 | 1746.37 | 588.245 | 433.532 | E:\test.dat (100GiB)
2 | 552165376 | 134806 | 8.78 | 2246.75 | 461.406 | 406.747 | E:\test.dat (100GiB)
3 | 553738240 | 135190 | 8.80 | 2253.15 | 447.064 | 357.468 | E:\test.dat (100GiB)
4 | 304295936 | 74291 | 4.84 | 1238.17 | 817.447 | 659.615 | E:\test.dat (100GiB)
5 | 471232512 | 115047 | 7.49 | 1917.43 | 534.547 | 468.967 | E:\test.dat (100GiB)
6 | 459587584 | 112204 | 7.30 | 1870.05 | 552.352 | 461.598 | E:\test.dat (100GiB)
7 | 465432576 | 113631 | 7.40 | 1893.83 | 540.667 | 444.176 | E:\test.dat (100GiB)
8 | 343990272 | 83982 | 5.47 | 1399.69 | 728.308 | 656.675 | E:\test.dat (100GiB)
9 | 483721216 | 118096 | 7.69 | 1968.25 | 516.776 | 431.475 | E:\test.dat (100GiB)
10 | 485789696 | 118601 | 7.72 | 1976.66 | 515.055 | 411.910 | E:\test.dat (100GiB)
11 | 439861248 | 107388 | 6.99 | 1789.78 | 574.270 | 410.608 | E:\test.dat (100GiB)
12 | 343695360 | 83910 | 5.46 | 1398.49 | 740.699 | 708.637 | E:\test.dat (100GiB)
13 | 392949760 | 95935 | 6.25 | 1598.90 | 636.726 | 471.561 | E:\test.dat (100GiB)
14 | 454242304 | 110899 | 7.22 | 1848.30 | 551.699 | 440.274 | E:\test.dat (100GiB)
15 | 544976896 | 133051 | 8.66 | 2217.50 | 468.379 | 384.267 | E:\test.dat (100GiB)
16 | 318631936 | 77791 | 5.06 | 1296.50 | 791.512 | 645.581 | E:\test.dat (100GiB)
17 | 457535488 | 111703 | 7.27 | 1861.70 | 545.411 | 457.880 | E:\test.dat (100GiB)
18 | 499122176 | 121856 | 7.93 | 2030.91 | 512.318 | 407.594 | E:\test.dat (100GiB)
19 | 514727936 | 125666 | 8.18 | 2094.41 | 491.173 | 433.459 | E:\test.dat (100GiB)
20 | 349941760 | 85435 | 5.56 | 1423.90 | 722.302 | 610.912 | E:\test.dat (100GiB)
21 | 442064896 | 107926 | 7.03 | 1798.75 | 565.278 | 508.831 | E:\test.dat (100GiB)
22 | 476717056 | 116386 | 7.58 | 1939.75 | 529.442 | 452.575 | E:\test.dat (100GiB)
23 | 547028992 | 133552 | 8.69 | 2225.85 | 455.279 | 373.624 | E:\test.dat (100GiB)
24 | 359505920 | 87770 | 5.71 | 1462.82 | 685.194 | 563.236 | E:\test.dat (100GiB)
25 | 408272896 | 99676 | 6.49 | 1661.25 | 616.206 | 553.827 | E:\test.dat (100GiB)
26 | 543903744 | 132789 | 8.65 | 2213.13 | 457.790 | 388.385 | E:\test.dat (100GiB)
27 | 484175872 | 118207 | 7.70 | 1970.10 | 518.580 | 439.527 | E:\test.dat (100GiB)
28 | 295219200 | 72075 | 4.69 | 1201.24 | 849.809 | 665.632 | E:\test.dat (100GiB)
29 | 425418752 | 103862 | 6.76 | 1731.02 | 593.248 | 475.191 | E:\test.dat (100GiB)
30 | 521732096 | 127376 | 8.29 | 2122.91 | 483.042 | 390.188 | E:\test.dat (100GiB)
31 | 534482944 | 130489 | 8.50 | 2174.80 | 472.403 | 381.151 | E:\test.dat (100GiB)
-----------------------------------------------------------------------------------------------------
total: 14261198848 | 3481738 | 226.67 | 58028.42 | 563.973 | 487.663
Read IO
thread | bytes | I/Os | MiB/s | I/O per s | AvgLat | LatStdDev | file
-----------------------------------------------------------------------------------------------------
0 | 178257920 | 43520 | 2.83 | 725.33 | 674.671 | 576.413 | E:\test.dat (100GiB)
1 | 213831680 | 52205 | 3.40 | 870.08 | 572.234 | 428.339 | E:\test.dat (100GiB)
2 | 277045248 | 67638 | 4.40 | 1127.29 | 447.416 | 401.138 | E:\test.dat (100GiB)
3 | 277446656 | 67736 | 4.41 | 1128.92 | 432.094 | 350.891 | E:\test.dat (100GiB)
4 | 152088576 | 37131 | 2.42 | 618.84 | 793.622 | 649.998 | E:\test.dat (100GiB)
5 | 236531712 | 57747 | 3.76 | 962.44 | 518.675 | 461.725 | E:\test.dat (100GiB)
6 | 229703680 | 56080 | 3.65 | 934.66 | 534.262 | 455.289 | E:\test.dat (100GiB)
7 | 231813120 | 56595 | 3.68 | 943.24 | 521.611 | 434.533 | E:\test.dat (100GiB)
8 | 172265472 | 42057 | 2.74 | 700.94 | 712.924 | 649.119 | E:\test.dat (100GiB)
9 | 241836032 | 59042 | 3.84 | 984.02 | 502.309 | 424.834 | E:\test.dat (100GiB)
10 | 241594368 | 58983 | 3.84 | 983.04 | 496.556 | 404.403 | E:\test.dat (100GiB)
11 | 220303360 | 53785 | 3.50 | 896.41 | 557.535 | 404.358 | E:\test.dat (100GiB)
12 | 172908544 | 42214 | 2.75 | 703.56 | 724.640 | 706.080 | E:\test.dat (100GiB)
13 | 195837952 | 47812 | 3.11 | 796.86 | 619.383 | 465.924 | E:\test.dat (100GiB)
14 | 227352576 | 55506 | 3.61 | 925.09 | 535.020 | 434.752 | E:\test.dat (100GiB)
15 | 271437824 | 66269 | 4.31 | 1104.47 | 453.574 | 378.724 | E:\test.dat (100GiB)
16 | 158654464 | 38734 | 2.52 | 645.56 | 773.357 | 637.683 | E:\test.dat (100GiB)
17 | 229961728 | 56143 | 3.66 | 935.71 | 529.436 | 450.417 | E:\test.dat (100GiB)
18 | 250658816 | 61196 | 3.98 | 1019.92 | 496.472 | 403.316 | E:\test.dat (100GiB)
19 | 257912832 | 62967 | 4.10 | 1049.44 | 475.431 | 426.839 | E:\test.dat (100GiB)
20 | 174952448 | 42713 | 2.78 | 711.88 | 705.718 | 604.459 | E:\test.dat (100GiB)
21 | 221462528 | 54068 | 3.52 | 901.12 | 548.896 | 496.545 | E:\test.dat (100GiB)
22 | 237711360 | 58035 | 3.78 | 967.24 | 513.153 | 445.868 | E:\test.dat (100GiB)
23 | 273747968 | 66833 | 4.35 | 1113.87 | 440.897 | 368.835 | E:\test.dat (100GiB)
24 | 179834880 | 43905 | 2.86 | 731.74 | 668.983 | 556.583 | E:\test.dat (100GiB)
25 | 204980224 | 50044 | 3.26 | 834.06 | 597.970 | 547.431 | E:\test.dat (100GiB)
26 | 270725120 | 66095 | 4.30 | 1101.57 | 443.897 | 381.977 | E:\test.dat (100GiB)
27 | 242339840 | 59165 | 3.85 | 986.07 | 502.521 | 432.494 | E:\test.dat (100GiB)
28 | 148017152 | 36137 | 2.35 | 602.28 | 831.509 | 659.462 | E:\test.dat (100GiB)
29 | 212484096 | 51876 | 3.38 | 864.59 | 576.801 | 470.917 | E:\test.dat (100GiB)
30 | 260964352 | 63712 | 4.15 | 1061.86 | 468.516 | 384.378 | E:\test.dat (100GiB)
31 | 266899456 | 65161 | 4.24 | 1086.01 | 456.947 | 374.386 | E:\test.dat (100GiB)
-----------------------------------------------------------------------------------------------------
total: 7131561984 | 1741104 | 113.35 | 29018.13 | 547.682 | 481.193
Write IO
thread | bytes | I/Os | MiB/s | I/O per s | AvgLat | LatStdDev | file
-----------------------------------------------------------------------------------------------------
0 | 179589120 | 43845 | 2.85 | 730.74 | 710.796 | 588.640 | E:\test.dat (100GiB)
1 | 215359488 | 52578 | 3.42 | 876.29 | 604.142 | 438.048 | E:\test.dat (100GiB)
2 | 275120128 | 67168 | 4.37 | 1119.46 | 475.494 | 411.839 | E:\test.dat (100GiB)
3 | 276291584 | 67454 | 4.39 | 1124.22 | 462.096 | 363.334 | E:\test.dat (100GiB)
4 | 152207360 | 37160 | 2.42 | 619.33 | 841.253 | 668.238 | E:\test.dat (100GiB)
5 | 234700800 | 57300 | 3.73 | 954.99 | 550.543 | 475.618 | E:\test.dat (100GiB)
6 | 229883904 | 56124 | 3.65 | 935.39 | 570.427 | 467.118 | E:\test.dat (100GiB)
7 | 233619456 | 57036 | 3.71 | 950.59 | 559.574 | 452.750 | E:\test.dat (100GiB)
8 | 171724800 | 41925 | 2.73 | 698.74 | 743.740 | 663.811 | E:\test.dat (100GiB)
9 | 241885184 | 59054 | 3.84 | 984.22 | 531.240 | 437.536 | E:\test.dat (100GiB)
10 | 244195328 | 59618 | 3.88 | 993.62 | 533.356 | 418.401 | E:\test.dat (100GiB)
11 | 219557888 | 53603 | 3.49 | 893.37 | 591.061 | 416.109 | E:\test.dat (100GiB)
12 | 170786816 | 41696 | 2.71 | 694.93 | 756.957 | 710.847 | E:\test.dat (100GiB)
13 | 197111808 | 48123 | 3.13 | 802.04 | 653.957 | 476.471 | E:\test.dat (100GiB)
14 | 226889728 | 55393 | 3.61 | 923.21 | 568.412 | 445.112 | E:\test.dat (100GiB)
15 | 273539072 | 66782 | 4.35 | 1113.02 | 483.071 | 389.133 | E:\test.dat (100GiB)
16 | 159977472 | 39057 | 2.54 | 650.94 | 809.517 | 652.822 | E:\test.dat (100GiB)
17 | 227573760 | 55560 | 3.62 | 925.99 | 561.554 | 464.741 | E:\test.dat (100GiB)
18 | 248463360 | 60660 | 3.95 | 1010.99 | 528.304 | 411.247 | E:\test.dat (100GiB)
19 | 256815104 | 62699 | 4.08 | 1044.97 | 506.982 | 439.441 | E:\test.dat (100GiB)
20 | 174989312 | 42722 | 2.78 | 712.03 | 738.882 | 616.851 | E:\test.dat (100GiB)
21 | 220602368 | 53858 | 3.51 | 897.62 | 581.724 | 520.355 | E:\test.dat (100GiB)
22 | 239005696 | 58351 | 3.80 | 972.51 | 545.642 | 458.575 | E:\test.dat (100GiB)
23 | 273281024 | 66719 | 4.34 | 1111.97 | 469.686 | 377.813 | E:\test.dat (100GiB)
24 | 179671040 | 43865 | 2.86 | 731.08 | 701.421 | 569.356 | E:\test.dat (100GiB)
25 | 203292672 | 49632 | 3.23 | 827.19 | 634.593 | 559.600 | E:\test.dat (100GiB)
26 | 273178624 | 66694 | 4.34 | 1111.56 | 471.559 | 394.149 | E:\test.dat (100GiB)
27 | 241836032 | 59042 | 3.84 | 984.02 | 534.673 | 445.883 | E:\test.dat (100GiB)
28 | 147202048 | 35938 | 2.34 | 598.96 | 868.211 | 671.275 | E:\test.dat (100GiB)
29 | 212934656 | 51986 | 3.38 | 866.43 | 609.660 | 478.855 | E:\test.dat (100GiB)
30 | 260767744 | 63664 | 4.14 | 1061.06 | 497.579 | 395.384 | E:\test.dat (100GiB)
31 | 267583488 | 65328 | 4.25 | 1088.79 | 487.820 | 387.166 | E:\test.dat (100GiB)
-----------------------------------------------------------------------------------------------------
total: 7129636864 | 1740634 | 113.32 | 29010.29 | 580.269 | 493.512
total:
%-ile | Read (ms) | Write (ms) | Total (ms)
----------------------------------------------
min | 20.708 | 20.722 | 20.708
25th | 85.144 | 93.021 | 88.925
50th | 456.959 | 485.494 | 472.409
75th | 812.087 | 848.067 | 830.342
90th | 1195.462 | 1246.133 | 1224.244
95th | 1477.615 | 1541.381 | 1510.270
99th | 2044.864 | 2098.635 | 2070.104
3-nines | 3039.979 | 3152.734 | 3103.595
4-nines | 3720.243 | 3725.120 | 3723.636
5-nines | 4026.207 | 4031.479 | 4030.117
6-nines | 4028.080 | 4032.067 | 4031.853
7-nines | 4028.554 | 4033.588 | 4033.588
8-nines | 4028.554 | 4033.588 | 4033.588
9-nines | 4028.554 | 4033.588 | 4033.588
max | 4028.554 | 4033.588 | 4033.588