Donnerstag, 23. Februar 2017

Smartctl info for nvme

nvme smart-log /dev/nvme0
Smart Log for NVME device:nvme0 namespace-id:ffffffff
critical_warning                    : 0
temperature                         : 26 C
available_spare                     : 100%
available_spare_threshold           : 10%
percentage_used                     : 0%
data_units_read                     : 174,995
data_units_written                  : 283,289
host_read_commands                  : 2,327,186
host_write_commands                 : 842,433
controller_busy_time                : 2
power_cycles                        : 2
power_on_hours                      : 2
unsafe_shutdowns                    : 0
media_errors                        : 0
num_err_log_entries                 : 0
Warning Temperature Time            : 0
Critical Composite Temperature Time : 0
Temperature Sensor 1                : 26 C
Temperature Sensor 2                : 47 C
Temperature Sensor 3                : 0 C
Temperature Sensor 4                : 0 C
Temperature Sensor 5                : 0 C
Temperature Sensor 6                : 0 C
Temperature Sensor 7                : 0 C
Temperature Sensor 8                : 0 C

Mittwoch, 22. Februar 2017

SSD Samsung 850 EVO 256GB performance

Empty, new SSD with CrystalDiskMark 3.0.2.




Donnerstag, 9. Februar 2017

Windows 7: PCI-e SSD vs striped WD 10K disks vs striped SSD


Intel PCI-E SSD P3600
-----------------------------------------------------------------------
CrystalDiskMark 3.0.1 x64 (C) 2007-2010 hiyohiyo
                           Crystal Dew World : http://crystalmark.info/
-----------------------------------------------------------------------
* MB/s = 1,000,000 byte/s [SATA/300 = 300,000,000 byte/s]

           Sequential Read :  1318.342 MB/s
          Sequential Write :  1215.438 MB/s
         Random Read 512KB :  1021.725 MB/s
        Random Write 512KB :  1231.051 MB/s
    Random Read 4KB (QD=1) :    37.135 MB/s [  9066.1 IOPS]
   Random Write 4KB (QD=1) :   297.593 MB/s [ 72654.6 IOPS]
   Random Read 4KB (QD=32) :   679.819 MB/s [165971.4 IOPS]
  Random Write 4KB (QD=32) :   525.391 MB/s [128269.4 IOPS]

  Test : 1000 MB [P: 0.0% (0.1/1117.8 GB)] (x5)
  Date : 2017/02/09 18:19:36
    OS : Windows 7 Ultimate Edition SP1 [6.1 Build 7601] (x64)
 
 Striped 2x Crusial SSD disks
 

 -----------------------------------------------------------------------
CrystalDiskMark 3.0.1 x64 (C) 2007-2010 hiyohiyo
                           Crystal Dew World : http://crystalmark.info/
-----------------------------------------------------------------------
* MB/s = 1,000,000 byte/s [SATA/300 = 300,000,000 byte/s]

           Sequential Read :   706.492 MB/s
          Sequential Write :   374.625 MB/s
         Random Read 512KB :   657.431 MB/s
        Random Write 512KB :   146.501 MB/s
    Random Read 4KB (QD=1) :    25.487 MB/s [  6222.4 IOPS]
   Random Write 4KB (QD=1) :    66.833 MB/s [ 16316.8 IOPS]
   Random Read 4KB (QD=32) :   405.031 MB/s [ 98884.4 IOPS]
  Random Write 4KB (QD=32) :   209.108 MB/s [ 51051.7 IOPS]

  Test : 1000 MB [C: 93.5% (211.7/226.5 GB)] (x5)
  Date : 2017/02/09 18:13:42
    OS : Windows 7 Ultimate Edition SP1 [6.1 Build 7601] (x64)
 

Striped 2x WD VelociRaptor 10K disks
-----------------------------------------------------------------------
CrystalDiskMark 3.0.1 x64 (C) 2007-2010 hiyohiyo
                           Crystal Dew World : http://crystalmark.info/
-----------------------------------------------------------------------
* MB/s = 1,000,000 byte/s [SATA/300 = 300,000,000 byte/s]

           Sequential Read :   158.779 MB/s
          Sequential Write :   227.951 MB/s
         Random Read 512KB :    66.876 MB/s
        Random Write 512KB :   132.817 MB/s
    Random Read 4KB (QD=1) :     0.886 MB/s [   216.2 IOPS]
   Random Write 4KB (QD=1) :     3.226 MB/s [   787.5 IOPS]
   Random Read 4KB (QD=32) :     3.832 MB/s [   935.6 IOPS]
  Random Write 4KB (QD=32) :     4.467 MB/s [  1090.6 IOPS]

  Test : 1000 MB [E: 45.7% (485.0/1061.8 GB)] (x5)
  Date : 2017/02/09 17:57:49
    OS : Windows 7 Ultimate Edition SP1 [6.1 Build 7601] (x64)
 
 

 


Donnerstag, 2. Februar 2017

lustre 2.9 on nvm PCI-E SSD Intel P3600 1.2TB

Ldiskfs on Intel SSD DC P3600 vs 8xSSD RAID10 with MR9271-8i
thrhi=16 dir_count=16 file_count=200000 mds-survey
Fri Feb  3 01:50:05 CET 2017 /usr/bin/mds-survey from c1701.cls
mdt 1 file  200000 dir   16 thr   16 create 329017.18 [ 329017.18, 329017.18] lookup 3167915.35 [ 3167915.35, 3167915.35] md_getattr 968143.25 [ 968143.25, 968143.25] setxattr 370109.92 [ 370109.92, 370109.92] destroy 235829.03 [ 235829.03, 235829.03]
done!

thrhi=16 dir_count=16 file_count=200000 mds-survey
Sun Jun  8 15:20:30 CEST 2014 /usr/bin/mds-survey from newmds01
mdt 1 file  200000 dir   16 thr   16 create 144417.16 [ 144417.16, 144417.16] lookup 2538618.74 [ 2538618.74, 2538618.74] md_getattr 1210573.15 [ 1210573.15, 1210573.15] setxattr 54542.92 [ 54994.01, 56996.07] destroy 89073.61 [ 76997.69, 76997.69]
done!

Interesting almost 2x faster than 8 SSDs(RAID10) in create operation.  Actually create in RAID10 same as create on 4SSDs. So one can say 1-NVME is 2 times faster than 4xSSDs: nice!

The expensive setxattr is almost 7 times faster!!!

PCI-E SSD INTEL formating to 4K sector size

isdct show -intelssd 

- Intel SSD DC P3600 Series CVMD550300L81P2CGN -

Bootloader : 8B1B0133
DevicePath : /dev/nvme0n1
DeviceStatus : Healthy
Firmware : 8DV101F0
FirmwareUpdateAvailable : The selected Intel SSD contains current firmware as of this tool release.
Index : 0
ModelNumber : INTEL SSDPEDME012T4
ProductFamily : Intel SSD DC P3600 Series
SerialNumber : CVMD550300L81P2CGN
Change sector size from 512(LBAFormat=0) to 4096(LBAFormat=3) :

isdct start -intelssd 0 -nvmeformat LBAFormat=3
Warning: you will loose all data.

Reset the device without rebooting:

echo 1 >  /sys/class/nvme/nvme0/device/reset

 nice we have now 4k sector size:

nvme list
nvme list
Node             SN                   Model                                    Version  Namespace Usage                      Format           FW Rev  
---------------- -------------------- ---------------------------------------- -------- --------- -------------------------- ---------------- --------
/dev/nvme0n1     CVMD550300L81P2CGN   INTEL SSDPEDME012T4                      1.0      1           1.20  TB /   1.20  TB      4 KiB +  0 B   8DV101F0

NVME intel performance on CentOS7.3

[root@c1701 ~]# hdparm -tT   --direct /dev/nvme0n1

/dev/nvme0n1:
 Timing O_DIRECT cached reads:   2512 MB in  2.00 seconds = 1255.72 MB/sec
 Timing O_DIRECT disk reads: 3604 MB in  3.00 seconds = 1200.83 MB/sec
[root@c1701 ~]# hdparm -tT   --direct /dev/nvme0n1

/dev/nvme0n1:
 Timing O_DIRECT cached reads:   2398 MB in  2.00 seconds = 1198.11 MB/sec
 Timing O_DIRECT disk reads: 3720 MB in  3.00 seconds = 1239.86 MB/sec
uname -a
Linux c1701.cls 3.10.0-514.2.2.el7.x86_64 #1 SMP Tue Dec 6 23:06:41 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux

Lustrefs 2.9 migrate data from OST

One of the osts is full,  we got a new ost,
let us migrate:

lfs find /archive  -obd arch-OST0001_UUID -type f -size +1M | lfs_migrate -y