Featured Post

YouTube and link library for S2D.dk

2019/11/23

DiskSpd remote disk Performance and Host impact

DiskSpd (diskspd.exe) - Disk Read/Write impact on the Host CPU/LPs (Remote Disk with RDMA/iWARP)
Examples with 1, 10 and 32 threads per target. 1 or 8 Number of outstanding I/O requests per-target per-threads.

*** Disclaimer ***
s2d.dk is not responsible for any errors, or for the results obtained from the use of this information on s2d.dk. All information in this site is provided as "draft notes" and "as is", with no guarantee of completeness, accuracy, timeliness or of the results obtained from the use of this information. Always test in a lab setup, before use any of the information in production environment.
For any reference links to other websites we encourages you to read the privacy statements of the third-party websites.
The names of actual companies and products mentioned herein may be the trademarks of their respective owners.
***

diskspd.exe - Disk Read/Write impact on the Host CPU/LPs 
The performance counters shows the Remote Client Host CPU/LPs impact, while the diskspd.exe creating workload

Both the File Server and the Client Host use Chelsio 40G Network Adapteres with RDMA/iWARP
The File Server use a "SET Switch" with two vNICs and the Client use pNIC
  • S046001E - File Server
    • 172.18.0.119
    • 172.18.0.120
  • S046002A - Client (Running DiskSpd)
    • 172.18.0.121
    • 172.18.0.122
Part 1 - Performance test with DiskSpd (Remote Disk Performance - Part 1)



Part 2 - Performance test with DiskSpd (Remote Disk Performance - Part 2)




The first Picture shows the SMB RDMA Connections
Note: The direction is opposite of the job, Read Test will show SMB Direct Write traffic

SMB Direct Connections from Client Server to File Server
***

Client Server Read Performance from the remote File Share (Remote Disk)
Note:
The Client Server use a pNIC from Chelsio with RDMA/iWARP enabled
***

Client Server Read Performance from the remote File Share (Remote Disk)
***

Client Server Write Performance from the remote File Share (Remote Disk)
***


Client Server Write Performance from the remote File Share (Remote Disk)
***

File Server Host Read Performance from the remote Client (Local Disk impact on the File Server)
Note:
The File Server use a Virtual Switch (SET Switch) with vNICs and RDMA enabled (NDKm2)
The pNICs are also Chelsio with RDMA/iWARP
***

File Server Host Write Performance from the remote Client (Local Disk impact on the File Server)
***