Benutzer-Werkzeuge

Webseiten-Werkzeuge


dba:rac_infinband

Unterschiede

Hier werden die Unterschiede zwischen zwei Versionen angezeigt.

Link zu dieser Vergleichsansicht

Beide Seiten der vorigen RevisionVorhergehende Überarbeitung
Nächste Überarbeitung
Vorhergehende Überarbeitung
Letzte ÜberarbeitungBeide Seiten der Revision
dba:rac_infinband [2012/03/24 16:49] – [Oracle Linux 6.1 Probleme] gpipperrdba:rac_infinband [2012/03/24 17:02] – [Oracle Linux 6.1 Probleme] gpipperr
Zeile 32: Zeile 32:
 ==== Infiniband Treiber einrichten ====  ==== Infiniband Treiber einrichten ==== 
  
-Download Treiber unter der SilverStorm website.\\+Download des Treiber unter der SilverStorm website.\\ 
  
 === Installation === === Installation ===
Zeile 131: Zeile 132:
 </code> </code>
  
-==== Oracle Linux 6.1 Probleme  ====+==== Oracle Linux 6.1 bzw. Scientific Linux (SL) Problematik  ====
  
  
Zeile 144: Zeile 145:
 </code> </code>
  
-Lösung:\\ +**Lösung**:\\ 
-Mellanox treiber manuel installieren+Mellanox Treiber manuel installieren\\ 
 +(Sorry, in Englisch da für englischsprachigen Kunden .-) )\\ 
 + 
 +Ablauf: 
 + 
 +  * Mount ISO Image of Mellanox Driver to /mnt/mellanox 
 +  * Create directory /tmp/build_driver_mellanox 
 +  * Copy from src directory from iso image the source code to /tmp/build_driver_ mellanox 
 +  * Copy Conf File to /tmp/build_driver_ mellanox (from MCNG Source Code!) 
 +  * Start Kernel driver installation ( ./install.pl –c ofed.conf) 
 +  * Install Tools from rpm directory of iso cd 
 +  
 +Mount the Infiniband Setup ISO Image via the command 
 +<code bash> 
 +# mkdir /mnt/mellanox 
 + 
 +# mount -o loop -t iso9660 /installfiles/06_mellanox/MLNX_OFED_LINUX-1.5.3-3.0.0-rhel5.7-x86_64.iso /mnt/mellanox 
 +</code> 
 + 
 +Building RPMs for un-supported kernels. 
 +<code bash> 
 +mkdir /tmp/build_driver_mellanox 
 + 
 +cd /mnt/mellanox/src 
 + 
 +cp MLNX_OFED_SRC-1.5.3-3.0.0.tgz /tmp/build_driver_mellanox  
 + 
 +cd /tmp/build_driver_mellanox 
 + 
 +tar zxvf MLNX_OFED_SRC-1.5.3-3.0.0.tgz 
 + 
 +cd MLNX_OFED_SRC-1.5.3-3.0.0 
 +</code> 
 + 
 +Copy ofed.conf to the /tmp/build_driver_mellanox/MLNX_OFED_SRC-1.5.3-3.0.0 directory\\ 
 +Deinstall package  scsi-target-utils\\ 
 + 
 +<code bash> 
 +yum remove  scsi-target-utils 
 +</code> 
 + 
 +Start the build and installation of the kernel module. 
 +<code bash> 
 +./install.pl -c ofed.conf  
 +Below is the list of OFED packages that you have chosen 
 +(some may have been added by the installer due to package dependencies): 
 + 
 +ofed-scripts 
 +kernel-ib 
 +kernel-ib-devel 
 +kernel-mft 
 + 
 +Uninstalling the previous version of OFED 
 +Build ofed-scripts RPM 
 + 
 +… …… ………… …… ….. 
 + 
 + 
 +Device (15b3:634a): 
 +        47:00.0 InfiniBand: Mellanox Technologies MT25418 [ConnectX VPI PCIe 2.0 2.5GT/s - IB DDR / 10GigE] (rev a0) 
 +        Link Width: 8x 
 +        PCI Link Speed: 2.5Gb/s 
 + 
 + 
 +Installation finished successfully. 
 + 
 +</code> 
 + 
 +If you get the output "Installation finished successfully" the driver installation is finished. \\ 
 +Go back to iso image and install the Mellanox Support  tools from RPM directory\\ 
 + 
 +<code bash> 
 +cd /mnt/mellanox/RPMS/ 
 + 
 + 
 +yum --nogpgcheck install opensm-3.3.9.MLNX_20111006_e52d5fc-0.1.x86_64.rpm rds-tools-2.0.4-1.x86_64.rpm infiniband-diags-1.5.8.MLNX_20110906-0.1.x86_64.rpm ibutils2-2.0-0.34.g9d3133a.x86_64.rpm ibutils-1.5.7-0.1.g05a9d1a.x86_64.rpm opensm-libs-3.3.9.MLNX_20111006_e52d5fc-0.1.x86_64.rpm libibmad-1.3.7.MLNX_20110814-0.1.x86_64.rpm libibumad-1.3.7.MLNX_20110814-0.1.x86_64.rpm 
 + 
 +</code> 
 + 
 +Please check in the configuration files for Infiniband, that the RDS driver is loaded at startup. 
 +<code bash> 
 +$ cat /etc/infiniband/openib.conf | grep RDS 
 +# Load RDS module 
 +RDS_LOAD=yes 
 +If not, please change Value for parameter RDS_LOAD to yes on each node. If whole parameter is missing, add the parameter. 
 +</code>
  
 +See also this : http://www.hpcadvisorycouncil.com/events/2011/switzerland_workshop/pdf/Presentations/Day%201/2_InfiniBand_Training.pdf
  
 ==== Quellen === ==== Quellen ===
dba/rac_infinband.txt · Zuletzt geändert: 2012/03/24 17:03 von gpipperr