This chapterprovidesinstructions,requirements,andconsiderations forattaching anIntel™ hostsystemrunningLinuxtoa storageunit.
Supported
adapter
cards
for
an
Intel
host
running
Linux
This topiclist thesupportedadaptercardsfor attachingto anIntel hostrunning Linux.
This sectiondescribeshow toattachanIntel serverrunningLinuxtoa storageunit withthefollowingfibre-channeladapters:
v QLogicQLA2310F adaptercard
v QLogicQLA2310FLadaptercard
v QLogicQLA2340FLadaptercard
v QLogicQLA2342FLadaptercard
v EmulexLP9002DCadaptercard
v EmulexLP9002Ladaptercard
v EmulexLP9402DCadaptercard
v EmulexLP9802adaptercard
v EmulexLP10000adaptercard
v EmulexLP10000DCadaptercard
v Netfinityadaptercard
For up-to-dateinformationabouttheservers,operating systems,distributionlevels, host adapters,andfabricconnectionsthatIBMsupports,seetheInteroperability Matrixat http://www.ibm.com/servers/storage/disk/ds8000/interop.html.
Note: Thestepstoinstallandconfigureadaptercardsareexamples.Your
configurationmightbedifferent.
Attaching
with
fibre-channel
adapters
You canattachanIntelserverthatisrunningeithertheRedHat EnterpriseLinux, SUSESLES, RedFlagLinuxAdvancedServer,andAsianuxversionsoftheLinux operating systemto anIBMstorageunit.
For informationaboutthemostcurrentversionof thekernelandtheswitchesthat aresupported,seetheInteroperabilityMatrixat
http://www.ibm.com/servers/storage/disk/ds8000/interop.html.
Attachment
requirements
for
an
Intel
host
running
Linux
This sectionprovidesattachmentrequirementsforanIntelhost runningLinux This sectionliststherequirementsforattachingthestorageunittoyourhost system:
v ChecktheLUNlimitationsfor yourhostsystem.
v Ensurethatyoucanreference thedocumentation foryourhostsystem andthe
IBMTotalStorage DS8000User’sGuide.TheUser’sGuideisontheTotalStorage CDthatyou receivewiththestorageunit.
v Fordetails aboutthereleaselevelforyouroperating system,seethe
InteroperabilityMatrixat
http://www.ibm.com/servers/storage/disk/ds8000/interop.html.
Either youoranIBMservice supportrepresentativemust performthefollowing tasksto installandconfigureastorageunit:
1. Installthestorageunit.
2. Define thefibre-channelhostsystem withtheworldwideportname identifiers.
For thelistofworldwideportnames,see“Locatingtheworldwideportname (WWPN),” onpage225.
3. Define thefibre-portconfigurationifyou didnotdoitwhenyouinstalledthe
storageunitor fibre-channeladapters.
4. Configurethehostsystem forthestorageunitbyusingtheinstructionsinyour
host systempublications.
Attachment
considerations
for
an
Intel
host
running
Linux
This sectionprovidesattachmentconsiderationsfor anIntelhost runningLinux. For themostcurrentLinuxversions,servers,andswitches,see
http://www.ibm.com/servers/storage/disk/ds8000/interop.html.
Seehttp://www.redhat.comorhttp://www.suse.com todownloadthevendorkernel. TheDS8000supports eServerBladeCenterHS20 withblades8678, 8832,and 8839 whenoperating ina RedHatEnterprise Linux3.0or 4.0or SUSESLES 9, 32-bit environment.Seehttp://www-1.ibm.com/servers/storage/disk/ds8000for more informationabout supportingBladeCenterHS20.
Thestorageunitsupports bothdirectandfabricattachmenttotheeServer
BladeCenter™JS20whenoperatingwithAIX5.2H,orRedHat EnterpriseLinux3.0 or 4.0,orLinuxSLES9.Seethe
http://www.ibm.com/servers/storage/disk/ds8000/interop.html formoreinformation about supportingBladeCenterJS20.
Disabling
automatic
system
updates
ManyLinuxdistributionsgiveadministratorstheabilitytoconfiguretheirsystemsfor automaticsystem updates.Red Hatprovidesthis abilityintheformof aprogram called up2date,andSUSEprovidesaprogramcalledYaSTOnlineUpdate.Youcan configurethesefeaturestoquery forupdatesthatareavailableforeach hostandto automatically installanynew updatesthattheyfind,which canincludeupdatesto thekernel.
If yourhostisattachedto theDS8000seriesandisrunningtheIBMMultipath SubsystemDeviceDriver(SDD),youshouldconsiderturningoff thisautomatic updatefeaturebecausesomedriverssuppliedbyIBM,likeSDD,aredependentan a specifickernelandcannotfunction inthepresenceofanew kernel.Similarly, host busadaptersdriversmustbecompiledagainstspecifickernelsto function optimally. Byallowingautomaticupdateofthekernel,youriskanunexpected impact toyourhostsystem.
Installing
the
Emulex
adapter
card
for
an
Intel
host
running
Linux
This sectionprovidesinstructionsfor installingtheEmulexadaptercardfor anIntel host runningLinux.
This sectiontellsyouhowto attacha storageunittoa Linuxhost systemwithan Emulexadaptercard.
Note: TheLP9402DCadaptercardisa3.3voltcardonlyandrequiresa 3.3volt
PCIslot.
Single-anddual-portfibre-channelinterfaceswithanEmulexadaptercardsupport thefollowingpublicandprivateloop modes:
v Target
v Publicinitiator
v Privateinitiator
v Targetandpublicinitiator
v Targetandprivateinitiator
1. Record theInstitute ofElectricalandElectronicsEngineers(IEEE)numberthat
isprintedonthecard.You canusetheIEEEnumberto determinetheWWPN.
Note: YoucanfindtheWWPNof youradaptercardsbyissuingthe
cat/proc/scsi/adapter_type/ncommand,whereadapter_typeisthehost adaptertypeandnisthehostadapternumberfor yourcard.Yourhost adaptertypecanbeeitherqlaxxxxforQLogic adaptersorlpfc forEmulex adapters.
2. Refertotheinstallationinstructionsprovidedbyyourhostadaptervendorfor
theirspecificinstallationinstructions.Gotohttp://www.emulex.com
Downloading
the
Emulex
adapter
driver
for
an
Intel
host
running
Linux
This sectionprovidesinstructionfordownloadingtheEmulexadapterdriverforan Intel hostrunningLinux.
1. Goto http://www.ibm.com/servers/storage/disk/ds8000/interop.html.
2. Click Interoperabilitymatrix.
3. Click DS8000interoperabilitymatrix.
4. Findthesection forthecurrentversion ofthedriverandfirmware thatyouwant.
5. Goto http://www.emulex.com
6. Click Driver,downloads, anddocumentation fromtheleftnavigationpane.
Click OEMsoftwareanddocumentation. 7. SelectIBMfromthedropdownvendorlist.
8. Click thelinkfortheadaptertogetthefirmware,driver,anddocumentationthat
youneed toinstallanddownloadtheadapterdriver.
Installing
the
Emulex
adapter
driver
for
an
Intel
host
running
Linux
This sectionprovidesinstructionsfor installingtheEmulexadapterdriversfor an Intel hostrunningLinux.
You mustbeabletoreference thereadmedocumentationthatcomeswiththehost adapter.
TheEmulexWebsitecontainsdetailedinstructionstoinstall,build,andloadtheir adapterdrivers.Refertothereadmedocumentationthatcomeswithyour host adapterfor thesedetailed instructionsthatareuniquetoyourhost adapter.You must followtheseinstructionsfor asuccessfulinstallationoftheadapterdriver.See http://www.emulex.comfor thelatestdocumentation.
Installing
the
QLogic
adapter
card
for
an
Intel
host
running
Linux
This sectiontellsyouhowto attachanIntelhost systemrunningLinuxtoastorage unit withtheQLogicQLA23xxadaptercard.
Single-anddual-portfibre-channelinterfaceswiththeQLogicadaptercardssupport thefollowingpublic andprivateloop modes:
v Target
v Publicinitiator
v Privateinitiator
v Targetandpublic initiator
v Targetandprivateinitiator
Note: Thefollowingstepsareanexampleconfiguration.Theconfigurationforyour
adaptermightdiffer.
1. InstalltheQLogic QLA23xxadaptercardinthehost system.
2. Connectthecabletothestorageunitport.
3. Restart theserver.
4. Press Ctrl+Qto gettotheFAST!Utilmenupanel.
5. UseFAST!Utilto settheparametersto thevalues listedinthefollowingtable:
Table8.RecommendedsettingsfortheQLogicadaptercardforanIntelhostrunningLinux
Parameters Recommendedsettings
BasicInput/OutputSystem(BIOS) Disabled
Framesize 2048
Loopresetdelay 5(minimum)
AdapterhardloopID Disabled
HardloopID 0
Executionthrottle 100
Fastcommandposting Enabled
>4GBaddressing Disabled(for32-bitsystems)
LUNspertarget 0or128
EnableLIPreset No
EnableLIPfulllogin Yes
Enabletargetreset Yes
Loginretrycount v 60ifyouarenotrunningtheSDD
v 8ifyouarerunningtheSDD
Portdownretrycount v
60ifyouarenotrunningtheSDD
v 8ifyouarerunningtheSDD
DriverloadRISCcode Enabled
Enabledatabaseupdates No
Disabledatabaseload No
IOCBallocation 256
Extendederrorlogging Disabled(Youmightwanttoenablethis parameterifyouusedebugging.)
Table8.RecommendedsettingsfortheQLogicadaptercardforanIntelhostrunning Linux (continued)
Parameters Recommendedsettings
Typeofconnection v
Looponly
v
Point-to-point
v
Looppreferred(Ifyoucannotuse
arbitratedloop,thendefaultto point-to-point.)
v Point-topoint,otherwiseloop(Ifyou
cannotusepoint-to-point,defaultto arbitratedloop.)
Note: Ifyouconnectthestorageunitdirectly tothehostsystem,theoptionyouselect mustmatchtheportconnectionsonthe storageunit.
6. Restart theserver.
Downloading
the
current
QLogic
adapter
driver
for
an
Intel
host
running
Linux
This sectionprovidesinstructionsfor downloadingthecurrentQLogicadapterdriver for anIntel hostrunningLinux.
1. Goto http://www.ibm.com/servers/storage/disk/ds8000/interop.html.
2. Click Interoperabilitymatrix.
3. Click DS8000interoperabilitymatrix.
4. Findthesection forthecurrentversion ofthedriverandfirmware anddriveryou
want.
5. Goto http://www.qlogic.com.
6. Click Drivers/Software fromtheQuickLinkslist.
7. ChooseIBMfromtheOEMandISVapprovedDriversandFirmwaresection.
8. Navigateto thepartof thepagefortheadapteryouwanttodownload,then
clickDownload.
Installing
the
QLogic
adapter
driver
for
an
Intel
host
running
Linux
This sectionprovidesinstructionsfor installingtheQLogicadapterdriversforan Intel hostrunningLinux.
You mustbeabletoreference thereadmedocumentationthatcomeswiththehost adapter.
TheQLogic Websitecontainsdetailedinstructionsto install,build,andloadtheir adapterdrivers.Refertothereadmedocumentationthatcomeswithyour host adapterfor thesedetailed instructionsthatareuniquetoyourhost adapter.You must followtheseinstructionsfor asuccessfulinstallationoftheadapterdriver.See http://www.qlogic.comfor thelatestdocumentation.
Defining
the
number
of
disk
devices
on
Linux
This sectionprovidesinformationaboutdefiningthenumberofdiskdeviceson Linux.
ThemaximumnumberofconfigurabledevicesthatareavailableonsupportedLinux host systemsiseither 128,256,or2304.ThestandardLinuxkernelusesastatic major andminornumberaddressmechanism.Aspecialdevicefilerepresentseach diskdevice.For eachdefault,thereisa maximumof 16partitionsperdisk.The major andminornumbersareeach8-bits.
Note: TodeterminewhatlevelofLinuxisinstalled,usethefollowingcommands:
uname -a
cat /etc/*release*
Fibre-channel attacheddevicesaremanagedasSCSIdevices.Traditionally,there have beeneight majornumbersreservedfor SCSIdevices.Thosemajornumbers are8, 65,66,67,68,79,70,and71.Forkernellevelsthatsupport256devices, theadditionalmajor numbersare128, 129,130,131,132,133,134,and135. Newer kernelsaremovingtoa dynamicconfigurationmethodthatwilluse any available majornumbers.ThelatestSUSESLES 9kernelerrataincludethis change andimpose alimitofnomorethan144majornumbersallocatedto SCSI diskdevices.
There are256minornumbers availableforeach oftheeightmajor numbers.The following formulaprovidesthemaximumnumberof devicesforLinuxhostsystems:
Number of devices = (number of major numbers) x (number of minor numbers) ÷
(number of partitions). For example, Number of devices = 8 x 256 ÷ 16 = 128
or Number of devices = 144 x 256 ÷ 16 = 2304.
Tosetthemaximumnumberofdiskdevicesunder Linuxto properlydetectall volumes,youneed tosetthemax_scsi_lunsoption.
1. Editthe/etc/modules.conffile.
2. Add thefollowing line: options scsi_mod max_scsi_luns=128.
Note: Ifyoualreadyhave amax_scsi_lunoptioninthemodules.conffile,
ensurethatthevalues issetto 128. 3. Save thefile.
4. Run mkinitrdinorderto rebuildtheram-disk associatedwiththecurrentkernel.
You canusethefollowingcommandasanexampleof whatmkinitrdcommand to run:
mkinitrd /boot/<image> <kernel>
5. Reboot thehost.
If youloadahost adapterdevice asa moduleinLinux,thereisa kernellimittothe total numberof disksthatyoucanconfigure.Thislimitmightbelessthanthetotal supportedbythekernel(usually128or256).Thefirstmodulethatisloadedonthe system mightconfigurediscovereddisksuptothemaximumnumberofdisks supportedbythekernel.Subsequentdriversarelimitedto configuringafixed, smaller numberof drives.Thesedriversallsharea poolof devicestructuresthat arestaticallyallocatedafterthefirsthostadapterdriver isloaded.Thenumberof allocateddevice structures(usually40)issetwiththeCONFIG_SD_EXTRA_DEVS parameter whenthekernelcompiles.Traditionally,thisvaluehasbeen40,but newerRed Hatkernelshave itsetto128or 256.OnSUSESLES 9thedynamic configurationsystem eliminatesthislimit.
For example,considerasystem withaninternalSCSIAdaptechostadapterand onedisk.Thesystemcontainsfibre-connecteddisksanda
CONFIG_SD_EXTRA_DEVSparametersetto 40.TheAdaptechostadapterdriver loadsfirstandconfiguresthesingleattacheddisk.At thispoint,thesystem is limited toatotal of41SCSIdisksinsteadofthefull128or 256.Iftherearemore than 40disksvisibleinthefibre-channelfabric,thesystem configuresanduses only thefirst40.Allof thefabricdevicesmightbelistedinthe/proc/scsi/scsi directory, butonlythefirst40areconfiguredwiththeSCSIdiskdriver.You are more likelytoencounterthisconstraintinmultipathfabricsituations.
Configuring
the
storage
unit
This sectionprovidesinstructionsfor configuringthestorageunit.
Configuring
the
storage
unit
for
an
Intel
host
running
Linux
ConfiguringthestorageunitforanIntelhostrunningLinux
Each oftheattachedstorageunitLUNs hasaspecialdevicefileintheLinux directory /dev.Therearemaximumsof128or 256fibre-channeldisksthatare basedonthemajornumbersthatareavailable.ForRed Hat,theoperatingsystem automatically addstheentriesforall128devices.For SUSE,thereareonly special device filesfor thefirst 16disks.Youmust createthedevicefilesforadditional disks byusingthemknodcommand.
Therangeof devicesgoesfrom/dev/sda(LUN0) to/dev/sddx(LUN127). Figure64showsanexampleof therange forthedevices.
Partitioning
storage
unit
disks
for
an
Intel
host
running
Linux
Partitioningstorageunitdisksfor anIntel hostrunningLinux
Beforeyou createafile system,partitionthediskbyusingthefdiskutility.Youhave to specifythespecialdevicefileof thediskyouwanttopartitionwhenexecuting fdisk.Figure65onpage126shows anexampleofthedifferentoptionsfor thefdisk utility.
# ls –l /dev/sda
brw-rw---- 1 root disk 8, 0 Aug 24 2000 /dev/sda
Figure66showsanexampleof aprimarypartitiononthedisk/dev/sdb.
Assigning
the
system
ID
to
the
partition
for
an
Intel
host
running
Linux
AssigningthesystemIDto thepartitionforanIntelhost runningLinux 1. Assignthesystempartition ID.
2. Writetheinformationtothepartitiontable onthedisk.
3. Exitthefdiskprogram.
Figure67onpage 127showstheassignmentof theLinuxsystem IDtothepartition (hex code83).
# fdisk /dev/sdb
Command (m for help): m
Command action
a toggle a bootable flag
b edit bsd disklabel
c toggle the dos compatibility flag
d delete a partition
l list known partition types
m print this menu
n add a new partition
o create a new empty DOS partition table
p print the partition table
q quit without saving changes
s create a new empty Sun disklabel
t change a partitions system id
u change display/entry units
v verify the partition table
w write table to disk and exit
x extra functionality (experts only)
Figure65.Exampleofdifferentoptionsforthefdiskutility
Command (m for help): n
Command action e extended p primary partition (1-4) p Partition number (1-4): 1
First cylinder (1-953, default 1): Enter Using default value 1
Last cylinder or +size or +sizeM or +sizeK (1-953, default 953): Enter Using default value 953
Command (m for help): p
Disk /dev/sdb: 64 heads, 32 sectors, 953 cylinders Units = cylinders of 2048 * 512 bytes
Device Boot Start End Blocks Id System
/dev/sdb1 1 953 975856 83 Linux
Creating
and
using
file
systems
on
the
storage
unit
for
an
Intel
host
running
Linux
This topicsdescribeshowyoucreateandusefilesystemsonthestorageunitfor anIntelhost runningLinux.
Afteryoupartitionthediskasdescribedin“Partitioningstorageunitdisksforan Intel hostrunningLinux”onpage125, thenext stepistocreateafilesystem. Figure68showsanexampleof theEXT2 Linuxfilesystem(whichisnonjournaled) byusingthemke2fs.
Figure69onpage 128shows anexampleoftheEXT2 Linuxfile system(whichis nonjournaled)byusingthemkfscommand.
Command (m for help): t
Partition number (1-4): 1
Hex code (type L to list codes): 83
Command (m for help): w
The partition table has been altered!
Calling ioctl() to re-read partition table.
SCSI device sdb: hdwr sector= 512 bytes. Sectors= 1953152 [953 MB][1.0 GB] sdb: sdb1
SCSI device sdb: hdwr sector= 512 bytes. Sectors= 1953152 [953 MB][1.0 GB] sdb: sdb1
WARNING: If you have created or modified any DOS 6.x partitions, pleasesee the fdisk manual page for additional information.
Syncing disks. [root@yahoo /data]#
Figure67.ExampleofassigningaLinuxsystemIDtothepartition
[root@yahoo /data]# mke2fs /dev/sdb1
mke2fs 1.18, 11-Nov-1999 for EXT2 FS 0.5b, 95/08/09 Filesystem label=
OS type: Linux
Block size=4096 (log=2) Fragment size=4096 (log=2) 122112 inodes, 243964 blocks
12198 blocks (5.00%) reserved for the super user First data block=0
8 block groups
32768 blocks per group, 32768 fragments per group 15264 inodes per group
Superblock backups stored on blocks: 32768, 98304, 163840, 229376
Writing inode tables: done
Writing superblocks and filesystem accounting information: done [root@yahoo /data]#
SCSI
disk
considerations
for
an
Intel
host
running
Linux
This sectionprovidesinformationfordynamicallyaddingandremovingSCSIdisks.