Reference Guide for AIX

(1)

PCI-X

SCSI

RAID

Controller

Reference

Guide

for

AIX

SA23-1323-02

(2)

(3)

PCI-X

SCSI

RAID

Controller

Reference

Guide

for

AIX

SA23-1323-02

(4)

ThirdEdition(February2006)

Beforeusingthisinformationandtheproductitsupports,readtheinformationin“SafetyInformation”onpageviiand AppendixB,“Notices,”onpage85.

Areader’scommentformisprovidedatthebackofthispublication.Iftheformhasbeenremoved,address commentstoPublicationsDepartment,InternalZip9561,11501BurnetRoad,Austin,Texas78758-3493.Tosend commentselectronically,usethiscommercialinternetaddress:[email protected] supplymaybeusedwithoutincurringanyobligationtoyou.

©InternationalBusinessMachinesCorporation2003,2006.Allrightsreserved.

NotetoU.S.GovernmentUsersRestrictedRights--Use,duplicationordisclosurerestrictedbyGSAADPSchedule

Note

Beforeusingthisinformationandtheproductit supports,besureto readthegeneralinformation under″ProductWarrantiesandNotices″includedwithyoursystemunit.

(5)

MAP3000 . . . 48 MAP3010 . . . 48 MAP3011 . . . 51 MAP3012 . . . 53 MAP3013 . . . 54 MAP3020 . . . 56 MAP3021 . . . 57 MAP3030 . . . 57 MAP3031 . . . 59 MAP3032 . . . 62 MAP3033 . . . 64 MAP3034 . . . 65 MAP3035 . . . 67 MAP3036 . . . 68 MAP3040 . . . 69 MAP3041 . . . 70 MAP3050 . . . 71 MAP3051 . . . 76 MAP3090 . . . 77

FindinganSRNGivenanAIXErrorLog . . . 78

ExampleAIXErrorLog(Error ID=SISIOA_ARY_DEGRADED) . . . 79

AppendixA.CommunicationsStatements . . . 81

FederalCommunicationsCommission(FCC)Statement . . . 81

EuropeanUnion(EU)Statement . . . 81

InternationalElectrotechnicalCommission(IEC)Statement . . . 81

UnitedKingdomTelecommunicationsSafety Requirements . . . 81

AvisdeconformitéauxnormesduministèredesCommunicationsduCanada . . . 82

CanadianDepartmentofCommunications ComplianceStatement . . . 82

VCCIStatement . . . 82

ElectromagneticInterference(EMI)Statement -Taiwan . . . 82

RadioProtectionfor Germany . . . 82

(7)

AppendixC.AIXCommand-LineInterface . . . 87

Index. . . 89

(8)

(9)

Safety

Information

DANGER

Anelectricaloutletthatis notcorrectlywiredcouldplace hazardousvoltage onmetalpartsof the systemorthe devicesthatattachtothe system.Itisthe responsibilityofthecustomer to ensure thattheoutletis correctlywiredandgroundedto preventanelectricalshock.

Before installingorremovingsignalcables,ensurethatthe powercablesforthe systemunit andallattacheddevicesare unplugged.

Whenaddingorremoving anyadditionaldevicestoorfromthe system,ensurethat thepower cablesforthosedevicesareunplugged beforethe signalcablesareconnected.Ifpossible, disconnectallpowercablesfromtheexistingsystembeforeyouadda device.

Use onehand,when possible,toconnectordisconnectsignalcablestopreventapossible shock fromtouchingtwosurfaceswithdifferentelectricalpotentials.

During anelectricalstorm,donotconnect cablesfordisplaystations,printers,telephones,or station protectorsforcommunicationlines.

(10)

(11)

Handling

Static

Sensitive

Devices

Attention:Static electricitycandamagethis deviceandyoursystemunit.Toavoiddamage,keepthis deviceinitsanti-staticprotectivebaguntil youarereadytoinstall it.Toreducethepossibilityof electrostaticdischarge,followtheprecautionslistedbelow:

v Limityourmovement.Movementcancausestaticelectricityto builduparoundyou.

v Handle thedevice carefully,holding itbyitsedgesoritsframe.

v Donottouchsolderjoints, pins,orexposedprintedcircuitry.

v Donotleavethedevicewhereotherscanhandleandpossiblydamagethedevice.

v While thedevice isstillinitsanti-staticpackage,touchitto anunpaintedmetalpartofthesystemunit

for atleasttwoseconds.(Thisdrainsstaticelectricityfromthepackageandfromyourbody.)

v Removethedevicefromitspackageandinstall itdirectlyinto yoursystemunitwithout settingitdown.If

it isnecessary tosetthedevicedown,placeitonitsstatic-protectivepackage.(If yourdeviceisan adapter,placeit component-sideup.)Donotplacethedeviceonyoursystem unitcoveror onametal table.

v Takeadditionalcarewhenhandlingdevicesduringcoldweather,asheatingreduces indoorhumidity

andincreasesstaticelectricity.

(12)

(13)

About

This

Book

Thisbookprovidesusageandmaintenanceinformationregarding thePCI-XSCSIRAIDController. Chapters1 through4ofthis bookcontaingeneralinformationthatisintendedfor allusersof thisproduct. Chapter5containsserviceinformationintended fora servicerepresentativespecificallytrainedonthe systemunitandsubsystembeingserviced.Usethisbookinconjunctionwithyourspecificsystem unitand operatingsystem documentation.

ISO

9000

ISO9000registeredquality systemswere usedinthedevelopmentandmanufacturingof thisproduct.

Highlighting

Thefollowinghighlightingconventionsareusedinthisbook:

Bold Identifiescommands,subroutines,keywords,files,structures,directories,andotheritems whosenamesarepredefinedbythesystem.Alsoidentifiesgraphicalobjectssuchasbuttons, labels,andiconsthattheuserselects.

Italics Identifiesparameterswhoseactualnamesorvaluesaretobesuppliedbytheuser. Monospace Identifiesexamplesofspecificdatavalues,examplesoftextsimilartowhatyoumightsee

displayed,examplesofportionsofprogramcodesimilartowhatyoumightwriteasa programmer,messagesfromthesystem,orinformationyoushouldactuallytype.

References

to

AIX

Operating

System

ThisdocumentmaycontainreferencestotheAIXoperating system.If youareusinganotheroperating system,consult theappropriatedocumentationfor thatoperatingsystem.

Thisdocumentmaydescribehardwarefeaturesandfunctions.Whilethehardwaresupports them,the realizationofthesefeaturesandfunctionsdependsupon supportfromtheoperating system.AIXprovides thissupport.Ifyou areusinganotheroperatingsystem,consulttheappropriatedocumentation forthat operatingsystem regardingsupportforthosefeaturesandfunctions.

Publications

Thefollowingpublicationscontainrelatedinformation:

v Systemunitdocumentationfor informationspecifictoyourhardware configuration

v RS/6000Eserver pSeriesAdapters,Devices,andCableInformationfor MultipleBusSystems,order

numberSA38-0516,containsinformationaboutadapters,devices,andcables foryoursystem.

v RS/6000Eserver pSeriesDiagnosticInformationforMultipleBusSystems,ordernumberSA38-0509,

containsdiagnosticinformation,service requestnumbers(SRNs),andfailingfunction codes(FFCs). Available ontheinternetathttps://techsupport.services.ibm.com/server/library

v AIXSystemManagement Guide:OperatingSystemandDevicesandAIXInstallationGuideand

Reference,availableontheinternetathttps://techsupport.services.ibm.com/server/library

v TheRAIDbook:AHandbookof StorageSystems Technology,Edition6,Editor:PaulMassiglia

(14)

Trademarks

ThefollowingtermsaretrademarksofInternationalBusinessMachinesCorporationintheUnitedStates, othercountries,orboth:

v AIX v AIX5L v Eserver v PowerPC v pSeries v RS/6000

(15)

Chapter

1. PCI-X

SCSI

RAID

Controller

Overview

ThePCI-XSCSIRAIDControllerisa133MHz64-bitPCI-Xadapter.Thisadapterhasthefollowing features:

v PCI-Xsysteminterface

v DualorQuadChannel,Ultra320SCSIcontrollers

v Embedded PowerPCRISCProcessor,hardware XORDMAEngine,andhardwareFiniteFieldMultiplier

(FFM)DMAEngine(forRAIDlevel6)

v Non-volatilewritecache

v Support forRAID(RedundantArrayofIndependent Disks)levels0, 5,6, and10diskarrays

v Diskarraysupportedasabootabledevice

v Supportsattachmentof otherdevicessuchasnon-RAIDdisks, tape,andopticaldevices

v AdvancedRAIDfeatures:

– Hotsparesfor RAIDlevel5, 6,and10diskarrays

– AbilitytoincreasethecapacityofanexistingRAIDlevel5or6 diskarraybyaddingdisks

– Backgroundparitychecking

– Backgrounddatascrubbing

– Disksformattedto522bytes/sector,providingLongitudinalRedundancyChecking(LRC)and

LogicallyBadBlockchecking

Table1.RaidEnablementcardsbyCustomCardIdentificationNumber(CCIN)

CCIN (Custom Card Identification Number) PCIForm Factor

Channels RAIDLevels

Supported WriteCache Size ReadCache Size MultiInitiator andHigh AvailSupport Adapter LED/FFC Cache BatteryPack Technology Cache BatteryPack Concur Maintain Cache BatteryPack FFC 2780 Yes 4 0,5,and10 Upto757MB (compressed) Upto1024 MB (compressed) No 2527 LiIon Yes 2D01

5703,1975 Yes 2 0,5,and10 40MB 0MB Yes3 ₂₅₂₃ _NiMH _No ₂₅₂₆

57091_,₁₉₇₆1 _No2 ₂ _0,_5,_and₁₀ ₁₆_MB ₀_MB _No ₂₅₂₃ _NiMH _No ₂₅₂₆ 571B,1913 Yes 2 0,5,6and 10 90MB 0MB Yes3 ₂₅₁₄ _LiIon _No _2D03 572E No4 ₂ ₀_and₁₀ ₀_MB ₀_MB _No _252B _NA _NA _NA 573D1_,₁₉₀₈1 _No2 ₂ _0,_5,_and₁₀ ₄₀_MB ₀_MB _No ₂₅₂₉ _NiMH _No ₂₅₂₆

1_The_CCIN_describes_the_RAID_Enablement_Card.

2_Some_PCI-X_SCSI_RAID_Controllers_do_not_have_the_form_of_a_standard_PCI_adapter._The_form_of_these_controllers_is_a_combination_of_SCSI_and_PCI-X_bus_interface_logic

integratedontothesystemboardandaRAIDEnablementCard.ThecardplugsintothesystemboardinordertoconnecttotheSCSIandPCI-Xbusinterfacelogic.

3_For_Multi_Initiator_and_High_Availability_information,_see_Chapter_4,_{“Multi-Initiator}_and_{High-Availability,”}_on_page_23.

4

ThisPCI-XSCSIRAIDControllerisintegratedontothesystemboardandattachestoSerialAttachedSCSI(SAS)disksvia3Gbconnections.

Note: This guiderefersto varioushardwareandsoftwarefeaturesandfunctions.Therealizationofthese

featuresandfunctionsdepends onthelimitationsofyourhardwareandsoftware.AIXsupports all functionsmentioned.If youareusinganotheroperatingsystem,consulttheappropriate

documentationfor thatoperatingsystem regardingsupportforthementionedfeaturesand functions.Thisguidealsousesthetermschannel andbusinterchangeably.

(16)

1 Channel1 external,68-position,VHDCI(veryhighdensity cableinterconnect)

2 Channel0 external,68-position,VHDCI(veryhighdensity cableinterconnect)

3 Channel0 internal,68-position,high-densityplasticD-shellSCSIstandardconnectorfor16-bit attachment

4 Channel1 internal,68-position,high-densityplasticD-shellSCSIstandardconnectorfor16-bit attachment

5 AdapterHandle

Disk

Arrays

RAIDtechnologyisusedto storedataacrossagroup ofdisksknownasadiskarray.Depending onthe RAIDlevelselected,thisstoragetechniqueprovidesthedataredundancyrequiredtokeep datasecure andthesystemoperational.Ifa diskfailureoccurs,thediskcanusuallybereplacedwithout interrupting normalsystemoperation.Disk arraysalso havethepotentialto providehigherdata transferandinput and output(I/O)rates thanthoseprovided bysingle largedisks.

Eachdiskarray canbeused byAIXinthesamewayasit wouldasinglenon-RAIDdisk.Forexample, aftercreatingadiskarray,youcancreateafilesystem onthediskarrayoruseAIXcommands tomake thediskarrayavailableto thesystembyaddingthediskarrayto avolumegroup.

ThePCI-XSCSIRAIDControllerismanagedbythePCI-XSCSIDiskArrayManager.ThePCI-XSCSI DiskArrayManagerservesastheinterface totheRAIDconfiguration.Itisalsoresponsibleforthe monitoringandrecoveryfeaturesofthecontroller.

Ifadiskarrayistobeusedasthebootdevice,it mayberequiredtopreparethedisksbybootingfrom theDiagnosticCDandcreatingthediskarraybeforeinstallingAIX.You mightwanttoperformthis procedurewhentheoriginalbootdriveisto beused aspartof adiskarray.

Thefollowingfigureillustratesa possiblediskarrayconfiguration.

(17)

Supported

RAID

Levels

TheRAIDlevelofa diskarraydetermineshow dataisstoredonthediskarrayandthelevelofprotection thatisprovided.Whenapartof theRAIDsystem fails,differentRAIDlevelshelpto recoverlostdatain differentways.Withtheexception ofRAIDlevel0,ifa singledrivefailswithinanarray,thearraycontroller canreconstructthedatafortheFaileddiskbyusingthedatastoredonotherharddriveswithinthearray. Thisdatareconstructionhaslittleornoimpacttocurrentsystemprogramsandusers.ThePCI-XSCSI RAIDControllersupports RAIDlevels 0,5, 6,and10.EachRAIDlevelsupportedbythePCI-XSCSI RAIDControllerhasitsown attributesandusesadifferentmethodofwriting data.Thefollowing informationdetailseachsupportedRAIDlevel.

(18)

RAID

Level

0

RAIDlevel0 stripesdataacrossthedisksinthearray,for optimalperformance.For aRAIDlevel0 array ofthreedisks, datawouldbewritteninthefollowingpattern.

RAIDlevel0 offersahighpotentialI/Orate,butitisanonredundantconfiguration.As aresult,thereisno dataredundancyavailablefor thepurposeof reconstructingdataintheeventofa diskfailure.Thereisno errorrecovery beyondwhatisnormallyprovidedonasingledisk.Unlikeother RAIDlevels, thearray controllernever marksa RAIDlevel0 arrayasDegradedastheresultof adiskfailure.Ifaphysicaldisk failsinaRAIDlevel0diskarray,thediskarrayismarkedasFailed.Alldata inthearraymustbebacked upregularly toprotectagainstdataloss.

(19)

RAID

Level

5

RAIDlevel5 stripesdataacrossalldisksinthearray.RAIDlevel5also writesarrayparitydata.Theparity dataisspreadacrossallthedisks.For aRAIDlevel5arrayof threedisks,arraydataandparity

informationarewritteninthefollowingpattern:

IfadiskfailsinaRAIDlevel5array,you cancontinueto usethearraynormally.ARAIDlevel5array operatingwithasingleFaileddiskissaid tobeoperatinginDegradedmode.Wheneverdataisreadfrom aDegradeddiskarray, thearraycontrollerrecalculatesthedataontheFaileddiskbyusingdataand parityblocks ontheoperationaldisks.If aseconddiskfails,thearraywillbeplacedintheFailedstate and willnotbeaccessible.

RAID

Level

6

RAIDlevel6 stripesdataacrossalldisksinthearray.RAIDlevel6also writesarray“P”and“Q”parity data.ThePandQparitydata, whichisbasedonReedSolomonalgorithms,isspreadacrossallthe disks.Fora RAIDlevel6 arrayoffourdisks,arraydataandparityinformationarewritteninthefollowing pattern:

Figure3.RAIDLevel5

(20)

Ifoneortwo disksfailina RAIDlevel6 array,youcancontinueto usethearraynormally.ARAIDlevel6 arrayoperatingwithaoneortwo Faileddisksissaid tobeoperatinginDegradedmode.Wheneverdata isreadfroma Degradeddiskarray,thearraycontrollerrecalculatesthedataontheFaileddisk(s) byusing dataandparityblocks ontheoperationaldisks.ARAIDlevel6 arraywitha singleFaileddiskhassimilar protectiontothatofa RAIDlevel5array withnodiskfailures. Ifathirddiskfails,thearraywillbeplaced intheFailedstateandwillnotbeaccessible.

Disk 1 Disk 2 Disk 3 Disk 4

(21)

RAID

Level

10

RAIDlevel10usesmirroredpairs toredundantlystoredata.Thearraymust containanevennumberof disks.Twoistheminimumnumberof disksneededtocreateaRAID10array.Thedataisstripedacross themirroredpairs.Forexample,aRAIDlevel10arrayof fourdiskswouldhavedatawrittento itinthe followingpattern:

RAIDlevel10toleratesmultiplediskfailures. Ifonediskineach mirroredpairfails,thearraywillstillbe functional,operatinginDegradedmode.Youcancontinuetousethearraynormallybecausefor each

Faileddisk,thedataisstoredredundantlyonitsmirroredpair.However, ifbothmembers ofamirrored pairfail,thearraywillbeplacedintheFailedstate andwillnotbeaccessible.

WhenaRAIDlevel10diskarrayiscreated,thecontrollerwillautomaticallyattemptto selectthedisksfor eachmirroredpairfromadifferentSCSIbus.Forexample,if fourdisksselectedfor thediskarrayreside ononeof thecontroller’sSCSIbusesandanotherfourdisksselectedresideonanotherof thecontroller’s SCSIbuses,thecontrollerwillautomaticallyattemptto createeach mirroredpairfromonediskoneach SCSIbus.Intheeventofa SCSIbus failure,each mirroredpairwillcontinuetooperateinaDegraded

mode.

Figure5.RAIDLevel10

(22)

Disk

Array

Capacities

Thecapacityof adiskarraydependsonthecapacityofthedisksusedandtheRAIDLevelofthearray. Tocalculatethecapacityof adiskarray,dothefollowing:

RAIDLevel 0

Multiplythenumberofdisksbythediskcapacity.

RAIDLevel 5

Multiplyonefewerthanthenumberofdisksbythediskcapacity.

RAIDLevel 6

Multiplytwo fewerthanthenumberofdisksbythediskcapacity.

RAIDLevel 10

Multiplythenumberofdisksbythediskcapacityanddivide by2.

Note: If disksofdifferentcapacitiesareused inthesamearray,alldisksaretreatedasiftheyhave the

capacityof thesmallestdisk.

RAID

Level

Summary

Thefollowinginformationprovidesdataredundancy, usablediskcapacity,readperformance,andwrite performanceforeach RAIDlevel.

RAIDLevel DataRedundancy UsableDisk

Capacity

ReadPerformance WritePerformance

RAID0 None 100% VeryGood Excellent

RAID5 VeryGood 67%to94% VeryGood Good

RAID6 Excellent 50%to89% VeryGood FairtoGood

RAID10 Excellent 50% Excellent VeryGood

RAIDLevel 0

Doesnotsupportdataredundancy, butprovidesapotentially higherI/Orate.

RAIDLevel 5

Createsarrayparityinformationsothatthedatacanbereconstructedifa diskinthearrayfails. ProvidesbettercapacitythanRAIDlevel10butpossiblylowerperformance.

RAIDLevel 6

Createsarray“P”and“Q”parityinformation,usingReedSolomonalgorithms,sothatthedatacan bereconstructedifoneor twodisksinthearray fail.Providesbetterdataredundancy thanRAID level5 butwithslightlylowercapacityandpossiblylowerperformance.Provides bettercapacity thanRAIDlevel10butpossiblylowerperformance.

RAIDLevel 10

Storesdataredundantlyonmirroredpairstoprovidemaximumprotectionagainstdiskfailures. ProvidesgenerallybetterperformancethanRAIDlevel5 or6, buthaslowercapacity.

Stripe-Unit

Size

WithRAIDtechnology, dataisstripedacrossanarrayof physicaldisks.Thisdatadistribution scheme complementsthewaytheoperatingsystem requestsdata.Thegranularityatwhichdata isstoredonone diskof thearraybeforesubsequent dataisstoredonthenext diskof thearrayiscalledthestripe-unit size.Thecollectionof stripeunits,fromthefirstdiskofthearraytothelastdiskof thearray,iscalleda

stripe.

Youcansetthestripe-unitsizeof aPCI-XSCSIDiskArrayto16KB,64KB,or256KB.Youmaybeable tomaximizetheperformanceof yourPCI-XSCSIDiskArraybysettingthestripe-unitsizetoavaluethat

(23)

isslightlylarger thanthesizeoftheaveragesystem I/Orequest.Forlargesystem I/Orequests,usea stripe-unitsizeof 256KB.Therecommendedstripesizeformost applicationsis64KB.

Disk

Array

Overview

Diskarraysaregroupsofdisksthatworktogetherwitha specializedarraycontrollerto potentiallyachieve higherdatatransferandinput andoutput(I/O)ratesthanthoseprovidedbysinglelargedisks.Thearray controllerkeepstrack ofhow thedataisdistributedacrossthedisks.RAIDlevel5,6, and10diskarrays alsoprovidedataredundancy, sothatnodataislostif asinglediskinthearrayfails.

PCI-XSCSIDiskArraysareassignednamesusingthehdiskform,thesameasotherdiskstorageunitsin AIX.Thesenamesareautomaticallyassignedwheneveryoucreateadiskarray.Thenamesaredeleted whenyoudeletethediskarray.Theindividual physicaldisksthatcomprisediskarraysorserveas

candidatesto beused indiskarraysarerepresentedbypdisknames.Apdiskisadiskthatisformatted to 522bytes/sector.Disksthatareformattedto 512bytes/sectorareassignednamesusingthehdiskform. Thesedisksmust beformatted to522bytes/sectorbeforetheycan beused indiskarrays.Foradditional informationaboutformatting512bytes/sectorhdisks tomakethemavailablefor useinPCI-XSCSIDisk Arrays,see“PreparingDisksforUseinPCI-XSCSIDiskArrays” onpage 14.

TheListPCI-XSCSIDiskArrayConfigurationoptioninthePCI-XSCSIDiskArrayManagercanbe usedto displaythesepdiskandhdisknames,alongwiththeirassociatedlocationcodes.For details regardinghowto viewthediskarrayinformation,see “ViewingtheDiskArrayConfiguration”onpage15. Thefollowingsampleoutputisdisplayed whentheListPCI-XSCSIDiskArrayConfigurationoptionis invoked.

---Name Location State Description Size

---sisioa1 30-60 Available PCI-XDDR Dual Channel U320 SCSI RAID Adapter

hdisk15 30-60-ff-0,1 Optimal Raid 5 Array 54.3GB

pdisk0 30-60-00-5,0 Active Array Member 18.1GB

hdisk16 30-60-ff-0,2 Degraded Raid 6 Array 72.8GB

pdisk3 30-60-00-10,0Active Array Member 36.4GB

pdisk5 30-60-01-5,0 Failed Array Member 36.4GB

pdisk7 30-60-00-12,0Active Array Candidate 36.4GB

pdisk8 30-60-00-13,0Active Hot Spare 72.8GB

hdisk20 30-60-01-4,0 Available 16 Bit LVD SCSI 9.0GB

hdisk21 30-60-01-6,0 Defined 16 Bit LVD SCSI 9.0GB

Thethirdcolumnintheprecedingoutputdisplaysthestate ofthedevice.

States

for

Disk

Arrays

(hdisks)

Thesixvalidstatesfor PCI-XSCSIDiskArraysare:Optimal,Degraded,Rebuilding,Failed,Missing,and

Unknown. Optimal

Thearrayisfunctionalandfullyprotected(RAID5,6, and10)withallArrayMemberpdisksinthe

Activestate.

Degraded

Thearray’sprotectionagainstdiskfailuresisdegradedoritsperformanceisdegraded.When one

(24)

ormoreArrayMemberpdisksareintheFailedstate,thearrayisstillfunctionalbutmightno longerbefullyprotected againstdiskfailures.For moreinformationaboutrecoveryproceduresfor diskfailures, see“RecoveryProceduresfor DiskFailures”onpage43.WhenallArrayMember pdisksareintheActivestate,thearrayisnotperformingoptimallybecauseofa problemwiththe controller’snonvolatilewritecache.

Rebuilding

Redundancydataforthearrayisbeingreconstructed.Aftertherebuildprocesshascompleted,the arraywillreturntotheOptimalstate.Untilthen,thearrayisnotfullyprotected againstdisk

failures.

Failed Thearray isnolongeraccessiblebecauseofdiskfailuresor configurationproblems.

Missing

Apreviouslyconfigureddiskarraynolongerexists.

Unknown

Thestate ofthediskarraycouldnotbedetermined.

States

for

Physical

Disks

(pdisks)

Thevalidstatesfor pdisksare:Active,RWProtected,Failed,Missing,andUnknown.

Active Thediskisfunctioningproperly.

RWProtected

Thediskisunavailablebecauseof ahardwareor aconfigurationproblem.

Failed Thecontrollercannotcommunicatewiththediskorthepdiskisthecauseof thediskarraybeing ina Degradedstate.

Missing

Thediskwaspreviouslyconnectedto thecontrollerbutisnolongerdetected.

Unknown

Thestate ofthediskcouldnotbedetermined.

pdisk

Descriptions

Thefourthcolumnintheprecedingoutputisadescriptionof thedevice. Foranarray,thedescription indicatestheRAIDlevelof thearray.Thedescriptionof apdiskindicateswhetherthediskisconfiguredas anArrayMember,Hot Spare,oranArrayCandidate.

ArrayMember

A522bytes/sectorpdiskthatisconfiguredasamemberofanarray.

HotSpare

A522bytes/sectorpdiskthatcanbeusedbythecontrollertoautomaticallyreplacea Faileddisk ina DegradedRAIDlevel5,6, or10diskarray.AHotSparediskisusefulonly ifitscapacityis greaterthanorequalto thecapacityof thesmallestdiskinanarraythatbecomesDegraded.For moreinformationabouthotsparedisks, see“UsingHotSpareDisks”onpage 18.

ArrayCandidate

(25)

Chapter

2. PCI-X

SCSI

RAID

Controller

Software

ForthePCI-XSCSIRAIDControllerto beidentifiedandconfiguredbyAIX,therequisitedevicesupport softwaremust beinstalled.TherequisitesoftwareforthePCI-XSCSIRAIDControllerisoften preinstalled aspartof thenormalAIX installation.However, itmay benecessaryto performoperationsrelatedtothe installation,verification,andmaintenanceoftheAIXdevice softwarefor thePCI-XSCSIRAIDController.

SoftwareforthePCI-XSCSIRAIDControllerispackagedininstallpformat anddistributedaspartof the baseAIXinstallationmedia,AIXupdatemedia,andthroughtheweb-based FixDeliveryCenterforAIX. Thisinformationisanoverviewof theAIXsoftwaresupportrequiredfor thePCI-XSCSIRAIDController. ForcompleteinformationrelatedtotheinstallationandmaintenanceofAIX,refertotheAIXInstallation GuideandReference.

ThePCI-XSCSIRAIDControllerexecutesonboardmicrocode.TheAIXcommandlsmcodecanbeused todeterminethelevelof onboardmicrocodebeingused bythecontroller.Althougha versionofcontroller microcodemaybedistributedalongwithAIX,this doesnotnecessarilyrepresentthemostrecentversion ofmicrocodeavailablefor thecontroller.For moreinformationregardingobtaininganddownloadingnew PCI-XSCSIRAIDControllermicrocode,see“UpdatingthePCI-XSCSIRAIDControllerMicrocode”on page30.

Verifying

the

Installation

of

the

PCI-X

SCSI

RAID

Controller

Software

Supportfor thePCI-XSCSIRAIDControlleriscontainedintheAIXpackagedescribedbythetable below. Thedevicesupportpackagecontainsmultiplefilesets,each relatedto adifferentaspectofdevice support (forexample,run-timeenvironment,diagnosticssupport,andcontrollermicrocode).

Thesepackagecanbedownloadedfrom

http://techsupport.services.ibm.com/server/mdownload2/adapter.html

Table2.AIXsoftwarerequirementsbyCustomCardIdentificationNumber

CCIN(CustomCard IdentificationNumber)

AIXPackage MinimumRequiredAIXVersion

2780 devices.pci.14106402 5.2 5703,1975 devices.pci.14107802 5.1 5.2 ML_07* or 5.3 ML_03* 5709,1976 devices.pci.14107802 5.1 571B,1913 devices.pci.1410be02 5.2 572E devices.pci.14108d02 5.2 573D,1908 devices.pci.1410d402 5.2

*MiniumlevelrequiredforMultiInitiatorandHighAvailabilitysupport.

Attention: Ensuretheadaptersareupdatedwiththelatestmicrocodefromthecodedownloadwebsiteaspartof

theinitialinstallation.Gotohttp://techsupport.services.ibm.com/server/mdownload2/adapter.html

ToverifythatthedevicesupportpackageforthePCI-XSCSIRAIDControllerisinstalled,typeasan example:

lslpp -l devices.pci.14107802*

Outputfromthiscommandwillindicateifdevice supportsoftwareforthePCI-XSCSIRAIDControlleris installed,andifso,whatthecorrespondinglevels ofeach filesetare.

(26)

Iftheoutputindicates thatnofilesetsofthisname areinstalled,you mustinstalltheappropriatepackage inorderfor thePCI-XSCSIRAIDControllertobemade availableforuse.Thissoftwarepackageis availableaspartof thebaseAIXinstallationmedia,AIXupdatemedia,andthroughtheweb-based Fix DeliveryCenterforAIX.

Overtime, itmaybecome necessarytoinstallsoftwareupdatesinordertohave thevery latestavailable levelofdevicesoftwaresupportforthePCI-XSCSIRAIDController.Updatesto thedevicesupport softwarearepackaged,distributed,andinstalledthroughthesamemechanismsused forotherportionsof theAIXbaseoperating system.ThestandardAIXtechnicalsupportprocedurescanbeusedto determine thelatestavailablelevelof devicesoftwaresupportfor thePCI-XSCSIRAIDController.

(27)

Chapter

3. Common

PCI-X

SCSI

RAID

Controller

Tasks

Theinstructionsinthischapterpertaintothevarioustasksthatcanbeperformedinordertomanagedisk arrays.

Using

the

PCI-X

SCSI

Disk

Array

Manager

ThePCI-XSCSIDiskArrayManagercan beaccessedeither throughtheSystemManagementInterface Tool(SMIT),orfor sometasks,theAIX commandline. Forinformationabout usingthecommandline interface,seeAppendixC,“AIXCommand-LineInterface,” onpage 87.ThePCI-XSCSIDiskArray ManagercanalsobestartedfromDiagnostics.

TostartthePCI-XSCSIDiskArrayManager, dothefollowing: 1. Atthecommandprompt,typesmit,andpressEnter.

2. SelectDevices.

3. SelectDiskArray.

4. SelectIBM PCI-XSCSIDiskArray.Fromthemenuwithoptionsforconfiguringandmanagingthe

PCI-XSCSIRAIDController,select PCI-XSCSIDiskArrayManagertodisplaythefollowingmenufor managingdiskarrays.

PCI-X SCSI Disk Array Manager

Move cursor todesired item and press Enter.

List PCI-X SCSIDisk Array Configuration

Create an ArrayCandidate pdisk and Format to 522 Byte Sectors Create a PCI-XSCSI Disk Array

Delete a PCI-XSCSI Disk Array

Add Disks toan Existing PCI-X SCSI Disk Array Configure aDefined PCI-X SCSI Disk Array

Change/ShowCharacteristics of a PCI-X SCSI Disk Array Reconstructa PCI-X SCSI Disk Array

Change/ShowPCI-X SCSI pdisk Status Diagnosticsand Recovery Options

F1=Help F2=Refresh F3=Cancel F8=Image

F9=Shell F10=Exit Enter=Do

Youcanalso useaSMITfast pathtostartthePCI-XSCSIDiskArrayManager.OntheAIXcommandline, type smitpxdam, andpress Enter.

Ifadiskarrayistobeusedasthebootdevice,you mightneedto preparethedisksbybootingfromthe DiagnosticCDandcreatingthediskarraybeforeinstallingAIX.Youmightwantto performthisprocedure whentheoriginal bootdriveistobeusedaspartofa diskarray.

TostartthePCI-XSCSIDiskArrayManagerfromDiagnostics,dothefollowing: 1. StartDiagnostics andontheFunctionSelectionscreen,selectTaskSelection.

2. SelectRAIDArrayManagerandpressEnter.

3. SelectPCI-XSCSIDiskArrayManagerandpressEnter.

(28)

Preparing

Disks

for

Use

in

PCI-X

SCSI

Disk

Arrays

BeforeadiskcanbeusedinaPCI-XSCSIDiskArray,itmust bea 522bytes/sectorArrayCandidate pdisk.TocreateanArrayCandidate pdiskandformat itto 522bytesectors,dothefollowing:

1. StartthePCI-XSCSIDiskArrayManagerbyfollowingthestepsin“UsingthePCI-XSCSIDiskArray

Manager”onpage 13.

2. SelectCreateanArrayCandidatepdiskandFormatto522ByteSectors.

3. SelecttheappropriatePCI-XSCSIRAIDController.

4. SelectthedisksthatyouwanttoprepareforuseinthePCI-XSCSIDiskArrays.

Attention: Continuingwiththisoptionwillformatthedisks.Alldataonthediskswillbelost. Some

disksrequirethattheirmicrocodebeupdatedto thelatestlevelbeforebeingformattedto 522byte sectors.Also, somedisksdonotsupportbeingformattedto 522bytesectors.ThePCI-XSCSIDisk ArrayManager willinformtheuserofthesesituationswhentheyexist.

5. Amessagewilldisplayaskingif youwantto continue.Toproceedwiththeformat,selectOK orpress

Entertocontinue.Toreturnto thepreviousmenu withoutformattingthedisks,select Cancel.

Aftertheformattingiscomplete,thediskswillbeArrayCandidate pdisksandwillbeready forusein PCI-XSCSIDiskArrays.Thisoperation willalso zeroallthedataonthedisks.ThePCI-XSCSIRAID Controllerkeepstrackofthedisksthathave theirdatazeroed.TheseZeroedArrayCandidatepdiskscan beused tocreateadiskarraythatwillbeimmediatelyprotectedagainst diskfailures, andtheyarethe onlydisksthatcanbeaddedtoanexistingdiskarray.An ArrayCandidate pdiskwilllose itsZeroedstate afterithasbeen usedinanarrayor isunconfigured.Itwillalso loseitsZeroedstate afterthesystemhas beenrebooted.ToreturnanArrayCandidatepdiskto theZeroedstate,followthestepspreviously describedinthis sectionforpreparing disksforuseindiskarrays.

Creating

a

PCI-X

SCSI

Disk

Array

Adiskarrayiscreatedusingasetof ActiveArrayCandidatepdisks.For diskarrayswithdataredundancy (RAIDlevel5, 6,and10),ifallof thepdisksareintheZeroedstate,thearraywillbecomeimmediately protectedagainstfailures. However,if oneormoreofthepdisks arenotZeroed, thenewly createdarray willinitiallybeintheRebuildingstate.Itwillbeunprotectedagainst diskfailures untilparitydataonallof thediskshasbeenrecalculated.Fordiskarrayswithnodataredundancy(RAIDlevel0), itisof no importancewhetherthepdisksareintheZeroed state.Tocreatea PCI-XSCSIDiskArray,dothe following:

2. SelectCreateaPCI-XSCSIDiskArray.

3. SelecttheappropriatePCI-XSCSIRAIDControlleronwhichyouwanttocreateanarray.

4. SelecttheRAIDlevelforthearray.Formore informationaboutselectinganappropriateRAIDlevel,

see“SupportedRAIDLevels”onpage 3.

5. Selectthestripesizeinkilobytesfor thearray. Formoreinformationaboutthestripe-sizeparameter,

see“Stripe-UnitSize”onpage8.Aselectionscreensimilarto thefollowingdisplays.Itwilldisplayalist ofArrayCandidatepdisks andnotesregardingarrayrequirements. Theminimumandmaximum numberof supporteddisks willbespecified,alongwithanyother specificrequirements forthearray. 6. Selectthedisksthatyouwanttouseinthearrayaccordingtotherequirementsonthisscreen.

(29)

Create a PCI-X SCSI Disk Array

Move cursor todesired item and press F7. Use arrow keys to scroll.

ONE OR MOREitems can be selected.

Press Enter AFTERmaking all selections.

# RAID 10 supportsa minimum of 2 and a maximum of 18 disks # The totalnumber of disks must be a multiple of 2

pdisk10 30-60-01-1,0 Active Array Candidate 72.8GB pdisk11 30-60-00-4,0 Active Array Candidate 72.8GB pdisk12 30-60-01-8,0 Active Array Candidate 72.8GB pdisk18 30-60-00-2,0 Active Array Candidate 72.8GB

F1=Help F2=Refresh F3=Cancel

F7=Select F8=Image F10=Exit

Enter=Do /=Find n=Find Next

7. ASMITDialog Screensummarizesyourselections.PressEntertocreatethearray.

Youcannow addthediskarraytoa volumegroup.Logical volumesandfile systemscan alsobecreated. UsestandardAIXprocedurestoperformthesetasks,andtreatthearrayinthesamewaythatyouwould treatanyhdisk.

Viewing

the

Disk

Array

Configuration

ToviewtheconfigurationofarraysanddisksassociatedwithaparticularPCI-XSCSIRAIDController, do thefollowing:

2. SelectListPCI-XSCSIDiskArrayConfiguration.

3. Chooseoneor morePCI-XSCSIRAIDControllers.Theoutputdisplayedwillbesimilar tothe

following:

(30)

COMMAND STATUS

Command: OK stdout: yes stderr: no

Before command completion,additional instructions may appear below.

---sisioa1 30-60 Available PCI-XDDR Dual Channel U320 SCSI RAID Adapter

hdisk11 30-60-ff-0,1 Optimal Raid 5 Array 54.3GB

hdisk14 30-60-ff-0,3 Rebuilding Raid 10 Array 72.8GB Create 55%

hdisk15 30-60-ff-0,6 Failed Raid 5 Array 109.2GB

pdisk14 30-60-00-0,0 RWProtected Array Member 36.4GB

pdisk15 30-60-00-9,0 RWProtected Array Member 36.4GB

pdisk16 30-60-00-2,0 Missing Array Member 36.4GB

pdisk17 30-60-00-3,0 Missing Array Member 36.4GB

hdisk16 30-60-ff-0,8 Missing Raid 0 Array 145.6GB

pdisk9 30-60-00-1,0 Active Hot Spare 18.1GB

pdisk10 30-60-01-1,0 Active Array Candidate 72.8GB

pdisk11 30-60-00-4,0 Active Array Candidate 72.8GB Zeroed

pdisk12 30-60-01-13,0RWProtected Array Candidate 72.8GB Format 35%

hdisk20 30-60-01-4,0 Available 16 Bit LVD SCSI 9.0GB

hdisk21 30-60-01-6,0 Defined 16 Bit LVD SCSI 9.0GB

F1=Help F2=Refresh F3=Cancel F6=Command

F8=Image F9=Shell F10=Exit /=Find

n=Find Next

Thecontroller’sname,location,status,anddescription aredisplayedfirst. EachPCI-XSCSIdiskarray

hdiskisdisplayedwithitsArrayMemberpdisks directlyunderneathit.

v Thefirstcolumnof outputisthenameof thediskarray(hdisk)orphysical disk(pdisk).

v Thesecondcolumnof outputisthedevice’slocationcode.Theformatof thelocationcodeis

AB-CD-EF-G,H.TheAB-CDfieldsidentifythelocationof thePCI-XSCSIRAIDController.TheEFvalue identifiestheController’sSCSIbusthatthedevice isattachedto.Foradiskarraythisvaluewillbeff whichindicates alogicalbusfor RAIDdevices.TheG,HvaluesaretheSCSIIDandLogicalUnit Number(LUN)of thedevice.

v Thethirdcolumnof theaboveoutputisthestateofthediskarrayorpdisk.For informationaboutthe

possiblediskarrayandpdiskstates,see“DiskArrayOverview”onpage9. For512byte/sector standalonedisks (hdisks),thiscolumn istheAIXdevice state(for example,Available orDefined).

v Thefourthcolumnisa descriptionofthedevice. Foradiskarray,thedescriptionistheRAIDlevelof

(31)

v Thefifthcolumnisthecapacityofthearrayordisk.For informationabouthowthecapacityof anarray

iscalculatedfor eachRAIDlevel,see“DiskArrayCapacities”onpage 8.

v Thesixthcolumnisthestatusof along-runningcommandissuedto adiskarrayorpdisk.Thiscolumn

isalsoused toindicatethatanArrayCandidatepdiskhashaditsdatazeroed.Thefollowingvalues maybedisplayed:

Createnn%

Diskarrayisinprocessof beingcreated.

Deletenn%

Diskarrayisinprocessof beingdeleted.

Rebuildnn%

Diskarrayisinprocessof beingreconstructed.

Resyncnn%

Diskarrayisinprocessof havingitparitydataresynchronized.

Addingnn%

Diskarrayisinprocessof havingoneormoredisksaddedtoit.

Formatnn%

pdiskisinprocess ofbeingformatted.

Zeroed

pdiskhasbeenzeroed.

ArrayCandidatepdisksandHotSparepdisks aredisplayedat thebottomof thisscreen.Thepdisknames aredisplayed, alongwithlocation,state,description,capacity,andlong-runningcommandstatus.Any512 bytes/sectorstandalone disks(hdisks)aredisplayed,alongwithlocation,state,description,andcapacity.

Deleting

a

PCI-X

SCSI

Disk

Array

Attention: Afteradiskarrayisdeleted, itcannotbeaccessed.Alldatawillbelost.Adiskarraythatis

currentlyinuseoropenedcannotbedeleted.Also,if adiskarraycommand(suchasadiskcreation command)isinprogress,thatdiskarraycannotbedeleted.

Topreservethedataonthediskarray,youmustfirstbackupallfilesinthelogicalvolumesandfile systemsonthediskarraybeforeremovingthediskarrayfromitsvolumegroup.Todeletethearray,do thefollowing:

2. SelectDeletea PCI-XSCSIDiskArray.

3. SelectthePCI-XSCSIRAIDController.

4. Selectthediskarraytodelete.

Whenthediskarrayhasbeen deleted,anyActiveArrayMemberpdiskswillbecomeActiveArray Candidatepdisks.

Adding

Disks

to

an

Existing

Disk

Array

ThePCI-XSCSIRAIDControllersupportsaddingdisksto existingRAIDlevel5or 6diskarrays,which allowsyouto dynamicallyincreasethecapacityof adiskarraywhilepreservingitsexistingdata. Extensive useofthis feature,however,willresultina performancepenalty; becausetheaddeddiskswillnotcontain parityandthedatawillnotberestriped.

(32)

AnArrayCandidatepdiskisnotnecessarilya candidatethatcan beaddedtoanexistingarray.Inaddition tobeinganArrayCandidate, thepdiskmust alsoberecognizedbytheadapterashavingitsdatazeroed. Thissituationensuresthatwhenthedisks areaddedtothearray,theparitydatawillbecorrectandthe arraywillremainprotected againstdiskfailures.

Toadddiskstoanexistingarray, dothefollowing:

1. EnsurethatthediskstobeaddedareZeroedArrayCandidatepdisks. Forassistanceinviewingand

changingthestate ofthedisk,see“PreparingDisksfor UseinPCI-XSCSIDiskArrays”onpage14 and“ViewingtheDiskArrayConfiguration”onpage15.

3. SelectAddDiskstoan ExistingPCI-XSCSIDiskArray.

4. SelectthePCI-XSCSIDiskArraytowhich youwantto adddisks.

5. Ascreenwilldisplaysimilarto thefollowingexample.If aparticulardiskisnotincludedinthelist,it

maynotbea candidatethatcanbeaddedtothearraybecauseofthefollowingreasons:

v Thedisk’scapacityislessthanthatofthesmallestdiskalreadyinthearray.

v Thediskhasnotbeen formattedasa522bytes/sectorArrayCandidate pdisk.

v Thediskdoesnothaveitsdatazeroed.

Forthesecondandthirdcases,thediskcanbeaddedto anarrayif itisfirstformattedusingthe

CreateanArrayCandidate pdiskandFormatto522ByteSectorsoptioninthePCI-XSCSIDisk ArrayManager.

Add Disksto an Existing PCI-X SCSI Disk Array

Move cursor to desireditem and press F7. Use arrow keys to scroll.

ONE OR MOREitems can be selected.

Press Enter AFTERmaking all selections.

# Choose up to14 of the following disks to add to hdisk2

pdisk10 30-60-01-1,0 Active Array Candidate 72.8GB Zeroed pdisk11 30-60-00-4,0 Active Array Candidate 72.8GB Zeroed pdisk12 30-60-01-8,0 Active Array Candidate 72.8GB Zeroed pdisk18 30-60-00-2,0 Active Array Candidate 80.0GB Zeroed

# Note: If a diskis not listed here it is either not a candidate # to be addedto this array or it does not have its data zeroed # Use the Createan Array Candidate pdisk and Format to 522 Byte # Sectors optionto format and zero the disk.

F1=Help F2=Refresh F3=Cancel

F7=Select F8=Image F10=Exit

Enter=Do /=Find n=Find Next

Ascreensummarizesyour selectionsandindicatestheperformancepenaltyassociatedwiththis option.

6. PressEntertoaddthedisksto thearray.Toenablehigherlevelcomponentsinthesystem tousethe

increasedcapacityofthediskarray,additional stepsmightbeneeded.

Using

Hot

Spare

Disks

HotSparedisksareusedto automaticallyreplaceFaileddisksina redundantRAIDenvironment.Hot sparedisksareusefulonlyif theircapacityisgreater thanorequaltothatof thesmallestcapacitydiskin anarray thatbecomesDegraded.

Creating

Hot

Spare

Disks

(33)

2. SelectChange/ShowPCI-XSCSIpdiskStatus.

3. SelectCreateaHotSpare.

5. Selectthepdisksthatyou wantto designateashotspares.Ascreensummarizesyourselections.

6. PressEntertocreatethehotspares.

Thediskstate changesto HotSpare.Onsubsequentdiskfailures,reconstructionof Faileddiskswilloccur automaticallyfor RAIDlevel5,6, and10diskarrays.

Note: If thereisaDegradeddiskarrayat thetime thataHotSpareisconfigured,reconstructionofthe

Faileddiskbeginsautomatically.

Deleting

Hot

Spare

Disks

Todeletea HotSpareandchangethediskto anArrayCandidatepdisk,dothefollowing:

3. SelectDeletea HotSpare.

5. Selectthehotsparestodelete.

TheHotSparebecomesanArrayCandidatepdisk.

Viewing

and

Changing

PCI-X

SCSI

RAID

Controller

Bus

Settings

Toviewandchangesettingsfor thePCI-XSCSIRAIDController,dothefollowing: 1. Atthecommandprompt,typesmit,andpressEnter.

2. SelectDevices.

3. SelectDiskArray.

4. SelectIBM PCI-XSCSIDiskArray.

5. SelectChange/ShowPCI-XSCSIRAIDControllerBus.

6. SelectthePCI-XSCSIRAIDControllerbus thatyouwantto changesettingsonorview.

Change/ShowCharacteristics of a PCI-X SCSI RAID Controller Bus

Type or selectvalues in entry fields. Press Enter AFTERmaking all desired changes.

[Entry Fields]

SCSI Adapter scsi8

Description PCI-X U320 SCSI RAID > Status Available

Location 30-60-00

Adapter cardSCSI ID [7] +# Wide bus enabled yes + Maximum SCSIBus Speed in MB/s 320 + QAS (Quick Arbitration)Capability Enable + Apply changeto DATABASE only no +

F1=Help F2=Refresh F3=Cancel F4=List

F5=Reset F6=Command F7=Edit F8=Image

(34)

Ascreendisplaysinformationaboutthecontrollerbus.Thelast fiveattributesonthescreenare changeable.Thefollowingisinformationregardingeachof theattributes:

AdaptercardSCSIID

SpecifiestheSCSIIDvaluethatthecontrollerwillusetosend commandsasaninitiator device.Ifmulti-initiators aresupported,theSCSIIDthatthecontrollerrespondsto whenacting asa targetdevicewillbespecified.Thisvalueisusuallychangedto avoidaconflictor

duplicationof SCSIIDsamongthecontrollerandotherdevicesontheSCSIbus.Before cablinganynew devicetotheSCSIbus,youshouldverifythatthedevice’sSCSIIDisunique. Ifthecontrollerdoes notsupportmulti-initiators, 7istheonlyvalidvaluefortheSCSIID.

Widebusenabled

Specifieswhether thecontrollerwillnegotiatewiththedevicefora 16-bitdatatransferwidthon theSCSIbus. IfYesisspecified,whichisthedefaultvalue,thecontrollernegotiatesfor16-bit datatransfers.Yescanbespecifiedwhenan8-bitdevice isconnectedthroughan8-bitcable totheSCSIconnector.TheNooptionsets thedata transferwidthto 8bits.UsetheNooption whenolder devicesareconnectedthatmaynothandlethewidedata transferrequest,WDTR, messagesproperly.TheWDTRmessagesareused todetectthedatatransferwidth

capabilitiesofadevice.

MaximumSCSIBusSpeedinMB/s

Thisattributeisusedto limitthemaximumspeedinmegabytespersecond(MB/s)thatthe adapterSCSIbuswilluse.Speed isnegotiatedbetweentheadapterandSCSIdevices.The maximumnegotiatedspeedcannotbegreaterthantheMaximumSCSIBusSpeed inMB/s value.

QAS(QuickArbitration) Capability

Thisattributeisusedto enableordisablethequickarbitrationcapability. EnablingQAS capabilitydoesnotguarantee thatQASwillactuallyoccurfor anydeviceonaSCSIbus.

ApplyChangetoDatabaseonly

Indicateswhethertheconfigurationchangesshouldbeapplied onlyto thedatabaseorto both thedatabaseandthecurrentdevice operation.Fordevicesthatareinuse andcannotbe changed,thisallowsthedatabaseto bechanged forthedeviceandthechangeswilltake effectthenexttimethesystemisrebooted.

(35)

Viewing

PCI-X

SCSI

Disk

Array

Settings

Toviewthesettingsfora PCI-XSCSIDiskArray,dothefollowing:

2. SelecttheChange/ShowCharacteristicsofa PCI-XSCSIDiskArray option.

3. SelectthedesiredPCI-XSCSIDiskArray.

4. ASMITdialogscreendisplaystheattributesoftheselectedarray.Theoutputdisplayedwillbesimilar

tothefollowing:

Change/ShowCharacteristics of a PCI-X SCSI Disk Array

Type or selectvalues in entry fields. Press Enter AFTERmaking all desired changes.

[Entry Fields]

RAID Array

hdisk15

Description SCSI RAID 5 Disk Arra> Status Available

Location 30-60-ff-0,1 Serial Number 12D0E934 Physical volumeidentifier none Queue DEPTH 16 Size in Megabytes 109200 RAID Level 5 Stripe Sizein KB 64

v ThePhysicalvolumeidentifierfield isa uniquevalueassignedto thehdiskifthediskarrayisa

memberof avolumegroup.If thediskarrayisnotamemberofa volumegroup,this fieldvalueisnone.

v TheQueueDEPTHfield isthedepth ofthecommandqueueused forthisdiskarray.

v TheSizeinMegabytes fieldrepresentstheusable capacityof thediskarray.For informationabout

calculatingcapacitiesfor eachRAIDlevel,see“SupportedRAIDLevels”onpage3.

v TheRAIDLevelfieldisthelevelofprotectionchosenforthis array.

v TheStripeSizein KBfield isthenumberofcontiguous kilobyteswhichwillbewrittentoasingle disk

before switchingto thenext diskinthediskarray.It providesthehostwithamethodto tunedata stripingaccordingto thetypicalI/Orequestsize.

Youcannotchangeanyof theattributesonthisscreen.TheRAIDlevelandstripesizemustbespecified whenthearrayiscreated.

Viewing

PCI-X

SCSI

pdisk

Settings

ToviewthePCI-XSCSIpdisksettings,dothefollowing:

3. SelectChange/ShowPCI-XSCSIpdisk.

4. Selecta pdiskfromthelist.

5. Thefollowing attributesaredisplayed:

(36)

Change/Show PCI-X SCSI pdisk Type or select valuesin entry fields.

Press Enter AFTERmaking all desired changes.

[Entry Fields]

Disk pdisk3

Description Physical SCSI Disk Drive Status Available

Location 30-60-00-10,0 Serial Number E3V1W93B

Vendor and ProductID IBM IC35L036UCDY10> Service Level

Size in Megabytes 60400

Format Timeoutin minutes [120] +#

TheSizeinMegabytesfield representsthecapacityofthepdisk.

Todisplayapdisk’sVitalProductData(VPD),dothefollowing:

3. SelectDisplay pdiskVitalProductData.

(37)

Chapter

4. Multi-Initiator

and

High-Availability

TheMulti-InitiatorandHigh-Availabilityoptionprovidesahigh-availabilityenvironment forsystemstorage byenablingtwosystemsto haveaccesstothesamesetof diskarrays.Thisfeatureistypicallyusedwith theIBMHigh-AvailabilityCluster Multiprocessingapplication(HACMP).TheIBMHACMPsoftwareprovides alow-costcommercialcomputingenvironment thatensuresthemission-criticalapplicationscanrecover quicklyfromhardware andsoftwarefailures.

Useof theHighAvailabilityfeaturerequiresadapterandAIX softwaresupport.Theadapterswhichsupport thisHighAvailabilityfeatureareidentifiedinTable1onpage1.TheAIXsoftwaresupportlevelsrequired fortheHighAvailabilityfeatureareidentifiedinTable2onpage11.Theseadapterssupportbeingeitherin asingleadapterconfigurationoraspartof thisdualadapter(HighAvailability)configuration.Theadapter firmwarewilldeterminethecorrectoperatingmode basedupon thepresenceorabsenceofanother compatibleadapter,andwillautomaticallychangetheoperatingmode asneeded.Nomodejumpersor specialconfigurationsettingsareneededto configuretheadapter.

Thisfunctionisonly supportedfor connectionsto diskarraysbetweentwosystemsorpartitions.Itisnot supportedfor connectionstodiskarraysfromtwoadapters inthesamepartitionorsystem.

Oneadapterfunctionsastheprimaryadapterandperformsdirectmanagement ofthephysicaldevices. Thesecondadapterservesasa clientoftheprimaryadapteranddoes notperformreads orwritesto devicesdirectly. Commandsdirected todiskarraysthroughthesecondaryadapterareforwardedthrough theSCSIbus totheprimaryadapterfor execution.Thesecondaryadapterdetects iftheprimaryadapter goesofflineandtransitionsitselftobecometheprimaryadapter.Whentheoriginalprimaryadaptercomes backonline,it nowservesasthesecondaryadapter,unlessit waspreviously designatedasthepreferred primaryadapter.

Whenina HighAvailabilityconfiguration,theadapterbehavior isalteredto enableeasiertransitionof the diskarraysbetweenadapters intheeventofanadapterfailure(or forothercauses).Writecacheonthe adaptersisdisabledinaHighAvailability configurationwhich impactsperformance.Also,ina High Availabilityconfiguration,parityfootprintsarekeptinreservedsectorsof thedevice inaddition to nonvolatileadaptermemory.Bothofthesearedifferentthanthetypical adapterbehavior andare applicableonly iftwoadapters arepresent.Theadapterwillautomatically switchitsbehaviorasneeded basedonthecurrentconfiguration.

Multi

Initiator

and

High

Availability

Configuration

Specifics

v Connectionsto diskarraysmustbebetweentwosystemsorpartitionsandnotbetweentwoadapters in

thesamepartitionorsystem.

v All(pdisks)inthediskarraysmustbesharedbetweenbothadaptersinaHighAvailability configuration.

v Non-pdisk devices,includingtape andoptical,cancontinuetobeconnectednon-sharedto asingle

adapter.

v AdiskarrayinaHighAvailabilityconfigurationcannotbeusedasabootdevice.

v Attachmenttotheshareddiskenclosures mustbefromthesameSCSIbusportconnectionsoneach

adapter.SeeFigure1 onpage 2forreference.

v UnlikeadaptertypescanbeconnectedinaHighAvailabilityconfigurationaslongasbothadaptertypes

areIBMPCI-XSCSIRaidAdaptersandthesameAdvancedFunctionsaresupportedoneachadapter (for example,RAIDlevels).

v Theenduserandtheirapplicationsareresponsibleto ensureorderlyreadandwriteoperationsto the

shareddiskarrays,for example,whenusingdevicereservationcommands(persistentreservationisnot supported).

(38)

Comparison

of

JBOD

(512

byte/sector

standalone

disks

(hdisks))

versus

Disk

Arrays

(522

bytes/sector

disks

(pdisks))

in

High

Availability

Configurations

JBOD(512byte/sectorstandalonedisks(hdisks))

ExternalLow-voltageDifferential Connection

Theinterconnectioncable,whichhasVHDCIconnectors,isprovidedwiththeexternalsubsystem.

DiskArrays(522byte/sectordisks(pdisks))

ExternalLow-voltageDifferential Connection

Theinterconnectioncable,whichhasVHDCIconnectors,isprovidedwiththeexternalsubsystem.

Similarities

between

JBOD

and

Disk

Arrays

in

High

Availability

Configurations:

v BothadaptersinaHighAvailability configurationconnect toshareddiskenclosures.

v BothadaptersinaHighAvailability configurationcanattach512byte/sectorstandalonedisks(hdisks).

v Eachadapter’sSCSIIDmustbesettoa differentvaluewhenconnectedto shareddiskenclosures.

v In theeventof anadapterfailure,thesystemcontainingthefunctionaladaptercanstillaccessthe

shareddisks. T1 T T T0 C1 C1 C0 C0 A _T T T T S S A

Figure6.JBOD(512byte/sectorstandalonedisks(hdisks))

T1 T T T0 C1 C1 C1 C1 C0 C0 C0 C0 A _T T T T S S A Primary Secondary Disk Arrays

(39)

Differences

between

JBOD

and

Disk

Arrays

in

High

Availability

Configurations

v In aJBODHighAvailabilityenvironment,thereisadirectdata pathforeither adapterto theshared

disks.

v In adiskarrayHighAvailabilityenvironment,there isanindirectdatapathfor thesecondaryadapter:

– ThePrimaryadaptercontrolsthediskarraysandhasdirectaccesstothepdisks.

– TheSecondaryadapterdoesnotcommunicatedirectly tothediskarrays,butforwards

commands/datato andfromthedisksarraysviathePrimaryadapter.

– ThePrimaryadapterwilllogerrorsrelatedtoproblemswiththediskarray.Thesearrayerrorswillnot

beforwardedto thesecondaryadapter.

v In adiskarrayHighAvailabilityenvironment,SCSIbus connectionsfromeach adapterto thesharedisk

enclosuremustbefromthesameportoneachadapter.

v In adiskarrayHighAvailabilityenvironment,adapters willautomatically switchroles (primaryto

secondary)asneededtomaintainaccessto thediskarraysandtosatisfy thesystem’sdesirefor preferredprimaryadapter.

TypicalreasonsforthePrimaryandSecondaryto switchroles fromwhatwasexpectedorpreferredare asfollows:

– Adapterswillswitchroles forasymmetric reasons.Forexampleoneadapterdetectsmorediskdrives

thantheother.If theSecondaryadapterisable tofinddevicesthatarenotfound bythePrimary adapter,anautomatictransition(failover)willoccur.Theadapterswillcommunicatewitheach other, comparedeviceinformation, andmakethedecisiontoswitchroles.

– Poweringoff thePrimaryadapterorthesystem/partitionwhichcontainsthePrimaryadapterwill

causeanautomatictransition(failover)to occur.

– FailureofPrimaryAdapteror thesystem/partitionwhichcontainsthePrimaryadapterwillcausean

automatictransition(failover)tooccur.

– IfthepreferredPrimaryadapterisdelayedincomingactive,automatictransition(failover)willoccur.

OncethepreferredPrimaryadapterdoescomeactive,theroleswillswitchback.

– IfthePrimaryadapterlosescontact tothedisksthatarealso accessiblebythesecondary,an

automatictransition(failover)willoccur.

v In adiskarrayHighAvailabilityenvironment,theautomatictransition(failover)willnotoccurfor the

following:

– Microcodedownloadof thePrimaryadapter.

– RecoverableerrorsonthePrimaryadapter.

Performance

Considerations

WritecacheonthePCI-XSCSIRaidadapters isdisabledinanHighAvailability configuration.The performanceimpactsfromthelackofwritecachefunctionwillbegreater whenrunningRaid-5or Raid-6 arrays.PerformanceimpactswillbesomewhatlessifrunningRaid-0or Raid-10arrays.Diskarrayaccess viathesecondaryadaptermust berouted throughtheprimaryadapterwhichwillalsoaffect read/write performance.Additionally,Raidparityfootprintsbeingkept/updatedondiskforRaid5,6,10arrays,will causeperformanceimpacts.

Installation

ThefollowingistherequiredOrderof Installationwhencreatinga Multi-InitiatorHigh-Availability environment.It iscritical topaycloseattention totheinformationcontainedbelowandfollowthesteps exactlyaswrittento avoidproblemsduringinstallation.

1. Beforeproceedingwithphysicallyinstallingthehigh availabilityconfiguration,youmust updatetothe

latestadaptermicrocodefromthecodedownloadwebsite,andto therequiredlevels ofboththeAIX

(40)

versionandtheAIXdriverpackageforyour specificadapters. SeeTable2onpage11fortherequired codelevelsandalso refertotheinstallationinformationfortheadapter.

Attention: Donotinstallanyadapters orattachcablesina Multi-InitiatorHigh-Availability

configurationuntil aftertherequiredcode supportisinstalled. 2. SettheSCSIIDsof theadaptersbeforethey areinstalled.

Attention: AnyattacheddeviceswithSCSIID’sof5 and6willneedtobemovedorremovedbefore

proceedingwiththis step.

WheninstallingaMulti-Initiatorconfiguration,eachadaptermusthave auniqueSCSIIDandmustnot duplicatetheIDof otherdevicesonthesameSCSIbus.RecommendedSCSIIDs forthetwoadapters are5 and6.Referto“ViewingandChangingPCI-XSCSIRAIDControllerBusSettings”onpage19 forsettingtheSCSIID.

3. DiskArrayscanbepreviouslyconfiguredornew arrayscan becreatedafterthehigh-availability

configurationissetup.Ifnew diskarraysarecreatedafterwards,theconfigurationmanagermustbe runonthesystemorpartition containingthesecondaryadapterinorderforit torecognizethenew diskarrays(see8onpage27).

Ifthereareexistingdiskarraysconfiguredontheadaptersthatarebeingused inthehigh-availability configuration,youmustperformanormalpowerdownof thesystem orpartitionpriorto settingupthe high-availabilityenvironment.

4. Performanormalshutdownof thesystem orpartition.

5. Referto theFigure6onpage24andFigure7onpage 24andattachcablesfromtheshareddisk

enclosuresto thesameSCSIbusportoneach adapter.

Somediskenclosures mightrequireachangeto theirconfigurationtosupportadualadapter environmentsothatbothadapterswilldetectallthediskunitsintheenclosureandalsotheother adapter.Referto specificdiskenclosuredocumentationfor details.

Note: Somediskenclosuresmay requireapowercyclefor thechangesto takeaffect.

6. Poweronsystemorpartition andverifyproper portcabling,andthefunctionof adaptersanddisk

arrays.Referto “ViewingtheDiskArrayConfiguration”onpage15.Theoutputdisplayedwillbesimilar tothefollowing.-Verify thatlikebusnumbered bussesareconnectedontheprimaryandremote (secondary)adaptersandtheSCSIIDsaresetto05and06oneachadapterashighlightedbelow.

COMMAND STATUS

Command: OK stdout: yes stderr: no

Before command completion,additional instructions may appear below.

---sisioa0 1V-08 Primary PCI-X Dual Channel U320 SCSI RAID Adapter

scsi4 1V-08-00-06,0 Linked Target on remote adapter is 00-05,0

scsi5 1V-08-01-06,0 Linked Target on remote adapter is 01-05,0

hdisk4 1V-08-ff-0,0 Optimal RAID 0 Array 35.3GB

pdisk1 1V-08-00-1,0 Active Array Member 35.3GB

hdisk5 1V-08-ff-0,1 Optimal RAID 5 Array 141.1GB

pdisk6 1V-08-00-10,0Active Array Candidate 71.4GB

Reference Guide for AIX

PCI-X

SCSI

RAID

Controller

Reference

Guide

for

AIX

PCI-X

SCSI

RAID

Controller

Reference

Guide

for

AIX

Contents

Safety

Information

Handling

Static

Sensitive

Devices

About

This

Book

ISO

9000

Highlighting

References

to

AIX

Operating

System

Related

Publications

Trademarks

Chapter

1.

PCI-X

SCSI

RAID

Controller

Overview

Disk

Arrays

Supported

RAID

Levels

RAID

Level

0

RAID

Level

5

RAID

Level

6

RAID

Level

10

Disk

Array

Capacities

RAID

Level

Summary

Stripe-Unit

Size

Disk

Array

Overview

States

for

Disk

Arrays

(hdisks)

States

for