PCI-X SCSI RAID Controller

(1)

PCI-X SCSI RAID

Controller

Reference Guide for AIX

ESCALA POWER6

REFERENCE

86 A1 59EV 00

(2)

(3)

ESCALA POWER6

PCI-X SCSI RAID

Controller

Reference Guide for AIX

November 2007 BULL CEDOC 357 AVENUE PATTON B.P.20845 49008 ANGERS CEDEX 01 FRANCE

REFERENCE

86 A1 59EV 00

Hardware

(4)

The following copyright notice protects this book under Copyright laws which prohibit such actions as, but not limited to, copying, distributing, modifying, and making derivative works.

Copyright Bull SAS 1992, 2007 Printed in France

Suggestions and criticisms concerning the form, content, and presentation of this book are invited. A form is provided at the end of this book for this purpose. To order additional copies of this book or other Bull Technical Publications, you are invited to use the Ordering Form also provided at the end of this book.

Trademarks and Acknowledgements

We acknowledge the right of proprietors of trademarks mentioned in this book.

AIX is a registered trademark of International Business Machines Corporation, and is being used under licence. UNIX is a registered trademark in the United States of America and other countries licensed exclusively through the Open Group.

Linux is the registered trademark of Linus Torvalds in the U.S. and other countries

The information in this document is subject to change without notice. Bull will not be liable for errors contained herein, or for incidental or consequential damages in connection with the use of this material.

(5)

MAP3000 . . . 64 MAP3010 . . . 64 MAP3011 . . . 67 MAP3012 . . . 69 MAP3013 . . . 70 MAP3020 . . . 72 MAP3021 . . . 74 MAP3030 . . . 75 MAP3031 . . . 76 MAP3032 . . . 80 MAP3033 . . . 82 MAP3034 . . . 82 MAP3035 . . . 85 MAP3036 . . . 86 MAP3040 . . . 87 MAP3041 . . . 88 MAP3050 . . . 90 MAP3051 . . . 95 MAP3090 . . . 96

FindinganSRNGivenanAIXErrorLog . . . 97

ExampleAIXError Log(Error ID=SISIOA_ARY_DEGRADED) . . . 98

AppendixA.Communications Statements . . . 99

FederalCommunicationsCommission(FCC)Statement . . . 99

EuropeanUnion(EU)Statement . . . 99

InternationalElectrotechnicalCommission(IEC)Statement . . . 99

UnitedKingdomTelecommunicationsSafety Requirements . . . 99

AvisdeconformitéauxnormesduministèredesCommunicationsduCanada . . . 100

CanadianDepartmentofCommunications ComplianceStatement . . . 100

VCCIStatement . . . 100

(7)

RadioProtectionfor Germany . . . 100

AppendixB.Notices . . . 103

AppendixC.AIXCommand-LineInterface . . . 105

(8)

(9)

Safety

Information

DANGER

Anelectricaloutletthatis notcorrectlywiredcouldplace hazardousvoltage onmetalpartsof the systemorthe devicesthatattachtothe system.Itisthe responsibilityofthecustomer to ensure thattheoutletis correctlywiredandgroundedto preventanelectricalshock.

Before installingorremovingsignalcables,ensurethatthe powercablesforthe systemunit andallattacheddevicesare unplugged.

Whenaddingorremoving anyadditionaldevicestoorfromthe system,ensurethat thepower cablesforthosedevicesareunplugged beforethe signalcablesareconnected.Ifpossible, disconnectallpowercablesfromtheexistingsystembeforeyouadda device.

Use onehand,when possible,toconnectordisconnectsignalcablestopreventapossible shock fromtouchingtwosurfaceswithdifferentelectricalpotentials.

During anelectricalstorm,donotconnect cablesfordisplaystations,printers,telephones,or station protectorsforcommunicationlines.

(10)

(11)

Handling

Static

Sensitive

Devices

Attention:Static electricitycandamagethis deviceandyoursystemunit.Toavoiddamage,keepthis deviceinitsanti-staticprotectivebaguntil youarereadytoinstall it.Toreducethepossibilityof electrostaticdischarge,followtheprecautionslistedbelow:

v Limityourmovement.Movementcancausestaticelectricityto builduparoundyou. v Handle thedevice carefully,holding itbyitsedgesoritsframe.

v Donottouchsolderjoints, pins,orexposedprintedcircuitry.

v Donotleavethedevicewhereotherscanhandleandpossiblydamagethedevice.

v While thedevice isstillinitsanti-staticpackage,touchitto anunpaintedmetalpartofthesystemunit for atleasttwoseconds.(Thisdrainsstaticelectricityfromthepackageandfromyourbody.)

v Removethedevicefromitspackageandinstall itdirectlyinto yoursystemunitwithout settingitdown.If it isnecessary tosetthedevicedown,placeitonitsstatic-protectivepackage.(If yourdeviceisan adapter,placeit component-sideup.)Donotplacethedeviceonyoursystem unitcoveror onametal table.

v Takeadditionalcarewhenhandlingdevicesduringcoldweather,asheatingreduces indoorhumidity andincreasesstaticelectricity.

(12)

(13)

About

This

Book

Thisbookprovidesusageandmaintenanceinformationregarding thePCI-XSCSIRAIDController. Chapters1 through4ofthis bookcontaingeneralinformationthatisintendedfor allusersof thisproduct. Chapter5containsserviceinformationintended fora servicerepresentativespecificallytrainedonthe systemunitandsubsystembeingserviced.Usethisbookinconjunctionwithyourspecificsystem unitand operatingsystem documentation.

ISO

9000

ISO9000registeredquality systemswere usedinthedevelopmentandmanufacturingof thisproduct.

Highlighting

Thefollowinghighlightingconventionsareusedinthisbook:

Bold Identifiescommands,subroutines,keywords,files,structures,directories,andotheritems whosenamesarepredefinedbythesystem.Alsoidentifiesgraphicalobjectssuchasbuttons, labels,andiconsthattheuserselects.

Italics Identifiesparameterswhoseactualnamesorvaluesaretobesuppliedbytheuser.

Monospace Identifiesexamplesofspecificdatavalues,examplesoftextsimilartowhatyoumightsee displayed,examplesofportionsofprogramcodesimilartowhatyoumightwriteasa programmer,messagesfromthesystem,orinformationyoushouldactuallytype.

References

to

AIX

Operating

System

ThisdocumentmaycontainreferencestotheAIXoperating system.If youareusinganotheroperating system,consult theappropriatedocumentationfor thatoperatingsystem.

Thisdocumentmaydescribehardwarefeaturesandfunctions.Whilethehardware supportsthem,the realizationofthesefeaturesandfunctionsdependsupon supportfromtheoperating system.AIXprovides thissupport.Ifyou areusinganotheroperatingsystem,consulttheappropriatedocumentation forthat operatingsystem regardingsupportforthosefeaturesandfunctions.

Publications

Thefollowingpublicationscontainrelatedinformation:

v Systemunitdocumentationfor informationspecifictoyourhardware configuration

v RS/6000Eserver pSeriesAdapters,Devices,andCableInformationfor MultipleBusSystems,order numberSA38-0516,containsinformationaboutadapters, devices,andcables foryoursystem. v

RS/6000Eserver pSeriesDiagnosticInformationforMultipleBusSystems,ordernumberSA38-0509, containsdiagnosticinformation,service requestnumbers(SRNs),andfailingfunction codes(FFCs). Available ontheinternetathttps://techsupport.services.ibm.com/server/library

v AIXSystemManagement Guide:OperatingSystemandDevicesandAIXInstallationGuideand

Reference,availableontheinternetathttps://techsupport.services.ibm.com/server/library v TheRAIDbook:AHandbookof StorageSystems Technology,Edition6,Editor:PaulMassiglia

(14)

Trademarks

ThefollowingtermsaretrademarksofInternationalBusinessMachinesCorporationintheUnitedStates, othercountries,orboth:

v AIX v AIX5L v Eserver v PowerPC v pSeries v RS/6000

(15)

Chapter

1. PCI-X

SCSI

RAID

Controller

Overview

ThePCI-XSCSIRAIDControllerisa64-bitPCI-Xadapter.Thisadapterhasthefollowingfeatures: v

PCI-Xsysteminterface

v DualorQuadChannel,Ultra320SCSIcontrollers

v Embedded PowerPCRISCProcessor,hardware XORDMAEngine,andhardwareFiniteFieldMultiplier (FFM)DMAEngine(forRAIDlevel6)

v Non-volatilewritecache

v Support forRAID(RedundantArrayofIndependent Disks)levels0, 5,6, and10diskarrays v Diskarraysupportedasabootabledevice

v Supportsattachmentof otherdevicessuchasnon-RAIDdisks, tape,andopticaldevices v AdvancedRAIDfeatures:

– Hotsparesfor RAIDlevel5, 6,and10diskarrays

– AbilitytoincreasethecapacityofanexistingRAIDlevel5or6 diskarraybyaddingdisks – Backgroundparitychecking

– Backgrounddatascrubbing

– Disksformattedto522bytes/sector,providingLongitudinalRedundancyChecking(LRC)and LogicallyBadBlockchecking

Table1.RAIDControllercardsbyCustomCardIdentificationNumber(CCIN)

CCIN (CustomCard Identification Number) PCI Form Factor Channels RAID Levels Supported WriteCache Size ReadCache Size Multi Initiatorand High Availability Support Auxillary Cache Support

AdapterLED/FFC Cache BatteryPack Technology Cache BatteryPack Concurrent Maintenance Cache Battery PackFFC 27809 Yes 4 0,5,and 10 Upto757MB (compressed) Upto1024 MB (compressed)

No Yes 2527 LiIon Yes 2D01

5703,1975 Yes 2 0,5,and 10 40MB 0MB Yes3 _No ₂₅₂₃ _NiMH _No ₂₅₂₆ 57091_,₁₉₇₆1 _No2 ₂ _0,_5,_and 10 16MB 0MB No No 2523 NiMH No 2526 571B,1913 Yes 2 0,5,6and 10 90MB 0MB Yes3 _No ₂₅₁₄ _LiIon _No _2D03

571E9 _Yes ₄ _0,_5,₆_and

10

Upto1.5GB (compressed)

Upto1.6GB (compressed)

No Yes 2512 LiIon Yes 2D01 572E No4 ₂ ₀_and₁₀ ₀_MB ₀_MB _No _No _252B _NA _NA _NA 573D1_,₁₉₀₈1 _No2 ₂ _0,_5,_and 10 40MB 0MB No No 2529 NiMH No 2526 571F/575B5,9 _Yes5 ₄6 _0,_5,₆_and 10 Upto1.5GB (compressed) Upto1.6GB (compressed)

No Yes 2513/252E LiIon Yes7 _2D06

574F8,9 _Yes ₁ _NA _Up_to_1.5_GB

(compressed)

0MB No Yes 2D07 LiIon Yes 2D01

1

TheCCINdescribestheRAIDEnablementCard.

2_Some_PCI-X_SCSI_RAID_Controllers_do_not_have_the_form_of_a_standard_PCI_adapter._The_form_of_these_controllers_is_a_combination_of_SCSI_and_PCI-X_bus_interface_logic

integratedontothesystemboardandaRAIDEnablementCard.ThecardplugsintothesystemboardinordertoconnecttotheSCSIandPCI-Xbusinterfacelogic.

3_For_Multi_Initiator_and_High_Availability_information,_see_Chapter_4,_{“Multi-Initiator}_and_{High-Availability,”}_on_page_25.

4_This_PCI-X_SCSI_RAID_Controller_is_integrated_onto_the_system_board_and_attaches_to_Serial_Attached_SCSI_(SAS)_disks_via₃_Gb_connections. 5_Double-wide_adapter_which_takes_up_two_PCI-X_slots._It_is_composed_of_both_a_storage_I/O_adapter_(571F)_and_an_Auxiliary_Cache_adapter_(575B).

6_Three_channels_available_for_external_device_attachment._One_internal_channel_dedicated_to_Auxiliary_Cache_attachment._See_the_“Auxiliary_Cache”_on_page₁₀_section_for

moreinformation.

7_The_Cache_Battery_Pack_for_both_adapters_is_contained_in_a_single_battery_FRU_which_is_physically_located_on_the_575B_Auxiliary_Cache_card.

8_This_is_a_standalone_Auxiliary_Cache_adapter_which_should_be_connected_to_the_last_SCSI_port_of_either_a₂₇₈₀_or_571E_storage_I/O_adapter._See_the_“Auxiliary_Cache”_on

page10sectionformoreinformation.

9_This_adapter_is_only_supported_in_an_AIX_partition_on_an_iSeries_or_System_i_server.

Note: This guiderefersto varioushardwareandsoftwarefeaturesandfunctions.Therealizationofthese featuresandfunctionsdepends onthelimitationsofyourhardwareandsoftware.AIXsupports all functionsmentioned.If youareusinganotheroperatingsystem,consulttheappropriate

(16)

documentation forthatoperatingsystem regardingsupportforthementionedfeaturesand functions.Thisguidealsousesthetermschannel andbusinterchangeably.

1 Channel1 external,68-position,VHDCI(veryhigh densitycableinterconnect) 2 Channel0 external,68-position,VHDCI(veryhigh densitycableinterconnect)

3 Channel0 internal,68-position,high-densityplasticD-shellSCSIstandardconnectorfor16-bit attachment

4 Channel1 internal,68-position,high-densityplasticD-shellSCSIstandardconnectorfor16-bit attachment

5 AdapterHandle

Disk

Arrays

RAIDtechnologyisusedto storedataacrossagroup ofdisksknownasadiskarray.Depending onthe RAIDlevelselected,thisstoragetechniqueprovidesthedataredundancyrequiredtokeep datasecure andthesystemoperational.Ifa diskfailureoccurs,thediskcanusuallybereplacedwithout interrupting normalsystemoperation.Disk arraysalso havethepotentialto providehigherdata transferandinput and output(I/O)rates thanthoseprovided bysingle largedisks.

Eachdiskarray canbeused byAIXinthesamewayasit wouldasinglenon-RAIDdisk.Forexample, aftercreatingadiskarray,youcancreateafilesystem onthediskarrayoruseAIXcommands tomake thediskarrayavailableto thesystembyaddingthediskarrayto avolumegroup.

ThePCI-XSCSIRAIDControllerismanagedbythePCI-XSCSIDiskArrayManager.ThePCI-XSCSI DiskArrayManagerservesastheinterface totheRAIDconfiguration.Itisalsoresponsibleforthe monitoringandrecoveryfeaturesofthecontroller.

Ifadiskarrayistobeusedasthebootdevice,it mayberequiredtopreparethedisksbybootingfrom theDiagnosticCDandcreatingthediskarraybeforeinstallingAIX.You mightwanttoperformthis procedurewhentheoriginalbootdriveisto beused aspartof adiskarray.

Thefollowingfigureillustratesa possiblediskarrayconfiguration.

(17)

Supported

RAID

Levels

TheRAIDlevelofa diskarraydetermineshow dataisstoredonthediskarrayandthelevelofprotection thatisprovided.Whenapartof theRAIDsystem fails,differentRAIDlevelshelpto recoverlostdatain differentways.WiththeexceptionofRAIDlevel0,ifa singledrivefailswithinanarray,thearraycontroller canreconstructthedatafortheFaileddiskbyusingthedatastoredonotherharddriveswithinthearray. Thisdatareconstructionhaslittleornoimpacttocurrentsystemprogramsandusers.ThePCI-XSCSI RAIDControllersupports RAIDlevels 0,5, 6,and10.EachRAIDlevelsupportedbythePCI-XSCSI RAIDControllerhasitsown attributesandusesadifferentmethodofwriting data.Thefollowing informationdetailseachsupportedRAIDlevel.

(18)

RAID

Level

0

RAIDlevel0 stripesdataacrossthedisksinthearray,for optimalperformance.For aRAIDlevel0 array ofthreedisks, datawouldbewritteninthefollowingpattern.

RAIDlevel0 offersahighpotentialI/Orate,butitisanonredundantconfiguration.As aresult,thereisno dataredundancyavailablefor thepurposeof reconstructingdataintheeventofa diskfailure.Thereisno errorrecovery beyondwhatisnormallyprovidedonasingledisk.Unlikeother RAIDlevels, thearray controllernever marksa RAIDlevel0 arrayasDegradedastheresultof adiskfailure.Ifaphysicaldisk failsinaRAIDlevel0diskarray,thediskarrayismarkedasFailed.Alldata inthearraymust bebacked upregularly toprotectagainstdataloss.

(19)

RAID

Level

5

RAIDlevel5 stripesdataacrossalldisksinthearray.RAIDlevel5also writesarrayparitydata.Theparity dataisspreadacrossallthedisks.For aRAIDlevel5arrayof threedisks,arraydataandparity

informationarewritteninthefollowingpattern:

IfadiskfailsinaRAIDlevel5array,you cancontinueto usethearraynormally.ARAIDlevel5array operatingwithasingleFaileddiskissaid tobeoperatinginDegradedmode.Wheneverdataisreadfrom aDegradeddiskarray, thearraycontrollerrecalculatesthedataontheFaileddiskbyusingdataand parityblocks ontheoperationaldisks.If aseconddiskfails,thearraywillbeplacedintheFailedstate and willnotbeaccessible.

RAID

Level

6

RAIDlevel6 stripesdataacrossalldisksinthearray.RAIDlevel6also writesarray“P”and“Q”parity data.ThePandQparitydata, whichisbasedonReedSolomonalgorithms,isspreadacrossallthe disks.Fora RAIDlevel6 arrayoffourdisks,arraydataandparityinformationarewritten inthefollowing pattern:

(20)

Ifoneortwo disksfailina RAIDlevel6 array,youcancontinueto usethearraynormally.ARAIDlevel6 arrayoperatingwithaoneortwo Faileddisksissaid tobeoperatinginDegradedmode.Wheneverdata isreadfroma Degradeddiskarray,thearraycontrollerrecalculatesthedataontheFaileddisk(s) byusing dataandparityblocks ontheoperationaldisks.ARAIDlevel6 arraywitha singleFaileddiskhassimilar protectiontothatofa RAIDlevel5array withnodiskfailures. Ifathirddiskfails,thearraywillbeplaced intheFailedstateandwillnotbeaccessible.

Disk 1 Disk 2 Disk 3 Disk 4

(21)

RAID

Level

10

RAIDlevel10usesmirroredpairs toredundantlystore data.Thearraymust containanevennumberof disks.Twoistheminimumnumberof disksneededtocreateaRAID10array.Thedataisstripedacross themirroredpairs.Forexample,aRAIDlevel10arrayof fourdiskswouldhavedatawrittento itinthe followingpattern:

RAIDlevel10toleratesmultiplediskfailures. Ifonediskineach mirroredpairfails,thearraywillstillbe functional,operatinginDegradedmode.Youcancontinuetousethearraynormallybecausefor each

Faileddisk,thedataisstoredredundantlyonitsmirroredpair.However, ifbothmembers ofamirrored pairfail,thearraywillbeplacedintheFailedstate andwillnotbeaccessible.

WhenaRAIDlevel10diskarrayiscreated,thecontrollerwillautomaticallyattemptto selectthedisks for eachmirroredpairfromadifferentSCSIbus.Forexample,if fourdisksselectedfor thediskarrayreside ononeof thecontroller’sSCSIbusesandanotherfourdisksselectedresideonanotherof thecontroller’s SCSIbuses,thecontrollerwillautomaticallyattemptto createeach mirroredpairfromonediskoneach SCSIbus.Intheeventofa SCSIbus failure,eachmirroredpairwillcontinuetooperateinaDegraded

mode.

(22)

Disk

Array

Capacities

Thecapacityof adiskarraydependsonthecapacityofthedisksusedandtheRAIDLevelofthearray. Tocalculatethecapacityof adiskarray,dothefollowing:

RAIDLevel 0

Multiplythenumberofdisksbythediskcapacity. RAIDLevel 5

Multiplyonefewerthanthenumberofdisksbythediskcapacity. RAIDLevel 6

Multiplytwo fewerthanthenumberofdisksbythediskcapacity. RAIDLevel 10

Multiplythenumberofdisksbythediskcapacityanddivide by2.

Note: If disksofdifferentcapacitiesareused inthesamearray,alldisksaretreatedasiftheyhave the capacityof thesmallestdisk.

RAID

Level

Summary

Thefollowinginformationprovidesdataredundancy, usablediskcapacity,readperformance,andwrite performanceforeach RAIDlevel.

RAIDLevel DataRedundancy UsableDisk Capacity

ReadPerformance WritePerformance

RAID0 None 100% VeryGood Excellent

RAID5 VeryGood 67%to94% VeryGood Good

RAID6 Excellent 50%to89% VeryGood FairtoGood

RAID10 Excellent 50% Excellent VeryGood

RAIDLevel 0

Doesnotsupportdataredundancy, butprovidesapotentially higherI/Orate. RAIDLevel 5

Createsarrayparityinformationsothatthedatacanbereconstructedifa diskinthearrayfails. ProvidesbettercapacitythanRAIDlevel10butpossiblylowerperformance.

RAIDLevel 6

Createsarray“P”and“Q”parityinformation,usingReedSolomonalgorithms,sothatthedatacan bereconstructedifoneor twodisksinthearray fail.Providesbetterdataredundancy thanRAID level5 butwithslightlylowercapacityandpossiblylowerperformance.Provides bettercapacity thanRAIDlevel10butpossiblylowerperformance.

RAIDLevel 10

Storesdataredundantlyonmirroredpairstoprovidemaximumprotectionagainstdiskfailures. ProvidesgenerallybetterperformancethanRAIDlevel5 or6, buthaslowercapacity.

Stripe-Unit

Size

WithRAIDtechnology, dataisstripedacrossanarrayof physicaldisks.Thisdatadistribution scheme complementsthewaytheoperatingsystem requestsdata.Thegranularityatwhichdata isstoredonone diskof thearraybeforesubsequent dataisstoredonthenext diskof thearrayiscalledthestripe-unit size.Thecollectionof stripeunits,fromthefirstdiskofthearraytothelastdiskof thearray,iscalleda

stripe.

Youcansetthestripe-unitsizeof aPCI-XSCSIDiskArrayto16KB,64KB,or256KB.Youmaybeable tomaximizetheperformanceof yourPCI-XSCSIDiskArraybysettingthestripe-unitsizetoavaluethat

(23)

isslightlylarger thanthesizeoftheaveragesystem I/Orequest.Forlargesystem I/Orequests,usea stripe-unitsizeof 256KB.Therecommendedstripesizeformost applicationsis64KB.

Disk

Array

Overview

Diskarraysaregroupsofdisksthatworktogetherwitha specializedarraycontrollerto potentiallyachieve higherdatatransferandinput andoutput(I/O)ratesthanthoseprovidedbysinglelargedisks.Thearray controllerkeepstrack ofhow thedataisdistributedacrossthedisks.RAIDlevel5,6, and10diskarrays alsoprovidedataredundancy, sothatnodataislostif asinglediskinthearrayfails.

PCI-XSCSIDiskArraysareassignednamesusingthehdiskform,thesameasotherdiskstorageunitsin AIX.Thesenamesareautomaticallyassignedwheneveryoucreateadiskarray.Thenamesaredeleted whenyoudeletethediskarray.Theindividual physicaldisksthatcomprisediskarraysorserveas

candidatesto beused indiskarraysarerepresentedbypdisknames.Apdiskisadiskthatisformatted to 522bytes/sector.Disksthatareformattedto 512bytes/sectorareassignednamesusingthehdiskform. Thesedisksmust beformatted to522bytes/sectorbeforetheycan beused indiskarrays.Foradditional informationaboutformatting512bytes/sectorhdisks tomakethemavailablefor useinPCI-XSCSIDisk Arrays,see“PreparingDisksforUseinPCI-XSCSIDiskArrays” onpage 16.

TheListPCI-XSCSIDiskArrayConfigurationoptioninthePCI-XSCSIDiskArrayManagercanbe usedto displaythesepdiskandhdisknames,alongwiththeirassociatedlocationcodes.For details regardinghowto viewthediskarrayinformation,see “ViewingtheDiskArrayConfiguration”onpage17. Thefollowingsampleoutputisdisplayed whentheListPCI-XSCSIDiskArrayConfigurationoptionis invoked.

---Name Location State Description Size

---sisioa1 30-60 Available PCI-XDDR Dual Channel U320 SCSI RAID Adapter

hdisk15 30-60-ff-0,1 Optimal Raid 5 Array 54.3GB

pdisk0 30-60-00-5,0 Active Array Member 18.1GB

hdisk16 30-60-ff-0,2 Degraded Raid 6 Array 72.8GB

pdisk3 30-60-00-10,0Active Array Member 36.4GB

pdisk5 30-60-01-5,0 Failed Array Member 36.4GB

pdisk7 30-60-00-12,0Active Array Candidate 36.4GB

pdisk8 30-60-00-13,0Active Hot Spare 72.8GB

hdisk20 30-60-01-4,0 Available 16 Bit LVD SCSI 9.0GB

hdisk21 30-60-01-6,0 Defined 16 Bit LVD SCSI 9.0GB

Thethirdcolumnintheprecedingoutputdisplaysthestate ofthedevice.

States

for

Disk

Arrays

(hdisks)

Thesixvalidstatesfor PCI-XSCSIDiskArraysare:Optimal,Degraded,Rebuilding,Failed,Missing,and

Unknown. Optimal

Thearrayisfunctionalandfullyprotected(RAID5,6, and10)withallArrayMemberpdisksinthe

Activestate.

(24)

ormoreArrayMemberpdisksareintheFailedstate,thearrayisstillfunctionalbutmightno longerbefullyprotected againstdiskfailures.For moreinformationaboutrecoveryproceduresfor diskfailures, see“RecoveryProceduresfor DiskFailures”onpage59.WhenallArrayMember pdisksareintheActivestate,thearrayisnotperformingoptimallybecauseofa problemwiththe controller’snonvolatilewritecache.

Rebuilding

Redundancydataforthearrayisbeingreconstructed.Aftertherebuildprocesshascompleted,the arraywillreturntotheOptimalstate.Untilthen,thearrayisnotfullyprotected againstdisk

failures.

Failed Thearray isnolongeraccessiblebecauseofdiskfailuresor configurationproblems.

Missing

Apreviouslyconfigureddiskarraynolongerexists.

Unknown

Thestate ofthediskarraycouldnotbedetermined.

States

for

Physical

Disks

(pdisks)

Thevalidstatesfor pdisksare:Active,RWProtected,Failed,Missing,andUnknown.

Active Thediskisfunctioningproperly.

RWProtected

Thediskisunavailablebecauseof ahardwareor aconfigurationproblem.

Failed Thecontrollercannotcommunicatewiththediskorthepdiskisthecauseof thediskarraybeing ina Degradedstate.

Missing

Thediskwaspreviouslyconnectedto thecontrollerbutisnolongerdetected.

Unknown

Thestate ofthediskcouldnotbedetermined.

pdisk

Descriptions

Thefourthcolumnintheprecedingoutputisadescriptionof thedevice. Foranarray,thedescription indicatestheRAIDlevelof thearray.Thedescriptionof apdiskindicateswhetherthediskisconfiguredas anArrayMember,Hot Spare,oranArrayCandidate.

ArrayMember

A522bytes/sectorpdiskthatisconfiguredasamemberofanarray.

HotSpare

A522bytes/sectorpdiskthatcanbeusedbythecontrollertoautomaticallyreplacea Faileddisk ina DegradedRAIDlevel5,6, or10diskarray.AHotSparediskisusefulonly ifitscapacityis greaterthanorequalto thecapacityof thesmallestdiskinanarraythatbecomesDegraded.For moreinformationabouthotsparedisks, see“UsingHotSpareDisks”onpage 20.

ArrayCandidate

A522bytes/sectorpdiskthatisacandidatefor becominganArrayMemberoraHot Spare.

Auxiliary

Cache

TheAuxiliaryWriteCacheadapter(AWC)providesaduplicate,non-volatilecopyof writecachedataof the RAIDcontrollerto whichitisconnected.Protection ofdataisenhancedbyhaving twobatterybacked (non-volatile)copies ofwritecacheeach storedonseparateadapters. Ifafailureoccursto thewritecache portionoftheRAIDcontroller,or theRAIDcontrolleritselffailsinsucha waythatthewritecachedata is notrecoverable,theAWCadapterprovidesabackupcopyofthewritecachedata topreventdataloss duringtherecovery ofthefailedRAIDcontroller.Thecachedataisrecoveredtothenew replacement

(25)

RAIDcontrollerandthenwrittenouttodiskbeforeresumingnormaloperations.TheAWC adapterisnota failoverdevicethatcankeep thesystemoperationalbycontinuingdiskoperationswhentheattached RAIDcontrollerfails.Thesystem cannotusetheauxiliarycopyofthecachefor runtimeoperationseven if onlythecacheontheRAIDcontrollerfails.TheAWCadapterdoes notsupportanyotherdevice

attachmentandperformsnoothertasksthan communicatingwiththeattachedRAIDcontrollerto receive backupwritecachedata.Thepurposeof theAWCistominimizethelengthofanunplannedoutage,due toa failureof aRAIDcontroller,bypreventinglossofcritical datawhichmayhave otherwiserequireda systemreload.

Shoulda failureof eithertheRAIDcontrolleror theAuxiliaryCacheoccur,it isextremelyimportant thatthe MaintenanceAnalysisProcedures(MAPs)fortheServiceRequestNumbers(SRNs)intheAIXerrorlog befollowedprecisely.Needed serviceinformationcanbefoundinChapter6, “ProblemDeterminationand Recovery,”onpage61.

TheRAIDcontrollerandtheAWCadaptereachrequireaPCI-Xslotandarerequiredtobeinthesame partition.ThetwoadaptersareconnectedbyaninternalSCSIconnection.This dedicatedSCSIbusruns inUltra4mode (U320).

IftheAWCadapteritselffailsor thelinkbetweenthetwo adaptersfails,theRAIDcontrollerwillstop cachingoperations,destage existingwritecachedatatodisk,andrunina performancedegradedmode. OncetheAWC isreplacedorthelink isreestablished,theRAIDcontrollerwillautomatically recognizethe AWC,synchronizethecachearea,resumenormalcachingfunction,andresumewriting theduplicate cachedatatotheAWC.

TheAWCadapteristypicallyusedinconjunctionwithRAIDprotection.RAIDfunctionsarenotaffectedby theattachmentofanAWC.Because theAWCdoesnotcontrolotherdevicesoverthebusand

communicatesdirectly withit’sattached RAIDcontrollerdirectlyovera dedicatedSCSIbus, ithaslittle,if any,performanceimpactonthesystem.

TheAWCadaptermaybedirectlymatedwithitsassociatedstorageI/Oadapter(i.e.571F/575Badapters) ortheAWCadaptermaybestandalone(i.e.574F)withaSCSIcableconnectingit toitsassociated storageI/Oadapter(i.e.2780 or571E).

Installation

ThefollowingistherequiredOrderof InstallationwhencreatinganAuxiliaryCacheenvironment.It is criticalto paycloseattentionto theinformationcontainedbelowandfollowthestepsexactlyaswrittento avoidproblemsduringinstallation.

(26)

1. DiskArrayscanbepreviouslyconfiguredornew arrayscan becreatedaftertheAuxiliaryCache environmentconfigurationissetup.

2. EnsureboththestorageI/OadapterandAWCadapterareinstalledinthesamepartiitionandinthe sameenclosure.

Attention: WhenworkingwithsepearatestorageI/OandAWCadapters(i.e.2780 or571E

connectedtoa 574FAWC),donotinstalltheconnectingSCSIcablebetweenthestorageI/Oadapter andAWCadapteruntilaftertherequiredcodesupportisinstalled.

3. Youmustupdateto thelatestadaptermicrocodefromthecodedownloadwebsite,andtotherequired levelsofboth theAIXversionandtheAIXdriverpackageforyourspecificadapters. SeeTable2on page13fortherequiredcodelevelsandalso refertotheinstallationinformationfortheadapter. 4. WhenworkingwithsepearatestorageI/OandAWCadapters(i.e.2780or 571Econnectedtoa574F

AWC),powerdownthesystemorpartitionandinstall theSCSIcablebetweenthelast portof the storageI/Oadapter(i.e.farthestfromtheendwheretheCache BatteryPackresides)andtheAWC SCSIport.

5. Poweronthesystemorpartitionandverifycorrectportcabling,andthefunctionof adaptersanddisk arrays.Referto “ViewingtheDiskArrayConfiguration”onpage17.Theoutputdisplayedwillbesimilar tothefollowingscreenexamples(thefirstexamplescreenisfor thestorageI/Oadapterwhilethe secondexamplescreenisfor theAWCadapter).

6. VerifythatbothadaptersindicatetheyareAvailable andLinked totheotheradapter,andthatallarrays indicateOptimal.

+---—–– | COMMAND STATUS

|

|Command: OK stdout: yes stderr: no

|

|Before command completion,additional instructions may appear below. |

|---|Name Location State Description Size

|---|sisioa4 0I-08 Available PCI-XDDR Quad Channel U320 SCSI RAID Adapter

| scsi19 0I-08-03-07,0Linked Target on remote adapter is 01-06,0

|

|hdisk4 0I-08-ff-0,0 Optimal RAID 5 Array 175.6GB

| pdisk34 0I-08-02-0,0 Active Array Member 35.1GB

| | +---– +---– | COMMAND STATUS |

|Command: OK stdout: yes stderr: no

|

|Before command completion,additional instructions may appear below. |

|---|Name Location State Description Size

|---|sisioa5 0J-08 Available PCI-XDDR Auxiliary Cache Adapter

| scsi20 0J-08-01-06,0Linked Target on remote adapter is 03-07,0

| |

(27)

Chapter

2. PCI-X

SCSI

RAID

Controller

Software

ForthePCI-XSCSIRAIDControllerto beidentifiedandconfiguredbyAIX,therequisitedevicesupport softwaremust beinstalled.TherequisitesoftwareforthePCI-XSCSIRAIDControllerisoften preinstalled aspartof thenormalAIX installation.However, itmay benecessaryto performoperationsrelatedtothe installation,verification,andmaintenanceoftheAIXdevice softwarefor thePCI-XSCSIRAIDController. SoftwareforthePCI-XSCSIRAIDControllerispackagedininstallpformat anddistributedaspartof the baseAIXinstallationmedia,AIXupdatemedia,andthroughtheweb-based FixDeliveryCenterforAIX. Thisinformationisanoverviewof theAIXsoftwaresupportrequiredfor thePCI-XSCSIRAIDController. ForcompleteinformationrelatedtotheinstallationandmaintenanceofAIX,refertotheAIXInstallation GuideandReference.

ThePCI-XSCSIRAIDControllerexecutesonboardmicrocode.TheAIXcommandlsmcodecanbeused todeterminethelevelof onboardmicrocodebeingused bythecontroller.Althougha versionofcontroller microcodemaybedistributedalongwithAIX,this doesnotnecessarilyrepresentthemostrecentversion ofmicrocodeavailablefor thecontroller.For moreinformationregardingobtaininganddownloadingnew PCI-XSCSIRAIDControllermicrocode,see“UpdatingthePCI-XSCSIRAIDControllerMicrocode”on page32.

Verifying

the

Installation

of

the

PCI-X

SCSI

RAID

Controller

Software

Supportfor thePCI-XSCSIRAIDControlleriscontainedintheAIXpackagedescribedbythetable below. Thedevicesupportpackagecontainsmultiplefilesets,each relatedto adifferentaspectof devicesupport (forexample,run-timeenvironment,diagnosticssupport,andcontrollermicrocode).

Thesepackagecanbedownloadedfromhttp://techsupport.services.ibm.com/server/mdownload2/ adapter.html

Table2.AIXsoftwarerequirementsbyCustomCardIdentificationNumber CCIN(CustomCard

IdentificationNumber)

AIXPackage MinimumRequiredAIXVersion

2780 devices.pci.14106402 5.2 5703,1975 devices.pci.14107802 5.1 5.2 ML_07* or 5.3 ML_03* 5709,1976 devices.pci.14107802 5.1 571B,1913 devices.pci.1410be02 5.2 571E devices.pci.1410bf02 5.2ML_08or5.3ML_04 572E devices.pci.14108d02 5.2 573D,1908 devices.pci.1410d402 5.2 571F/575B devices.pci.1410d502 5.2ML_10or5.3ML_06 574F devices.pci.14100c03 5.2ML_10or5.3ML_06 *MiniumlevelrequiredforMultiInitiatorandHighAvailabilitysupport.

Attention: Ensuretheadaptersareupdatedwiththelatestmicrocodefromthecodedownloadwebsiteaspartof

theinitialinstallation.Gotohttp://techsupport.services.ibm.com/server/mdownload2/adapter.html

ToverifythatthedevicesupportpackageforthePCI-XSCSIRAIDControllerisinstalled,typeasan example:

(28)

Outputfromthiscommandwillindicateifdevice supportsoftwarefor thePCI-XSCSIRAIDControlleris installed,andifso,whatthecorrespondinglevels ofeach filesetare.

Iftheoutputindicates thatnofilesetsofthisname areinstalled,you mustinstalltheappropriatepackage inorderfor thePCI-XSCSIRAIDControllertobemade availableforuse.Thissoftwarepackageis availableaspartof thebaseAIXinstallationmedia,AIXupdatemedia,andthroughtheweb-based Fix DeliveryCenterforAIX.

Overtime, itmaybecome necessarytoinstallsoftwareupdatesinordertohave thevery latestavailable levelofdevicesoftwaresupportforthePCI-XSCSIRAIDController.Updatesto thedevicesupport softwarearepackaged,distributed,andinstalledthroughthesamemechanismsused forotherportionsof theAIXbaseoperating system.ThestandardAIXtechnicalsupportprocedurescanbeusedto determine thelatestavailablelevelof devicesoftwaresupportfor thePCI-XSCSIRAIDController.

(29)

Chapter

3. Common

PCI-X

SCSI

RAID

Controller

Tasks

Theinstructionsinthischapterpertaintothevarioustasksthatcanbeperformedinordertomanagedisk arrays.

Using

the

PCI-X

SCSI

Disk

Array

Manager

ThePCI-XSCSIDiskArrayManagercan beaccessedeither throughtheSystemManagement Interface Tool(SMIT),orfor sometasks,theAIX commandline. Forinformationabout usingthecommandline interface,seeAppendixC,“AIXCommand-LineInterface,” onpage 105.ThePCI-XSCSIDiskArray ManagercanalsobestartedfromDiagnostics.

TostartthePCI-XSCSIDiskArrayManager, dothefollowing: 1. Atthecommandprompt,typesmit,andpressEnter. 2. SelectDevices.

3. SelectDiskArray.

4. SelectIBM PCI-XSCSIDiskArray.Fromthemenuwithoptionsforconfiguringandmanagingthe PCI-XSCSIRAIDController,select PCI-XSCSIDiskArrayManagertodisplaythefollowingmenufor managingdiskarrays.

PCI-X SCSI Disk Array Manager

Move cursor todesired item and press Enter.

List PCI-X SCSIDisk Array Configuration

Create an ArrayCandidate pdisk and Format to 522 Byte Sectors Create a PCI-XSCSI Disk Array

Delete a PCI-XSCSI Disk Array

Add Disks toan Existing PCI-X SCSI Disk Array Configure a DefinedPCI-X SCSI Disk Array

Change/Show Characteristicsof a PCI-X SCSI Disk Array Reconstruct aPCI-X SCSI Disk Array

Change/Show PCI-XSCSI pdisk Status Diagnostics andRecovery Options

F1=Help F2=Refresh F3=Cancel F8=Image

F9=Shell F10=Exit Enter=Do

Youcanalso useaSMITfast pathtostartthePCI-XSCSIDiskArrayManager.OntheAIXcommandline, type smitpxdam, andpress Enter.

Ifadiskarrayistobeusedasthebootdevice,you mightneedto preparethedisksbybootingfromthe DiagnosticCDandcreatingthediskarraybeforeinstallingAIX.Youmightwantto performthisprocedure whentheoriginal bootdriveistobeusedaspartofa diskarray.

TostartthePCI-XSCSIDiskArrayManagerfromDiagnostics,dothefollowing: 1. StartDiagnostics andontheFunctionSelectionscreen,selectTaskSelection. 2. SelectRAIDArrayManagerandpressEnter.

(30)

Preparing

Disks

for

Use

in

PCI-X

SCSI

Disk

Arrays

BeforeadiskcanbeusedinaPCI-XSCSIDiskArray,itmust bea 522bytes/sectorArrayCandidate pdisk.TocreateanArrayCandidate pdiskandformat itto 522bytesectors,dothefollowing:

1. StartthePCI-XSCSIDiskArrayManagerbyfollowingthestepsin“UsingthePCI-XSCSIDiskArray Manager”onpage 15.

2. SelectCreateanArrayCandidatepdiskandFormatto522ByteSectors. 3. SelecttheappropriatePCI-XSCSIRAIDController.

4. SelectthedisksthatyouwanttoprepareforuseinthePCI-XSCSIDiskArrays.

Attention: Continuingwiththisoptionwillformatthedisks.Alldataonthediskswillbelost. Some disksrequirethattheirmicrocodebeupdatedto thelatestlevelbeforebeingformattedto 522byte sectors.Also, somedisksdonotsupportbeingformattedto 522bytesectors.ThePCI-XSCSIDisk ArrayManager willinformtheuserofthesesituationswhentheyexist.

5. Amessagewilldisplayaskingif youwantto continue.Toproceedwiththeformat,selectOK orpress Entertocontinue.Toreturnto thepreviousmenu withoutformattingthedisks,select Cancel.

Aftertheformattingiscomplete,thediskswillbeArrayCandidate pdisksandwillbeready forusein PCI-XSCSIDiskArrays.Thisoperation willalso zeroallthedataonthedisks.ThePCI-XSCSIRAID Controllerkeepstrackofthedisksthathave theirdatazeroed.TheseZeroedArrayCandidatepdiskscan beused tocreateadiskarraythatwillbeimmediatelyprotectedagainst diskfailures, andtheyarethe onlydisksthatcanbeaddedtoanexistingdiskarray.An ArrayCandidate pdiskwilllose itsZeroedstate afterithasbeen usedinanarrayor isunconfigured.Itwillalso loseitsZeroedstate afterthesystemhas beenrebooted.ToreturnanArrayCandidatepdiskto theZeroedstate,followthestepspreviously describedinthis sectionforpreparing disksforuseindiskarrays.

Creating

a

PCI-X

SCSI

Disk

Array

Adiskarrayiscreatedusingasetof ActiveArrayCandidatepdisks.For diskarrayswithdataredundancy (RAIDlevel5, 6,and10),ifallof thepdisksareintheZeroedstate,thearraywillbecomeimmediately protectedagainstfailures. However,if oneormoreofthepdisks arenotZeroed, thenewly createdarray willinitiallybeintheRebuildingstate.Itwillbeunprotectedagainst diskfailures untilparitydataonallof thediskshasbeenrecalculated.Fordiskarrayswithnodataredundancy(RAIDlevel0), itisof no importancewhetherthepdisksareintheZeroed state.Tocreatea PCI-XSCSIDiskArray,dothe following:

2. SelectCreateaPCI-XSCSIDiskArray.

3. SelecttheappropriatePCI-XSCSIRAIDControlleronwhichyouwanttocreateanarray.

4. SelecttheRAIDlevelforthearray.Formore informationaboutselectinganappropriateRAIDlevel, see“SupportedRAIDLevels”onpage 3.

5. Selectthestripesizeinkilobytesfor thearray. Formoreinformationaboutthestripe-sizeparameter, see“Stripe-UnitSize”onpage8.Aselectionscreensimilarto thefollowingdisplays.Itwilldisplayalist ofArrayCandidatepdisks andnotesregardingarrayrequirements. Theminimumandmaximum numberof supporteddisks willbespecified,alongwithanyother specificrequirements forthearray. 6. Selectthedisksthatyouwanttouseinthearrayaccordingtotherequirementsonthisscreen.

(31)

Create a PCI-X SCSI Disk Array

Move cursor todesired item and press F7. Use arrow keys to scroll.

ONE OR MOREitems can be selected.

Press Enter AFTERmaking all selections.

# RAID 10 supportsa minimum of 2 and a maximum of 18 disks # The totalnumber of disks must be a multiple of 2

pdisk10 30-60-01-1,0 Active Array Candidate 72.8GB pdisk11 30-60-00-4,0 Active Array Candidate 72.8GB pdisk12 30-60-01-8,0 Active Array Candidate 72.8GB pdisk18 30-60-00-2,0 Active Array Candidate 72.8GB

F1=Help F2=Refresh F3=Cancel

F7=Select F8=Image F10=Exit

Enter=Do /=Find n=Find Next

7. ASMITDialog Screensummarizesyourselections.PressEntertocreatethearray.

Youcannow addthediskarraytoa volumegroup.Logical volumesandfile systemscan alsobecreated. UsestandardAIXprocedurestoperformthesetasks,andtreatthearrayinthesamewaythatyouwould treatanyhdisk.

Viewing

the

Disk

Array

Configuration

ToviewtheconfigurationofarraysanddisksassociatedwithaparticularPCI-XSCSIRAIDController,do thefollowing:

2. SelectListPCI-XSCSIDiskArrayConfiguration.

3. Chooseoneor morePCI-XSCSIRAIDControllers.Theoutputdisplayedwillbesimilar tothe following:

(32)

COMMAND STATUS

Command: OK stdout: yes stderr: no

Before command completion,additional instructions may appear below.

---Name Location State Description Size

---sisioa1 30-60 Available PCI-XDDR Dual Channel U320 SCSI RAID Adapter

hdisk11 30-60-ff-0,1 Optimal Raid 5 Array 54.3GB

hdisk14 30-60-ff-0,3 Rebuilding Raid 10 Array 72.8GB Create 55%

hdisk15 30-60-ff-0,6 Failed Raid 5 Array 109.2GB

pdisk14 30-60-00-0,0 RWProtected Array Member 36.4GB

pdisk15 30-60-00-9,0 RWProtected Array Member 36.4GB

pdisk16 30-60-00-2,0 Missing Array Member 36.4GB

pdisk17 30-60-00-3,0 Missing Array Member 36.4GB

hdisk16 30-60-ff-0,8 Missing Raid 0 Array 145.6GB

pdisk9 30-60-00-1,0 Active Hot Spare 18.1GB

pdisk10 30-60-01-1,0 Active Array Candidate 72.8GB

pdisk11 30-60-00-4,0 Active Array Candidate 72.8GB Zeroed

pdisk12 30-60-01-13,0RWProtected Array Candidate 72.8GB Format 35%

hdisk20 30-60-01-4,0 Available 16 Bit LVD SCSI 9.0GB

hdisk21 30-60-01-6,0 Defined 16 Bit LVD SCSI 9.0GB

F1=Help F2=Refresh F3=Cancel F6=Command

F8=Image F9=Shell F10=Exit /=Find

n=Find Next

Thecontroller’sname,location,status,anddescription aredisplayedfirst. EachPCI-XSCSIdiskarray

hdiskisdisplayedwithitsArrayMemberpdisks directlyunderneathit.

v Thefirstcolumnof outputisthenameof thediskarray(hdisk)orphysical disk(pdisk). v Thesecondcolumnof outputisthedevice’slocationcode.Theformatof thelocationcodeis

AB-CD-EF-G,H.TheAB-CDfieldsidentifythelocationof thePCI-XSCSIRAIDController.TheEFvalue identifiestheController’sSCSIbusthatthedeviceisattachedto.Foradiskarraythisvaluewillbeff whichindicates alogicalbusfor RAIDdevices.TheG,HvaluesaretheSCSIIDandLogicalUnit Number(LUN)of thedevice.

v Thethirdcolumnof theaboveoutputisthestateofthediskarrayorpdisk.For informationaboutthe possiblediskarrayandpdiskstates,see“DiskArrayOverview”onpage9. For512byte/sector standalonedisks (hdisks),thiscolumn istheAIXdevice state(for example,Available orDefined). v Thefourthcolumnisa descriptionofthedevice. Foradiskarray,thedescriptionistheRAIDlevelof

(33)

v Thefifthcolumnisthecapacityofthearrayordisk.For informationabouthowthecapacityof anarray iscalculatedfor eachRAIDlevel,see“DiskArrayCapacities”onpage 8.

v Thesixthcolumnisthestatusof along-runningcommandissuedto adiskarrayorpdisk.Thiscolumn isalsoused toindicatethatanArrayCandidatepdiskhashaditsdatazeroed.Thefollowingvalues maybedisplayed:

Createnn%

Diskarrayisinprocessof beingcreated. Deletenn%

Diskarrayisinprocessof beingdeleted. Rebuildnn%

Diskarrayisinprocessof beingreconstructed. Resyncnn%

Diskarrayisinprocessof havingitparitydataresynchronized. Addingnn%

Diskarrayisinprocessof havingoneormoredisksaddedtoit. Formatnn%

pdiskisinprocess ofbeingformatted. Zeroed

pdiskhasbeenzeroed.

ArrayCandidatepdisksandHotSparepdisks aredisplayedat thebottomof thisscreen.Thepdisknames aredisplayed, alongwithlocation,state,description,capacity,andlong-runningcommandstatus.Any512 bytes/sectorstandalone disks(hdisks)aredisplayed,alongwithlocation,state,description,andcapacity.

Deleting

a

PCI-X

SCSI

Disk

Array

Attention: Afteradiskarrayisdeleted, itcannotbeaccessed.Alldatawillbelost.Adiskarraythatis currentlyinuseoropenedcannotbedeleted.Also,if adiskarraycommand(suchasadiskcreation command)isinprogress,thatdiskarraycannotbedeleted.

Topreservethedataonthediskarray,youmustfirstbackupallfilesinthelogicalvolumesandfile systemsonthediskarraybeforeremovingthediskarrayfromitsvolumegroup.Todeletethearray,do thefollowing:

2. SelectDeletea PCI-XSCSIDiskArray. 3. SelectthePCI-XSCSIRAIDController. 4. Selectthediskarraytodelete.

Whenthediskarrayhasbeen deleted,anyActiveArrayMemberpdiskswillbecomeActiveArray Candidatepdisks.

Adding

Disks

to

an

Existing

Disk

Array

ThePCI-XSCSIRAIDControllersupportsaddingdisksto existingRAIDlevel5or 6diskarrays,which allowsyouto dynamicallyincreasethecapacityof adiskarraywhilepreservingitsexistingdata. Extensive useofthis feature,however,willresultina performancepenalty;becausetheaddeddiskswillnotcontain parityandthedatawillnotberestriped.

(34)

AnArrayCandidatepdiskisnotnecessarilya candidatethatcanbeaddedtoanexistingarray.Inaddition tobeinganArrayCandidate, thepdiskmust alsoberecognizedbytheadapterashavingitsdatazeroed. Thissituationensuresthatwhenthedisks areaddedtothearray,theparitydatawillbecorrectandthe arraywillremainprotected againstdiskfailures.

Toadddiskstoanexistingarray, dothefollowing:

1. EnsurethatthediskstobeaddedareZeroedArrayCandidatepdisks. Forassistanceinviewingand changingthestate ofthedisk,see“PreparingDisksfor UseinPCI-XSCSIDiskArrays”onpage16 and“ViewingtheDiskArrayConfiguration”onpage17.

3. SelectAddDiskstoan ExistingPCI-XSCSIDiskArray. 4. SelectthePCI-XSCSIDiskArraytowhich youwantto adddisks.

5. Ascreenwilldisplaysimilarto thefollowingexample.Ifaparticulardiskisnotincludedinthelist,it maynotbea candidatethatcanbeaddedtothearraybecauseofthefollowingreasons:

v Thedisk’scapacityislessthanthatofthesmallestdiskalreadyinthearray. v Thediskhasnotbeen formattedasa522bytes/sectorArrayCandidate pdisk. v Thediskdoesnothaveitsdatazeroed.

Forthesecondandthirdcases,thediskcanbeaddedto anarrayif itisfirstformattedusingthe CreateanArrayCandidate pdiskandFormatto522ByteSectorsoptioninthePCI-XSCSIDisk ArrayManager.

Add Disksto an Existing PCI-X SCSI Disk Array

Move cursor to desireditem and press F7. Use arrow keys to scroll.

ONE OR MORE itemscan be selected.

Press Enter AFTERmaking all selections.

# Choose up to14 of the following disks to add to hdisk2

pdisk10 30-60-01-1,0 Active Array Candidate 72.8GB Zeroed pdisk11 30-60-00-4,0 Active Array Candidate 72.8GB Zeroed pdisk12 30-60-01-8,0 Active Array Candidate 72.8GB Zeroed pdisk18 30-60-00-2,0 Active Array Candidate 80.0GB Zeroed

# Note: If a diskis not listed here it is either not a candidate # to be added tothis array or it does not have its data zeroed # Use the Createan Array Candidate pdisk and Format to 522 Byte # Sectors optionto format and zero the disk.

F1=Help F2=Refresh F3=Cancel

F7=Select F8=Image F10=Exit

Enter=Do /=Find n=Find Next

Ascreensummarizesyour selectionsandindicatestheperformancepenaltyassociatedwiththis option.

6. PressEntertoaddthedisksto thearray.Toenablehigherlevelcomponentsinthesystem tousethe increasedcapacityofthediskarray,additional stepsmightbeneeded.

Using

Hot

Spare

Disks

HotSparedisksareusedto automaticallyreplaceFaileddisksina redundantRAIDenvironment.Hot sparedisksareusefulonlyif theircapacityisgreater thanorequaltothatof thesmallestcapacitydiskin anarray thatbecomesDegraded.

Creating

Hot

Spare

Disks

(35)

2. SelectChange/ShowPCI-XSCSIpdiskStatus. 3. SelectCreateaHotSpare.

4. SelecttheappropriatePCI-XSCSIRAIDController.

5. Selectthepdisksthatyou wantto designateashotspares.Ascreensummarizesyourselections. 6. PressEntertocreatethehotspares.

Thediskstate changesto HotSpare.Onsubsequentdiskfailures,reconstructionof Faileddiskswilloccur automaticallyfor RAIDlevel5,6, and10diskarrays.

Note: If thereisaDegradeddiskarrayat thetime thataHotSpareisconfigured,reconstructionofthe

Faileddiskbeginsautomatically.

Deleting

Hot

Spare

Disks

Todeletea HotSpareandchangethediskto anArrayCandidatepdisk,dothefollowing:

2. SelectChange/ShowPCI-XSCSIpdiskStatus. 3. SelectDeletea HotSpare.

4. SelecttheappropriatePCI-XSCSIRAIDController. 5. Selectthehotsparestodelete.

TheHotSparebecomesanArrayCandidatepdisk.

Viewing

and

Changing

PCI-X

SCSI

RAID

Controller

Bus

Settings

Toviewandchangesettingsfor thePCI-XSCSIRAIDController,dothefollowing: 1. Atthecommandprompt,typesmit,andpressEnter.

2. SelectDevices. 3. SelectDiskArray.

4. SelectIBM PCI-XSCSIDiskArray.

5. SelectChange/ShowPCI-XSCSIRAIDControllerBus.

6. SelectthePCI-XSCSIRAIDControllerbus thatyouwantto changesettingsonorview. Change/ShowCharacteristics of a PCI-X SCSI RAID Controller Bus

Type or selectvalues in entry fields. Press Enter AFTERmaking all desired changes.

[Entry Fields] SCSI Adapter scsi8

Description PCI-X U320 SCSI RAID > Status Available

Location 30-60-00

Adapter cardSCSI ID [7] +# Wide bus enabled yes + Maximum SCSIBus Speed in MB/s 320 + QAS (Quick Arbitration)Capability Enable + Apply changeto DATABASE only no +

F1=Help F2=Refresh F3=Cancel F4=List

F5=Reset F6=Command F7=Edit F8=Image

(36)

Ascreendisplaysinformationaboutthecontrollerbus.Thelast fiveattributesonthescreenare changeable.Thefollowingisinformationregardingeachof theattributes:

AdaptercardSCSIID

SpecifiestheSCSIIDvaluethatthecontrollerwillusetosend commandsasaninitiator device.Ifmulti-initiators aresupported,theSCSIIDthatthecontrollerrespondsto whenacting asa targetdevicewillbespecified.Thisvalueisusuallychangedto avoidaconflictor

duplicationof SCSIIDsamongthecontrollerandotherdevicesontheSCSIbus.Before cablinganynew devicetotheSCSIbus,youshouldverifythatthedevice’sSCSIIDisunique. Ifthecontrollerdoes notsupportmulti-initiators, 7istheonlyvalidvaluefortheSCSIID. Widebusenabled

Specifieswhether thecontrollerwillnegotiatewiththedevicefora 16-bitdatatransferwidthon theSCSIbus. IfYesisspecified,whichisthedefaultvalue,thecontrollernegotiatesfor16-bit datatransfers.Yescanbespecifiedwhenan8-bitdevice isconnectedthroughan8-bitcable totheSCSIconnector.TheNooptionsets thedata transferwidthto 8bits.UsetheNooption whenolder devicesareconnectedthatmaynothandlethewidedata transferrequest,WDTR, messagesproperly.TheWDTRmessagesareused todetectthedatatransferwidth

capabilitiesofadevice. MaximumSCSIBusSpeedinMB/s

Thisattributeisusedto limitthemaximumspeedinmegabytespersecond(MB/s)thatthe adapterSCSIbuswilluse.Speed isnegotiatedbetweentheadapterandSCSIdevices.The maximumnegotiatedspeedcannotbegreaterthantheMaximumSCSIBusSpeed inMB/s value.

QAS(QuickArbitration) Capability

Thisattributeisusedto enableordisablethequickarbitrationcapability. EnablingQAS capabilitydoesnotguarantee thatQASwillactuallyoccurfor anydeviceonaSCSIbus. ApplyChangetoDatabaseonly

Indicateswhethertheconfigurationchangesshouldbeapplied onlyto thedatabaseorto both thedatabaseandthecurrentdevice operation.Fordevicesthatareinuse andcannotbe changed,thisallowsthedatabaseto bechanged forthedeviceandthechangeswilltake effectthenexttimethesystemisrebooted.

(37)

Viewing

PCI-X

SCSI

Disk

Array

Settings

Toviewthesettingsfora PCI-XSCSIDiskArray,dothefollowing:

2. SelecttheChange/ShowCharacteristicsofa PCI-XSCSIDiskArray option. 3. SelectthedesiredPCI-XSCSIDiskArray.

4. ASMITdialogscreendisplaystheattributesoftheselectedarray.Theoutputdisplayedwillbesimilar tothefollowing:

Change/ShowCharacteristics of a PCI-X SCSI Disk Array

Type or selectvalues in entry fields. Press Enter AFTERmaking all desired changes.

[Entry Fields] RAID Array

hdisk15

Description SCSI RAID 5 Disk Arra> Status Available

Location 30-60-ff-0,1 Serial Number 12D0E934 Physical volumeidentifier none Queue DEPTH 16 Size in Megabytes 109200 RAID Level 5 Stripe Size inKB 64

v ThePhysicalvolumeidentifierfield isa uniquevalueassignedto thehdiskifthediskarrayisa memberof avolumegroup.If thediskarrayisnotamemberofa volumegroup,this fieldvalueisnone. v

TheQueueDEPTHfield isthedepth ofthecommandqueueused forthisdiskarray.

v TheSizeinMegabytes fieldrepresentstheusable capacityof thediskarray.For informationabout calculatingcapacitiesfor eachRAIDlevel,see“SupportedRAIDLevels”onpage3.

v TheRAIDLevelfieldisthelevelofprotectionchosenforthis array.

v TheStripeSizein KBfield isthenumberofcontiguous kilobyteswhichwillbewrittentoasingle disk before switchingto thenext diskinthediskarray.It providesthehostwithamethodto tunedata stripingaccordingto thetypicalI/Orequestsize.

Youcannotchangeanyof theattributesonthisscreen.TheRAIDlevelandstripesizemustbespecified whenthearrayiscreated.

Viewing

PCI-X

SCSI

pdisk

Settings

ToviewthePCI-XSCSIpdisksettings,dothefollowing:

2. SelectChange/ShowPCI-XSCSIpdiskStatus. 3. SelectChange/ShowPCI-XSCSIpdisk.

4. Selecta pdiskfromthelist.

(38)

Change/Show PCI-X SCSI pdisk Type or select valuesin entry fields.

Press Enter AFTERmaking all desired changes.

[Entry Fields] Disk pdisk3

Description Physical SCSI Disk Drive Status Available

Location 30-60-00-10,0 Serial Number E3V1W93B

Vendor and ProductID IBM IC35L036UCDY10> Service Level

Size in Megabytes 60400

Format Timeout inminutes [120] +#

TheSizeinMegabytesfield representsthecapacityofthepdisk. Todisplayapdisk’sVitalProductData(VPD),dothefollowing:

2. SelectChange/ShowPCI-XSCSIpdiskStatus. 3. SelectDisplay pdiskVitalProductData.

4. SelecttheappropriatePCI-XSCSIRAIDController. 5. Selectthedesiredpdisk.

(39)

Chapter

4. Multi-Initiator

and

High-Availability

TheMulti-InitiatorandHigh-Availabilityoptionprovidesahigh-availabilityenvironment forsystemstorage byenablingtwosystemsto haveaccesstothesamesetof diskarrays.Thisfeatureistypicallyusedwith theIBMHigh-AvailabilityCluster Multiprocessingapplication(HACMP).TheIBMHACMPsoftwareprovides alow-costcommercialcomputingenvironment thatensuresthemission-criticalapplicationscanrecover quicklyfromhardware andsoftwarefailures.

Useof theHighAvailabilityfeaturerequiresadapterandAIX softwaresupport.Theadapterswhichsupport thisHighAvailabilityfeatureareidentifiedinTable1onpage1.TheAIXsoftwaresupportlevelsrequired fortheHighAvailabilityfeatureareidentifiedinTable2onpage13.Theseadapterssupportbeingeitherin asingleadapterconfigurationoraspartof thisdualadapter(HighAvailability)configuration.Theadapter firmwarewilldeterminethecorrectoperatingmode basedupon thepresenceorabsenceofanother compatibleadapter,andwillautomaticallychangetheoperatingmode asneeded.Nomodejumpersor specialconfigurationsettingsareneededto configuretheadapter.

Thisfunctionisonly supportedfor connectionsto diskarraysbetweentwosystemsorpartitions.Itisnot supportedfor connectionstodiskarraysfromtwoadapters inthesamepartitionorsystem.

Oneadapterfunctionsastheprimaryadapterandperformsdirectmanagement ofthephysicaldevices. Thesecondadapterservesasa clientoftheprimaryadapteranddoes notperformreads orwritesto devicesdirectly. Commandsdirected todiskarraysthroughthesecondaryadapterareforwardedthrough theSCSIbus totheprimaryadapterfor execution.Thesecondaryadapterdetects iftheprimaryadapter goesofflineandtransitionsitselftobecometheprimaryadapter.Whentheoriginalprimaryadaptercomes backonline,it nowservesasthesecondaryadapter,unlessit waspreviously designatedasthepreferred primaryadapter.

Whenina HighAvailabilityconfiguration,theadapterbehavior isalteredto enableeasiertransitionof the diskarraysbetweenadapters intheeventofanadapterfailure(or forothercauses).Writecacheonthe adaptersisdisabledinaHighAvailability configurationwhich impactsperformance.Also,ina High Availabilityconfiguration,parityfootprintsarekeptinreservedsectorsof thedevice inaddition to nonvolatileadaptermemory.Bothofthesearedifferentthanthetypical adapterbehavior andare applicableonly iftwoadapters arepresent.Theadapterwillautomatically switchitsbehaviorasneeded basedonthecurrentconfiguration.

Multi

Initiator

and

High

Availability

Configuration

Specifics

v Connectionsto diskarraysmustbebetweentwosystemsorpartitionsandnotbetweentwoadapters in thesamepartitionorsystem.

v All(pdisks)inthediskarraysmustbesharedbetweenbothadaptersinaHighAvailability configuration. v Non-pdisk devices,includingtape andoptical,cancontinuetobeconnectednon-sharedto asingle

adapter. v

AdiskarrayinaHighAvailabilityconfigurationcannotbeusedasabootdevice.

v Attachmenttotheshareddiskenclosures mustbefromthesameSCSIbusportconnectionsoneach adapter.SeeFigure1 onpage 2forreference.

v UnlikeadaptertypescanbeconnectedinaHighAvailabilityconfigurationaslongasbothadaptertypes areIBMPCI-XSCSIRaidAdaptersandthesameAdvancedFunctionsaresupportedoneachadapter (for example,RAIDlevels).

v Theenduserandtheirapplicationsareresponsibleto ensureorderlyreadandwriteoperationsto the shareddiskarrays,for example,whenusingdevicereservationcommands(persistentreservationisnot supported).

(40)

Comparison

of

JBOD

(512

byte/sector

standalone

disks

(hdisks))

versus

Disk

Arrays

(522

bytes/sector

disks

(pdisks))

in

High

Availability

Configurations

JBOD(512byte/sectorstandalonedisks(hdisks)) ExternalLow-voltageDifferential Connection

Theinterconnectioncable,whichhasVHDCIconnectors,isprovidedwiththeexternalsubsystem.

DiskArrays(522byte/sectordisks(pdisks)) ExternalLow-voltageDifferential Connection

Theinterconnectioncable,whichhasVHDCIconnectors,isprovidedwiththeexternalsubsystem.

Similarities

between

JBOD

and

Disk

Arrays

in

High

Availability

Configurations:

v BothadaptersinaHighAvailability configurationconnect toshareddiskenclosures. v

BothadaptersinaHighAvailability configurationcanattach512byte/sectorstandalonedisks(hdisks). v Eachadapter’sSCSIIDmustbesettoa differentvaluewhenconnectedto shareddiskenclosures. v

In theeventof anadapterfailure,thesystemcontainingthefunctionaladaptercanstillaccessthe shareddisks. T1 T T T0 C1 C1 C0 C0 A _T T T T S S A

Figure6.JBOD(512byte/sectorstandalonedisks(hdisks))

T1 T T T0 C1 C1 C1 C1 C0 C0 C0 C0 A _T T T T S S A Primary Secondary Disk Arrays

PCI-X SCSI RAID Controller

PCI-X SCSI RAID

Controller

Reference Guide for AIX

ESCALA POWER6

REFERENCE

86 A1 59EV 00

ESCALA POWER6

PCI-X SCSI RAID

Controller

Reference Guide for AIX

REFERENCE

86 A1 59EV 00

Hardware

Trademarks and Acknowledgements

Contents

Safety

Information

Handling

Static

Sensitive

Devices

About

This

Book

ISO

9000

Highlighting

References

to

AIX

Operating

System

Related

Publications

Trademarks

Chapter

1.

PCI-X

SCSI

RAID

Controller

Overview

Disk

Arrays

Supported

RAID

Levels

RAID

Level

0

RAID

Level

5

RAID

Level

6

RAID

Level

10

Disk

Array

Capacities

RAID

Level

Summary

Stripe-Unit

Size

Disk

Array

Overview

States

for

Disk

Arrays

(hdisks)

States

for

Physical

Disks