SlideShare a Scribd company logo
B2B FC CREDITSPERFORMANCEDEADLOCKS
Jan 31, 2013 3:17 PM (
So thiswasabout gettingthe link"up"onboth ends,butwhataboutactuallysendingdataaccross those
links?Longerlinkscanactuallycontainmultiple fibrechannel frames!!The speedof lightisn'tinfinate,
so ittakestime (microsecondstosub milli seconds) foraframe to actuallytravel fromTx (transmitter)
to Rx (receiver).
If a fibre opticpathisan FCISL, theninknowingitsline bit-length,we cancalculate the maximum
numberof framesthat can simultaneouslyfit(source todestinationandback) onthat physical link.That
numberisthe exactanmountof buffertobufferscreditsyourISLswitchportswill require.
Why?
To safelystore-and-forwardframesatthe source end,while theyare still intransittothe destination
port,and acknowledgedashavingbeenreceived.Sothe sendingswitchwill keepthatframe ina buffer
while the ACKhasn'tbeenreceived.
To provide a“successfullysent”I/Oacknowledgmenttothe sendingportor HBA soit doesnothave to
waitfor the frame to reach the otherside of the link,andthe acknowledgmentthathasto come back.
So if youupgrade a port'sspeedfrom2 to 4 Gbps for example,the amountof framesthatcan be on the
linksimultaniouslydoubledandthe amountof B2B creditshasto be doubledaswell.
Please note thatalthoughthe linkbetweensitescanbe fastenoughandhave enoughbuffercreditsto
facilitate linerate communication,the receivingarraycan still be a bottleneckwhichcancause the
sendingside toslowdown.Considerforexample MirrorView orSRDF.The primarystorage array is
writtentoby a numberof hostsand the the back endof the primaryarray can handle the amountof
IOps.All I/Osthatwere writtenare alsosentto the secondaryarray to be replicated.If the receivingend
cannot handle thatamountof (write) IOpsbecause the numberof disksistoolow orthere'snot enough
cache available,the receiving(busy) arrayisprocessingthe incomingI/Osnotasfastas the ISLbetween
the sitescan provide andsoacknowledgementsaren'tsentbackto the primaryarray instantaniously,
but a little bitslower.Sointhe endthe sendingapplication receivesthisacknowledgementsomewhat
laterand we all knowthat comminucationisbuiltonsend/receive andACK,right?If the ACKcomesin
slow,the conversationisslowerthanyou'dlike ittobe.
So configuringthe linkbetweensitesisone thing,sizingthe recveivingarrayisanother(important)
thing!
Before we beginanexample of howtocalculate bufferrequirements,itisimportanttoknow the
numerical definitionof aFibre Channel Gigabit,aswell astounderstandthe structure of a Fibre Channel
Frame.
In the Fibre Channel world,one gigabitisdefinedtobe 1,062,500,000 bits(whichisnot
1024x1024x1024). Other Fibre Channel Gigabitvaluesare thenderivedfromthisreference definition.
For example,two(Fibre Channel) Gb=2 x 1,062,500,000 bits= 2,125,000,000 bits.To avoidconfusion
withthe traditional (nonFibre Channel) definitionof aGb, throughoutthisdocumentIwill use the
symbol Gbfcto mean“1,062,500,000 bits”,or 1 Fibre Channel Gb.
In summary:
1 Gbfc = 1,062,500,000
2 Gbfc = 2,125,000,000
4 Gbfc = 4,250,000,000
8 Gbfc = 8,500,000,000
10 Gbfc = 10,625,000,000
16 Gbfc = 17,000,000,000
Next,we showthe anatomyof a Fibre Channel Frame withnotes.
Start of Frame:4 bytesor 32 bits
StandardFrame Header:24 bytesor192 bits
Data (payload):[0– 2,112] bytesor [0 – 16,896] bits
CRC: 4 bytesor32 bits
End of Frame: 4 bytesor 32 bits
TOTAL (Nbrbits/frame):[36– 2,148] bytesor 288 – 17,184 bits
Notes:
The term byte usedhere means8 bits(notthe 10 bitsthat resultfrom 8/10 bitencoding).
The maximumFibre Channel frame sizeis2,148 bytes.
The final frame size mustbe a multiple of 4bytes.Thusthe Data (payload) segmentwill,asnecessary,
be paddedwith1 to 3 “fill-bytes”toachieve anoverall 4byte frame alignment.
The standard Frame Headersize is24 bytes.However,upto64 additional bytes(foratotal of an 88 byte
header) canbe includedforapplicationsthatneedextensive control information.Since the total frame
size cannotexceedthe maximumof 2,148 bytes,these additional Headerbyteswillsubtractfromthe
Data segmentsize byas muchas 64 bytes(perframe).Thisiswhythe maximumData(payload) size is
2,112 (because [2,112 – 64] = 2,048, whichisexactly2K-bytesof data).
The final frame,once constructed,ispassedthroughthe 8 byte to 10 byte conversionprocess.
In the FC world,1 Word = 4 x 8/10 bit encodedbytes(40bits).
Thenwe have the speedof light:
299,792.458 km/ s == 0.00000333564095 s / km, so that's 3.33564095 microsecondsperkilometer,
that's 3.3 millionthof asecondfor eachkm "traveled".
NOTE: thisisin vacuum!I'll adjustthe outcome later.The speedof lightinfiberisapproximately
200,000 kmper secondinsteadof almost300,000.
Nextwe take the lineardistance betweenthe twositesanddetermine:
How manysecondsittakesfor 1-bitto travel the one-waydistance linearbetweenthe twosites;thatis,
expressthe “distance”betweenthe twositesinseconds.Thisisdeterminedbythe speedof light.
Havingdetermined the one-waydistance insecondsbetweenthe twosites(afixednumber),we can
nowdetermine the maximumnumberof bitsthatcan exist,intransit,betweenthe twositesatanyone
time.Inotherwords,we can calculate the “distance”betweenthe twosites inbits(asopposedto
miles).Thisisdeterminedbythe speedof light,aswell asbythe rate at whichthe transmitting
equipment(e.g.afibre channel port) cancreate electrical variationsontothe medium(i.e.fibre optic
line).Inotherwords,howfastcan itpush bitsontoone endof the fibre opticline (usually1Gbfc,2
Gbfc, 4 Gbfc or 10 Gbfc).
Let say,for the purposesof discussion,thatwe have redundant(i.e.two) fibre opticpathsbetweena
primaryand secondarysite.
The lineardistance (asopposedtodisplacement)is91.732608 Km (or about57 miles) forone path,and
43.452288 km(or about27 miles) forthe otherpath.
Suppose the linkspeedis2Gbfc:
Distance (Km) Distance (secs) # of Bits(1Way) 8/10 FC bytes
91.732608 (57mi) 0.000305987044 650,222.468 65,022.2468
43.452288 (27mi) 0.000144941231 308,000.116 30,800.0116
Again:thisisin vacuuminsteadof fiber!Butstaywithme,I'll fix itlateron!!
Calculationsnotesforthe tablesabove:
Column2 indicates the amountof time (inseconds) ittakesone OPTICALVARIATION (howevermany
numberof bitsthat optical variationhappenstorepresent) totravel the one-waydistance specifiedin
columnone.Itcomesfrom multiplyingthe numberof secondsittakeslight totravel 1 km (i.e.
0.00000333564095 s / km),bythe numberof km traveledwhich,isspecifiedinthe firstColumn.
Column3 is the productof column2 (i.e.the line distance inseconds) andthe FCbitinsertionrate
(2,125,000,000). This columneffectivelyrepresentsthe amountof additional I/Othatcouldhave been
processedatthe host,had the response tothat I/Obeeninstantaneous;(actuallytwice thatamount,
since acknowledgmenttime forthose I/O’s,comingbackthe otherway,have to be accounted foras
well).
Column4 is Column3 dividedby10.This isdone to groupsingle bitsintransitintoequivalent8/10bit
“byte”quantities.The Fibre Channel protocol convertsevery8bitbyte intoa 10 bit equivalent(viathe
8/10 bit encodingalgorithm) before transmittingit.Sothe value inthisColumn4will determine the
numberof buffersneededforanISL switchport.
Frame Length8 (inkm) = (299,792.458 km/s) x (Seconds-Between- Inserted-Bitssecs/bit) x (Number-Of-
Bits-Per-Framebits)
Frame Length10 (inkm) = (299,792.458 km/s) x (Seconds-Between- Inserted-Bitssecs/bit) x (Number-Of-
Bits-Per-Framebits) x 10/8
Where:
Seconds-Between-Inserted-Bits=1/1,062,500,000 (for1Gbps FC) = 1/2,125,000,000 (for2Gbps FC)
Number-Of-Bits-Per-Frame=Variable dependingonDatapayloadand/orHeadersize.See table and
notesabove.Inmostcases the Headerwill be the Standardsize of 24 bytes.
Numberof bits/ frame
(after8/10 bitencoding)
Frame Length(km) @ 2 Gbps FC
(.000141078803764705 km/bit)
Numberof in-transitframes(1-
way) for 91.732608 km leg.
17,184 / 21,480 3.0303 km (2112 PL-bytes) 30.2170 frames(buffers)
Andagain: thisisvacuum,not infiber!!!Staywithme a little bitlonger....
Notes:
Column1 representsthe total numberof 8/10 bitsin a Fibre Channel frame (withastandardheadersize
of 24 bytes) atvaryingData payloads(PL).
Column2 representsthe productof the 10 bitvalue inColumn1, and (1/2,125,000,000). Thus,this
Column(Column2) essentiallyrepresentsthe lineardistance that1 (one) single frame consumesforthe
specifiedpayload(PL).
Column3 representsthe quotientderivedbydividingthe longest(worstcase) DWDMline distance (in
kilometers),bythe numberof kilometersperframe (calculatedinColumn2).Thus,thiscolumn
essentiallyindicateshowmanyadditionalONE-WAYframesworthof datacouldhave beenprocessedby
the host/application,hadthe response tothe firstframe beeninstantaneous.Inotherwords,thisishow
manyONE-WAY(notround trip) switch buffersyouwouldneedtoallow non-stoptransmission.Double
(i.e.roundtrip) the valuesinthiscolumn3to yieldthe numberof buffersrequiredof yourISLswitch
ports.
So inour example forrunning2longlinksusing2 Gbfc speed(invacuum):
the numberof B2B creditsneededforthe 91.7 km legwill be 2 x 30.2 = 60.4, soroundingupto 61 B2B
credits.
the numberof B2B creditsneededforthe 43.4 km legwill be 2 x (43.4/91.7) = 2 x 14.3 = 28.6, so
roundingupto 29 B2B credits.
Can't we make a rule of thumbout of this?
I admit,the numbersIusedare takenfroman example documentIhave lyingaroundsoI didn'tneedto
the math myself ,butmakinga ROT out of itbackfiresatme.
The easiestwayto calculate the rule of thumbisgettingbackto 1 km, soat 2 Gbfc speedthe numberof
B2B creditsneededfora1 km linkis2 x 30.2170 / 91.732608 = 0.6588 IN VACUUM.
Otherexampleswe cannowuse to more easilyrememberthese"nice"numbers:
2 Gbfc overa 2 km link= 2 x 0.6588 = ± 1.32
4 Gbfc overa 2 km link= 4 x 0.6588 = ± 2.64
4 Gbfc overa 20 km link= 40 x 0.6588 = ± 26.4
So whatwouldbe a nice numberto remember?4Gbfc requires1.3x the numberof km? 1.33 x the
numberof km? I guesswe have justcreateda rule of thumb!1.33 can be rememberedveryeasily!
Right?
So runninga 4Gb linkover44 km requires1.33 x 44 = 58.52 := 59 B2B credits.
A 2 Gbfc linkusingthe same distance (44km) will needhalf of that,so30 B2B credits.Sohalf the speed,
half the buffercredits,doublethe speed,doublethe buffercredits.
HOWEVER: the speedof lightinvacuumneedstobe devidedbythe refractionindexof fiber,whichis
about1.5.
BuffersRule of Thumb(takingthe actual speedof lightintoaccount):
4 Gbfc needs1.33 times1.5 timesthe distance inkilometer=1.995 buffersperkilometer
Thisextra1.5 is because of the refractionindex of the carrierused.Mostfibershave anindex of
approximately1.5,whichwill "slowdown"the speedof lighttoabout200,000 kilometerspersecond.
A longdistance connectionrunningat4 Gbfc needs2buffersperkilometer
A longdistance connectionrunningat4 Gbfc needs3.22 bufferspermile
(fromkm to mile youneedtomultiplythe outcome inkmby1.609, whichisnotthat easyto remember,
but youcan figure outa numberthatworksfor you,right?)
EMC as well asBrocade recommendaddinganextra20% B2B creditsto the amountyou justcalculated.
Message waseditedby:RRR Added20% extrasimilartothe bestppracticesbyEMC and Brocade.
ReportAbuse
Like Show2 Likes(2)
16. Re:Ask The Expert:Discussingthe challengesof LongDistance Links
RRR Nov20, 2012 3:17 AM(inresponse toRRR)
If anyone thinksImade a mistake here,please informme,sowe can setthisstraight.
ReportAbuse
Like Show0 Likes(0)
17. Re:Ask The Expert:Discussingthe challengesof LongDistance Links
Vincze Nov20, 2012 4:48 AM(inresponse toRRR)
Nice breakdown,RRR
ReportAbuse
Like Show1 Like (1)
18. Re:Ask The Expert:Discussingthe challengesof LongDistance Links
RRR Nov20, 2012 6:01 AM(inresponse toVincze)
Thanks.AndI almostlostmy post!!WhenI was done Iaccidentlyswitchedtothe advanced editorand
nothinghappened....aaaargh!FortunatelyIcopiedthe html texttonotepadonlyaminute before,soI
was able torestore mypost. Tookme an hourand a half or so to type this,so I wasgladit wasn't lostin
the end.
So whatabout this1.33 factor for a 4Gb link?Doyouthinkit's correct?I can't findanyerrorsin my
calculations
ReportAbuse
Like Show0 Likes(0)
19. Re:Ask The Expert:Discussingthe challengesof LongDistance Links
JonKlaus Nov20, 2012 7:32 AM(inresponse toMark)
AndI was afraidmy postwas long...yikes!
I originallycalculatedall buffercreditsbackfrom2gbit,whichis/was1creditper km.4Gbit wouldneed
2 creditsperkm,etc.
Don't forgetthat toomuch creditscan't harm performance (assumingyou're notrunningshortonother
links),andthatyoucan alwaysmonitorcreditusage onthe switch.CiscoDevice Managerhasa counter
that showsthe slackyou've got:
In thiscase it's an ISL that's maybe a couple of hundredmeterslong,soitcan cope with1 or 2 credits
dependingonactual speedanddistance.The portisneverthelessassigned32credits,of which32 are
still available(seebottom2numbers,CurrRxBbCreditsandCurrTxBbCredits.
ReportAbuse
Like Show1 Like (1)
20. Re:Ask The Expert:Discussingthe challengesof LongDistance Links
RRR Nov22, 2012 1:43 AM(inresponse toMark)
Tonight(Europe time) we plannedtodothe TweetChat,butyesterday SeanThulin mentionedtousover
TwitterthatThursday Novthe 22nd isThanksgivinganditmightnotbe a goodday for the TweetChat.
So aftersome careful considerationswe decidedtomove the TweetChattonextMonday,November
the 26th. Same time,same place,newday!
ReportAbuse
Like Show0 Likes(0)
21. Re:Ask The Expert:Discussingthe challengesof LongDistance Links
JonKlaus Nov23, 2012 4:26 AM(inresponse toRRR)
Happy Thanksgivingeveryone inthe USand aroundthe world!I hope the turkeytastedgood!
So..A lotof people are readingthistopic,butthe repliesare abiton the low side.Isthere no-one else
that wantsto share theirexperienceswithlongdistance links?Are longdistancelinksthateasy?
Please join the conversation;we won'tbite!
ReportAbuse
Like Show1 Like (1)
22. Re:Ask The Expert:Discussingthe challengesof LongDistance Links
RRR Nov28, 2012 2:49 AM(inresponse toJonKlaus)
So we talkedaboutlight,multi mode andsingle modeaswell asattenuation.Sothe maximumdistance
isdefinedbyhowsensitive the Rx side is.
Alsowe explainedwhyBuffertoBufferCreditsare neededandhow youcalculate how manyof these
youneed.
So the nextthingwe'dlike todiscussisa wayto make optimal use of the expensivefiberlinkyoumight
have.A way to do thisisby usingcolors.Since lasersare monochromaticanywayusingasort of prismto
bundle colorscomingfromdifferentlasersintoasingle multicoloredbeamisthe solution!
TechniqueslikeCWDM,DWDM andEWDM were developedtofacilitateasmanycolorsas possible into
a single beam.
WDM standsfor wavelength-divisionmultiplexing.Multiplexingsaysitall:itcombinesmultiple source
intoone.
The bestknownWDM productis CWDM: Course WDM. In 2002 the standardwas setfor CWDM as using
wavelengthsbetween1270 and1610 nm as well ashaving20 nm spacingsbetweenthe "colors".The
mostcommonlyusedCWDMMultiplexers(the prisms) provide 8connectionsso8 sendinglongwave
ports can use the same physical darkfiber.Andalthougheachof these "colors"isnamedaftera visible
color(like brown,yellow,blue andsoon) the actual wavelengthsare farbeyondthe visibilityof the
humaneye.
The wavelengthsbetween1270 and 1470 are consideredunusablebecause of the increased
attenuation,soonly1470 to 1610 issupported.
The "colors"usedfor CWDM are:
1470 nm (gray)
1490 nm (violet)
1510 nm (blue)
1530 nm (green)
1550 nm (yellow)
1570 nm (orange)
1590 nm (red)
1610 nm (brown)
The mentioned colorsare the namesCiscocallsthese differentwavelength.Byusingcoloredtagson
each SFPthe humaneye can noweasilyidentifyeachwavelength.
Needlesslytosaythat to connecta networkonsite A usingforexample the 1530 nmwavelength,the
same wavelengthof 1530 nm is neededonsite B.
CWDM isunaware of the protocol usedtotransport data accross,so you can easilycombine tcp/ip,fibre
channel andevenanalogue tvsignalsaslongas eachsignal usesa differentwavelength.
ReportAbuse
Like Show1 Like (1)
23. Re:Ask The Expert:Discussingthe challengesof LongDistance Links
JonKlaus Nov23, 2012 8:22 AM(inresponse toRRR)
So we knowhowto getthe signal acrosslongdistancesandwe know how to efficientlyloadthe link
usingbuffercredits.If we needmore bandwidththanone linkcandeliver,we cansenddifferent
wavelengthsoverone linkusingCWDMandDWDM to make thingsevenmore efficient.Butthere'sone
thingwe can't influence (much):latency.
Whenwe sendinformationbetweentwodistanceswe use light.The speedof lightis299,792,458m/s.
Thisis ina vacuum; infiberit'sa bit lower,somewherearound200,000,000m/s. Puttingitdifferently,
that's 200,000km/s or 200km/ms. This meansthatif we wantto cover200km of distance,we'll have
1ms of latencybetweenputtinglightonthe fiberandthe otherendseeingit.
To performreliable communications,we can'tsignal uni-directionallyandleave itatthat.We wantto
knowif the data arrivedat the other endintact.Thismeansthat we needtouse the bi-directional
latency,alsocalledround-triptime.Our200km linkisnow costingus 2ms of latency.Nottoo much
right?Well...helloSCSI!
FC data transportusesSCSIcommands.If we assume Iwill be the sendingstorage arrayonthe source
endand RRR will be the receiving storage onthe otherend,our(SCSI) conversationwouldbe something
alongthe linesof:
RTT direction1:HeyRRR,I wantto sendyou some data.
RTT direction2:Sure Jon,goahead.
RTT direction1:Okay,here isthe data.
RTT direction2:ThanksJon,gotit ingoodshape.
Or, since a picture saysmore than a thousandwords,a picture fromthe Brocade whitepapers:
Thismeansthat insteadof 1ms latency,our200km linkisactuallycostingus4ms of latency.Andthat's
onlyforthe linkitself.
If we send32KB of data,we also needtoput that onthe line.IgnoringFCframe overhead,at1Gbit/sa
32KB I/Otakes0,244ms to load.You can compare thisto a truck enteringthe highway:once the front
fendercrossesthe startingline,the backof itis still not"loaded"ontothe highway.
If we alsohave protocol convertersinbetweensource anddestination(because forexampleyouswitch
fromFC to FCIPand at the otherendback fromFCIPto FC) youwill needtoaddanother0,5ms for each
conversion.With4round-trips,you'll endupwith4msof protocol conversiontime.
So we've got4ms of delaydue tothe speedof light.We have 4ms due to protocol conversionsor
routers.Andwe have 0,244ms of latencydue tothe fact we can onlyloadthe data on the line at
1Gbit/s.Addit all up and at 200km youhave an additional latencyof 8,244ms.
Consideringthataunmirroredwrite I/Othatishittingwrite cache onlycostsus somethinginthe
neighborhoodof 0,5ms,thisisa lot.Switchon mirroringoverthatsecondarylinkandyourwrite latency
isnow 0,5 + 8,244 + 0,5ms = 9,244ms. If the secondarystorage systemisalsorunningoutof write cache
and needstoforce flush,you're ina worldof pain...
Moral of the story:be careful of synchronousreplicationoverlongdistances!
Andhave a goodweekend...
ReportAbuse
Like Show1 Like (1)
24. Re:Ask The Expert:Discussingthe challengesof LongDistance Links
JonKlaus Nov26, 2012 10:07 AM (inresponse toJonKlaus)
Andwe're off withthe tweetchat!Joinusontwitterwithhashtag#EMCATE or go the the following
website:http://tweetchat.com/room/EMCATE
Hope to see youthere for questions,commentsorjust a casual chat!
ReportAbuse
Like Show0 Likes(0)
25. Re:Ask The Expert:Discussingthe challengesof LongDistance Links
RRR Nov26, 2012 12:13 PM (inresponse toJonKlaus)
We talkedaboutFCIP,buffervcredits,inorderdelivery,portgroups,sharedbandwidth,butalsoSONET
OC-48 to coveralmost1,000 miles.Prettyimpressive!
Lots of questions,lotsof answer,butstill alotof unansweredones.Needmore time.......
ReportAbuse
Like Show0 Likes(0)
26. Re:Ask The Expert:Discussingthe challengesof LongDistance Links
RRR Nov27, 2012 3:50 AM(inresponse toRRR)
I fixedit.Itotallyforgotaboutthe speedof light,whichislowerinfibercomparedtovacuum.It'sabout
1.5 timesslower,sothe speedof lightinfiberisapproximately200kkm/s.
Thismeansmore frameswill live onthe link,somore buffersare needed.
ReportAbuse
Like Show0 Likes(0)
27. Re:Ask The Expert:Discussingthe challengesof LongDistance Links
merlijnNov27,2012 4:59 AM(inresponse toJonKlaus)
Hi Jon,
Can the counteractuallydropto 0, or is1 the minimum?
Because there’salwaysatleast1 BBC for a port.
ReportAbuse
Like Show0 Likes(0)
28. Re:Ask The Expert:Discussingthe challengesof LongDistance Links
JonKlaus Nov27, 2012 5:46 AM(inresponse tomerlijn)
Hi Merlijn,
Yes,the countercan actuallydropto 0. At that point,transmissionof new frameswillhaltuntill atleast
1 ACKisback and the counteris incrementedagain.
If you run the followingCLIcommandagainstan interface,forexample fc1/1:
sh intfc1/1 countersdetails|grepcredit
You will see somethinglike:
0 waitsdue to lackof transmitcredits
14576233333 transitionsof tx BB creditout of zero state
14 transitionsof rx BB creditto zero state
I had to google abit to make sense of it..apparently"transitionsof tx BBcreditout of zero state" does
not indicate aproblem.Ihave resetthe countersandit keepsincrementing;the othertwovalues
remain0. Thisis a 1km linkwhichhas32 credits,so ithardlyeverdipsunder31.
ReportAbuse
Like Show0 Likes(0)
29. Re:Ask The Expert:Discussingthe challengesof LongDistance Links
RRR Nov27, 2012 7:22 AM(inresponse toJonKlaus)
0 waitsdue to lackof transmitcredits
14576233333 transitionsof tx BB creditout of zero state
14 transitionsof rx BB creditto zero state
Is this"waitsdue to lackof transmitcredits"cumulativeorsimplyacounterfora certainpointintime to
presentthe value atTHAT moment?Ibet that if it'scumulative,youcaneasilytrackbuffershortages
and act uponthat.
ReportAbuse
Like Show0 Likes(0)
1 2 3 PreviousNext
Go to original post
Actions
More Like This
No similarcontentfound
IncomingLinks
Re: Askthe Expert:SAN (Connectrix), FCConnectivityRecommendationsandBestPractices
Re: Askthe Expert:SAN (Connectrix),FCConnectivityRecommendationsandBestPractices
Re: Re:Askthe Expert:SAN (Connectrix),FCConnectivityRecommendationsandBestPractices
Re: Howto buildanHA SQL cluster
Re: Mirrorview/Sperformance impact
Dell Technologies©2017 EMC Corporation.All rightsreserved.PrivacyLegalIntelContactUnitedStates
You are onthe Dell EMC UnitedStateswebsite.If you wouldlike tochange yourpreferredlanguageor
countryof origin,please clickhere.
Products
Solutions
Shop
Support
Services
Partners
Company
My AccountLogIn
BROWSE PRODUCTS
Data Storage
Servers
ConvergedInfrastructure
Data Protection
Security
Networking
Dell ProductsforWork
SearchProductsby Name
ProductsA-Z
ShopEMC Products
ProductCommunity
Software Downloads
Contact Sales
Call 1-866-438-3622
Call 1-866-438-3622
Storage Categories
Data Storage OverviewEnterprise StorageEntry&Midrange StorageSoftware DefinedStorageAll-Flash
StorageCloudStorageStorageManagement&Networking
Storage ProductFamilies
ElasticCloudStorage (ECS)IsilonScaleIOUnityViPRVMAXAllFlashVNXXtremIO
ServerOverviewRackServersTowerServersModularInfrastructure ServersServersOptimizedforSDS
ConvergedInfrastructure Categories
ConvergedInfrastructure OverviewConvergedSystemsHyper-convergedSystemsHybridCloudPlatforms
Converged Infrastructure ProductFamilies
VxRackSDDCVxBlockVxRackFLEXVxRailVisionSoftwareVscale ArchitectureXCSeries
Data ProtectionCategories
Data ProtectionOverviewDataBackupandProtectionStorageDataBackupandProtectionSoftwareData
ProtectionSuitesCloudBackupandProtectionCopyDataManagement
Data ProtectionProductFamilies
Data DomainDataProtectionSuite
Detect,investigate,andrespondtoadvancedthreats.Confirmandmanage identities.Ultimately,
preventIPtheft,fraud,andcybercrime.
Explore productsandsolutionsfromRSA.
VisitRSA.com
NetworkingOverviewSwitchesRoutersandWirelessNetworking
OverviewDell LaptopsDellDesktopsDell ThinClientsandVDIProducts
Top of Form
Search
Bottomof Form
No resultsfound
No results found
BROWSE SOLUTIONS
All-Flash
Big Data
Cloud
ConvergedInfrastructure
Data Protection
ServerSolutions
HighPerformance Computing
NetworkingSolutions
Software Defined
Virtualization
IT Transformation
Modernize,automate andtransformyourbusiness.
Contact Us
Let’stalkabout yourIT transformation.
Contact Sales
Call 1-866-438-3622
Call 1-866-438-3622
SHOPNOW
Data Storage
Servers
ConvergedInfrastructure
Data Protection
Security
Dell ProductsforWork
Questions?
We can help.
Contact Sales
Call 1-866-438-3622
Call 1-866-438-3622
How to Buy
International Sales
Entry and Midrange StorageEnterpriseStorageAll-FlashStorageSoftware-definedStorageStorage
ManagementandNetworkingCloudShopAll DataStorage Products
Rack ServersServersOptimizedforSDSModularInfrastructure Servers
ConvergedSystemsHyper-convergedSystemsHybridCloudPlatformsShopAll ConvergedInfrastructure
Products
Backup andProtectionStorageBackupandProtectionSoftwareShopAll DataProtectionProducts
OverviewDell LaptopsDellDesktopsDell ThinClientsandVDIProducts
ShopAll SecurityProducts
DELL EMC SERVICES& EXPERTISE
Accelerate yourbusinessandITtransformationwithcloud,bigdata,andtechnologyconsultingand
services.
ProfessionalServices
CustomerService
Training& Certification
Dell IT Lifecycle Services
Contact Us
Let’stalkabout yourIT service needs.
InFocus
Gain insightsandexpertise onthe topicsshapingITTransformation—visitInFocus.
Contact EMC Support
Contact Sales
Call 1-866-438-3622
Call 1-866-438-3622
Top of Form
Search
Bottomof Form
EMC SUPPORT
MyService360
Supportby Product
Downloads
Community
Service Center
Learn aboutCustomerService
Create a Service Request
Manage Service Requests
Chat witha SupportAgent
ViewandManage CompanyInformation
Manage LicensesandUsage Intelligence
Supportfor Dell Products
PARTNERS
Drive yourbusinesstogreatersuccess.Locate partners—orlearnaboutbecomingone.
FindStorage FocusedPartners
FindDell EMC Partners
Dell EMC PartnerProgram
PartnerCommunity
PartnerPortal
RSA Partners
Contact Us
PartnerwithDell EMC today.
Contact Sales
Call 1-866-438-3622
Call 1-866-438-3622
CompanyInformation
Keepupwiththe news,jobs,andinnovationsinITtransformationfromDell EMC.
Dell EMC at a Glance
Newsroom
LeadershipTeam
Sustainability
Dell Technologies
Contact & Office Locations
Dell EMC
176 SouthStreet
Hopkinton,MA 01748
UnitedStates
Glossary
Careersat Dell EMC
Social at Dell EMC
RSS Subscriptions
Email General Inquiries
SalesInquiries
Call 1-866-438-3622
Call 1-866-438-3622
BusinessOverviewBrandInnovationatDell EMCProductSecurity
Top of Form
Search
Bottomof Form
No resultsfound
ViewAll SearchResults
CLOSE
MENU
Products
Solutions
Shop
Support

More Related Content

What's hot

Physical Layer Numericals - Data Communication & Networking
Physical Layer  Numericals - Data Communication & NetworkingPhysical Layer  Numericals - Data Communication & Networking
Physical Layer Numericals - Data Communication & Networking
Drishti Bhalla
 
Chapter 4
Chapter 4Chapter 4
Chapter 4
Faisal Mehmood
 
PAPR Reduction
PAPR ReductionPAPR Reduction
PAPR Reduction
Pei-Che Chang
 
Chapter 5
Chapter 5Chapter 5
Chapter 5
Faisal Mehmood
 
Operating System Concepts - Ch05
Operating System Concepts - Ch05Operating System Concepts - Ch05
Operating System Concepts - Ch05Wayne Jones Jnr
 
04 Digital Transmission
04 Digital Transmission04 Digital Transmission
04 Digital Transmission
Ahmar Hashmi
 
Chapter 6
Chapter 6Chapter 6
Chapter 6
Faisal Mehmood
 
Analog transmission
Analog transmissionAnalog transmission
Analog transmission
Engr Ginna
 
Ch5 1 v1
Ch5 1 v1Ch5 1 v1
Ch5 1 v1
bhagavanprasad
 
Ch06
Ch06Ch06
Research Inventy : International Journal of Engineering and Science
Research Inventy : International Journal of Engineering and ScienceResearch Inventy : International Journal of Engineering and Science
Research Inventy : International Journal of Engineering and Scienceresearchinventy
 
Analog Transmissions
Analog TransmissionsAnalog Transmissions
Analog TransmissionsTechiNerd
 
4g LTE and LTE-A for mobile broadband-note
4g LTE and LTE-A for mobile broadband-note4g LTE and LTE-A for mobile broadband-note
4g LTE and LTE-A for mobile broadband-note
Pei-Che Chang
 
Unit 4 bandwidth utilization
Unit 4 bandwidth utilizationUnit 4 bandwidth utilization
Unit 4 bandwidth utilization
Anjuman College of Engg. & Tech.
 
Lecture-6 Data Communication ~www.fida.com.bd
Lecture-6 Data Communication ~www.fida.com.bdLecture-6 Data Communication ~www.fida.com.bd
Lecture-6 Data Communication ~www.fida.com.bd
QUT (Queensland University of Technology)
 
Chap5 analog transmission
Chap5 analog transmissionChap5 analog transmission
Chap5 analog transmissionarslan_akbar90
 
blake sample-problems
blake sample-problemsblake sample-problems
blake sample-problems
John Joel Martinez
 
Telecommunication System Engineering Notes
Telecommunication System Engineering NotesTelecommunication System Engineering Notes
Telecommunication System Engineering Notes
Haris Hassan
 
Chap 5 analog transmission
Chap 5 analog transmissionChap 5 analog transmission
Chap 5 analog transmission
Mukesh Tekwani
 

What's hot (20)

Physical Layer Numericals - Data Communication & Networking
Physical Layer  Numericals - Data Communication & NetworkingPhysical Layer  Numericals - Data Communication & Networking
Physical Layer Numericals - Data Communication & Networking
 
Chapter 4
Chapter 4Chapter 4
Chapter 4
 
PAPR Reduction
PAPR ReductionPAPR Reduction
PAPR Reduction
 
Chapter 5
Chapter 5Chapter 5
Chapter 5
 
Operating System Concepts - Ch05
Operating System Concepts - Ch05Operating System Concepts - Ch05
Operating System Concepts - Ch05
 
04 Digital Transmission
04 Digital Transmission04 Digital Transmission
04 Digital Transmission
 
Chapter 6
Chapter 6Chapter 6
Chapter 6
 
Analog transmission
Analog transmissionAnalog transmission
Analog transmission
 
Ch5 1 v1
Ch5 1 v1Ch5 1 v1
Ch5 1 v1
 
Ch08
Ch08Ch08
Ch08
 
Ch06
Ch06Ch06
Ch06
 
Research Inventy : International Journal of Engineering and Science
Research Inventy : International Journal of Engineering and ScienceResearch Inventy : International Journal of Engineering and Science
Research Inventy : International Journal of Engineering and Science
 
Analog Transmissions
Analog TransmissionsAnalog Transmissions
Analog Transmissions
 
4g LTE and LTE-A for mobile broadband-note
4g LTE and LTE-A for mobile broadband-note4g LTE and LTE-A for mobile broadband-note
4g LTE and LTE-A for mobile broadband-note
 
Unit 4 bandwidth utilization
Unit 4 bandwidth utilizationUnit 4 bandwidth utilization
Unit 4 bandwidth utilization
 
Lecture-6 Data Communication ~www.fida.com.bd
Lecture-6 Data Communication ~www.fida.com.bdLecture-6 Data Communication ~www.fida.com.bd
Lecture-6 Data Communication ~www.fida.com.bd
 
Chap5 analog transmission
Chap5 analog transmissionChap5 analog transmission
Chap5 analog transmission
 
blake sample-problems
blake sample-problemsblake sample-problems
blake sample-problems
 
Telecommunication System Engineering Notes
Telecommunication System Engineering NotesTelecommunication System Engineering Notes
Telecommunication System Engineering Notes
 
Chap 5 analog transmission
Chap 5 analog transmissionChap 5 analog transmission
Chap 5 analog transmission
 

Similar to B2 b fc credits performance deadlocks

Chapter10 switching
Chapter10 switchingChapter10 switching
Chapter10 switching
Suneel Varma
 
Transport layer issues and challenges - Guide
Transport layer issues and challenges - GuideTransport layer issues and challenges - Guide
Transport layer issues and challenges - Guide
GOPINATHS437943
 
MEDIUM ACCESS CONTROL Sublayer IN CN.ppt
MEDIUM ACCESS CONTROL Sublayer IN CN.pptMEDIUM ACCESS CONTROL Sublayer IN CN.ppt
MEDIUM ACCESS CONTROL Sublayer IN CN.ppt
ssuser35e92d
 
3-MACSublayer.ppt
3-MACSublayer.ppt3-MACSublayer.ppt
3-MACSublayer.ppt
DigiPlexus
 
IEEE CAMAD 2014_LTE Uplink Delay Constraints for Smart Grid Applications
IEEE CAMAD 2014_LTE Uplink Delay Constraints for Smart Grid ApplicationsIEEE CAMAD 2014_LTE Uplink Delay Constraints for Smart Grid Applications
IEEE CAMAD 2014_LTE Uplink Delay Constraints for Smart Grid ApplicationsSpiros Louvros
 
WC & LTE 4G Broadband Module 2- 2019 by Prof.Suresha V
WC & LTE 4G Broadband  Module 2- 2019 by Prof.Suresha VWC & LTE 4G Broadband  Module 2- 2019 by Prof.Suresha V
WC & LTE 4G Broadband Module 2- 2019 by Prof.Suresha V
SURESHA V
 
205583569 gb-interface-detailed-planning-final
205583569 gb-interface-detailed-planning-final205583569 gb-interface-detailed-planning-final
205583569 gb-interface-detailed-planning-finalOlivier Rostaing
 
EMERSON EDUARDO RODRIGUES wcdma-optimization-related-questions-m-com-academy
EMERSON EDUARDO RODRIGUES wcdma-optimization-related-questions-m-com-academyEMERSON EDUARDO RODRIGUES wcdma-optimization-related-questions-m-com-academy
EMERSON EDUARDO RODRIGUES wcdma-optimization-related-questions-m-com-academy
EMERSON EDUARDO RODRIGUES
 
A Carrierless Amplitude Phase (CAP) Modulation Format: Perspective and Prospe...
A Carrierless Amplitude Phase (CAP) Modulation Format: Perspective and Prospe...A Carrierless Amplitude Phase (CAP) Modulation Format: Perspective and Prospe...
A Carrierless Amplitude Phase (CAP) Modulation Format: Perspective and Prospe...
IJECEIAES
 
Vlsic.1998.688086
Vlsic.1998.688086Vlsic.1998.688086
Vlsic.1998.688086
Hoopeer Hoopeer
 
5g-Air-Interface-pptx.pptx
5g-Air-Interface-pptx.pptx5g-Air-Interface-pptx.pptx
5g-Air-Interface-pptx.pptx
Murali Munagapati
 
5G mmwaves - problems and solutions (graduation project)
5G mmwaves - problems and solutions (graduation project)5G mmwaves - problems and solutions (graduation project)
5G mmwaves - problems and solutions (graduation project)
Faculty of Engineering - Alexandria University
 
MAT 510 – Homework AssignmentHomework Assignment 6 Due.docx
MAT 510 – Homework AssignmentHomework Assignment 6 Due.docxMAT 510 – Homework AssignmentHomework Assignment 6 Due.docx
MAT 510 – Homework AssignmentHomework Assignment 6 Due.docx
jessiehampson
 
Ad Hoc Probe
Ad Hoc ProbeAd Hoc Probe
Ad Hoc Probenutikumar
 
Shah Md Zobair(063560056)
Shah Md Zobair(063560056)Shah Md Zobair(063560056)
Shah Md Zobair(063560056)mashiur
 

Similar to B2 b fc credits performance deadlocks (20)

Chapter10 switching
Chapter10 switchingChapter10 switching
Chapter10 switching
 
Transport layer issues and challenges - Guide
Transport layer issues and challenges - GuideTransport layer issues and challenges - Guide
Transport layer issues and challenges - Guide
 
Cnq1
Cnq1Cnq1
Cnq1
 
MEDIUM ACCESS CONTROL Sublayer IN CN.ppt
MEDIUM ACCESS CONTROL Sublayer IN CN.pptMEDIUM ACCESS CONTROL Sublayer IN CN.ppt
MEDIUM ACCESS CONTROL Sublayer IN CN.ppt
 
3-MACSublayer.ppt
3-MACSublayer.ppt3-MACSublayer.ppt
3-MACSublayer.ppt
 
IEEE CAMAD 2014
IEEE CAMAD 2014IEEE CAMAD 2014
IEEE CAMAD 2014
 
IEEE CAMAD 2014_LTE Uplink Delay Constraints for Smart Grid Applications
IEEE CAMAD 2014_LTE Uplink Delay Constraints for Smart Grid ApplicationsIEEE CAMAD 2014_LTE Uplink Delay Constraints for Smart Grid Applications
IEEE CAMAD 2014_LTE Uplink Delay Constraints for Smart Grid Applications
 
WC & LTE 4G Broadband Module 2- 2019 by Prof.Suresha V
WC & LTE 4G Broadband  Module 2- 2019 by Prof.Suresha VWC & LTE 4G Broadband  Module 2- 2019 by Prof.Suresha V
WC & LTE 4G Broadband Module 2- 2019 by Prof.Suresha V
 
OFDM
OFDMOFDM
OFDM
 
205583569 gb-interface-detailed-planning-final
205583569 gb-interface-detailed-planning-final205583569 gb-interface-detailed-planning-final
205583569 gb-interface-detailed-planning-final
 
EMERSON EDUARDO RODRIGUES wcdma-optimization-related-questions-m-com-academy
EMERSON EDUARDO RODRIGUES wcdma-optimization-related-questions-m-com-academyEMERSON EDUARDO RODRIGUES wcdma-optimization-related-questions-m-com-academy
EMERSON EDUARDO RODRIGUES wcdma-optimization-related-questions-m-com-academy
 
A0210106
A0210106A0210106
A0210106
 
A Carrierless Amplitude Phase (CAP) Modulation Format: Perspective and Prospe...
A Carrierless Amplitude Phase (CAP) Modulation Format: Perspective and Prospe...A Carrierless Amplitude Phase (CAP) Modulation Format: Perspective and Prospe...
A Carrierless Amplitude Phase (CAP) Modulation Format: Perspective and Prospe...
 
Vlsic.1998.688086
Vlsic.1998.688086Vlsic.1998.688086
Vlsic.1998.688086
 
5g-Air-Interface-pptx.pptx
5g-Air-Interface-pptx.pptx5g-Air-Interface-pptx.pptx
5g-Air-Interface-pptx.pptx
 
PMC_6G
PMC_6GPMC_6G
PMC_6G
 
5G mmwaves - problems and solutions (graduation project)
5G mmwaves - problems and solutions (graduation project)5G mmwaves - problems and solutions (graduation project)
5G mmwaves - problems and solutions (graduation project)
 
MAT 510 – Homework AssignmentHomework Assignment 6 Due.docx
MAT 510 – Homework AssignmentHomework Assignment 6 Due.docxMAT 510 – Homework AssignmentHomework Assignment 6 Due.docx
MAT 510 – Homework AssignmentHomework Assignment 6 Due.docx
 
Ad Hoc Probe
Ad Hoc ProbeAd Hoc Probe
Ad Hoc Probe
 
Shah Md Zobair(063560056)
Shah Md Zobair(063560056)Shah Md Zobair(063560056)
Shah Md Zobair(063560056)
 

Recently uploaded

FP Growth Algorithm and its Applications
FP Growth Algorithm and its ApplicationsFP Growth Algorithm and its Applications
FP Growth Algorithm and its Applications
MaleehaSheikh2
 
哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样
哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样
哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样
axoqas
 
一比一原版(CU毕业证)卡尔顿大学毕业证成绩单
一比一原版(CU毕业证)卡尔顿大学毕业证成绩单一比一原版(CU毕业证)卡尔顿大学毕业证成绩单
一比一原版(CU毕业证)卡尔顿大学毕业证成绩单
yhkoc
 
一比一原版(QU毕业证)皇后大学毕业证成绩单
一比一原版(QU毕业证)皇后大学毕业证成绩单一比一原版(QU毕业证)皇后大学毕业证成绩单
一比一原版(QU毕业证)皇后大学毕业证成绩单
enxupq
 
standardisation of garbhpala offhgfffghh
standardisation of garbhpala offhgfffghhstandardisation of garbhpala offhgfffghh
standardisation of garbhpala offhgfffghh
ArpitMalhotra16
 
一比一原版(UofM毕业证)明尼苏达大学毕业证成绩单
一比一原版(UofM毕业证)明尼苏达大学毕业证成绩单一比一原版(UofM毕业证)明尼苏达大学毕业证成绩单
一比一原版(UofM毕业证)明尼苏达大学毕业证成绩单
ewymefz
 
一比一原版(RUG毕业证)格罗宁根大学毕业证成绩单
一比一原版(RUG毕业证)格罗宁根大学毕业证成绩单一比一原版(RUG毕业证)格罗宁根大学毕业证成绩单
一比一原版(RUG毕业证)格罗宁根大学毕业证成绩单
vcaxypu
 
一比一原版(Coventry毕业证书)考文垂大学毕业证如何办理
一比一原版(Coventry毕业证书)考文垂大学毕业证如何办理一比一原版(Coventry毕业证书)考文垂大学毕业证如何办理
一比一原版(Coventry毕业证书)考文垂大学毕业证如何办理
74nqk8xf
 
Criminal IP - Threat Hunting Webinar.pdf
Criminal IP - Threat Hunting Webinar.pdfCriminal IP - Threat Hunting Webinar.pdf
Criminal IP - Threat Hunting Webinar.pdf
Criminal IP
 
一比一原版(NYU毕业证)纽约大学毕业证成绩单
一比一原版(NYU毕业证)纽约大学毕业证成绩单一比一原版(NYU毕业证)纽约大学毕业证成绩单
一比一原版(NYU毕业证)纽约大学毕业证成绩单
ewymefz
 
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
John Andrews
 
Malana- Gimlet Market Analysis (Portfolio 2)
Malana- Gimlet Market Analysis (Portfolio 2)Malana- Gimlet Market Analysis (Portfolio 2)
Malana- Gimlet Market Analysis (Portfolio 2)
TravisMalana
 
Criminal IP - Threat Hunting Webinar.pdf
Criminal IP - Threat Hunting Webinar.pdfCriminal IP - Threat Hunting Webinar.pdf
Criminal IP - Threat Hunting Webinar.pdf
Criminal IP
 
做(mqu毕业证书)麦考瑞大学毕业证硕士文凭证书学费发票原版一模一样
做(mqu毕业证书)麦考瑞大学毕业证硕士文凭证书学费发票原版一模一样做(mqu毕业证书)麦考瑞大学毕业证硕士文凭证书学费发票原版一模一样
做(mqu毕业证书)麦考瑞大学毕业证硕士文凭证书学费发票原版一模一样
axoqas
 
Predicting Product Ad Campaign Performance: A Data Analysis Project Presentation
Predicting Product Ad Campaign Performance: A Data Analysis Project PresentationPredicting Product Ad Campaign Performance: A Data Analysis Project Presentation
Predicting Product Ad Campaign Performance: A Data Analysis Project Presentation
Boston Institute of Analytics
 
一比一原版(TWU毕业证)西三一大学毕业证成绩单
一比一原版(TWU毕业证)西三一大学毕业证成绩单一比一原版(TWU毕业证)西三一大学毕业证成绩单
一比一原版(TWU毕业证)西三一大学毕业证成绩单
ocavb
 
Levelwise PageRank with Loop-Based Dead End Handling Strategy : SHORT REPORT ...
Levelwise PageRank with Loop-Based Dead End Handling Strategy : SHORT REPORT ...Levelwise PageRank with Loop-Based Dead End Handling Strategy : SHORT REPORT ...
Levelwise PageRank with Loop-Based Dead End Handling Strategy : SHORT REPORT ...
Subhajit Sahu
 
一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单
一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单
一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单
ewymefz
 
一比一原版(UofS毕业证书)萨省大学毕业证如何办理
一比一原版(UofS毕业证书)萨省大学毕业证如何办理一比一原版(UofS毕业证书)萨省大学毕业证如何办理
一比一原版(UofS毕业证书)萨省大学毕业证如何办理
v3tuleee
 
Data Centers - Striving Within A Narrow Range - Research Report - MCG - May 2...
Data Centers - Striving Within A Narrow Range - Research Report - MCG - May 2...Data Centers - Striving Within A Narrow Range - Research Report - MCG - May 2...
Data Centers - Striving Within A Narrow Range - Research Report - MCG - May 2...
pchutichetpong
 

Recently uploaded (20)

FP Growth Algorithm and its Applications
FP Growth Algorithm and its ApplicationsFP Growth Algorithm and its Applications
FP Growth Algorithm and its Applications
 
哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样
哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样
哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样
 
一比一原版(CU毕业证)卡尔顿大学毕业证成绩单
一比一原版(CU毕业证)卡尔顿大学毕业证成绩单一比一原版(CU毕业证)卡尔顿大学毕业证成绩单
一比一原版(CU毕业证)卡尔顿大学毕业证成绩单
 
一比一原版(QU毕业证)皇后大学毕业证成绩单
一比一原版(QU毕业证)皇后大学毕业证成绩单一比一原版(QU毕业证)皇后大学毕业证成绩单
一比一原版(QU毕业证)皇后大学毕业证成绩单
 
standardisation of garbhpala offhgfffghh
standardisation of garbhpala offhgfffghhstandardisation of garbhpala offhgfffghh
standardisation of garbhpala offhgfffghh
 
一比一原版(UofM毕业证)明尼苏达大学毕业证成绩单
一比一原版(UofM毕业证)明尼苏达大学毕业证成绩单一比一原版(UofM毕业证)明尼苏达大学毕业证成绩单
一比一原版(UofM毕业证)明尼苏达大学毕业证成绩单
 
一比一原版(RUG毕业证)格罗宁根大学毕业证成绩单
一比一原版(RUG毕业证)格罗宁根大学毕业证成绩单一比一原版(RUG毕业证)格罗宁根大学毕业证成绩单
一比一原版(RUG毕业证)格罗宁根大学毕业证成绩单
 
一比一原版(Coventry毕业证书)考文垂大学毕业证如何办理
一比一原版(Coventry毕业证书)考文垂大学毕业证如何办理一比一原版(Coventry毕业证书)考文垂大学毕业证如何办理
一比一原版(Coventry毕业证书)考文垂大学毕业证如何办理
 
Criminal IP - Threat Hunting Webinar.pdf
Criminal IP - Threat Hunting Webinar.pdfCriminal IP - Threat Hunting Webinar.pdf
Criminal IP - Threat Hunting Webinar.pdf
 
一比一原版(NYU毕业证)纽约大学毕业证成绩单
一比一原版(NYU毕业证)纽约大学毕业证成绩单一比一原版(NYU毕业证)纽约大学毕业证成绩单
一比一原版(NYU毕业证)纽约大学毕业证成绩单
 
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
 
Malana- Gimlet Market Analysis (Portfolio 2)
Malana- Gimlet Market Analysis (Portfolio 2)Malana- Gimlet Market Analysis (Portfolio 2)
Malana- Gimlet Market Analysis (Portfolio 2)
 
Criminal IP - Threat Hunting Webinar.pdf
Criminal IP - Threat Hunting Webinar.pdfCriminal IP - Threat Hunting Webinar.pdf
Criminal IP - Threat Hunting Webinar.pdf
 
做(mqu毕业证书)麦考瑞大学毕业证硕士文凭证书学费发票原版一模一样
做(mqu毕业证书)麦考瑞大学毕业证硕士文凭证书学费发票原版一模一样做(mqu毕业证书)麦考瑞大学毕业证硕士文凭证书学费发票原版一模一样
做(mqu毕业证书)麦考瑞大学毕业证硕士文凭证书学费发票原版一模一样
 
Predicting Product Ad Campaign Performance: A Data Analysis Project Presentation
Predicting Product Ad Campaign Performance: A Data Analysis Project PresentationPredicting Product Ad Campaign Performance: A Data Analysis Project Presentation
Predicting Product Ad Campaign Performance: A Data Analysis Project Presentation
 
一比一原版(TWU毕业证)西三一大学毕业证成绩单
一比一原版(TWU毕业证)西三一大学毕业证成绩单一比一原版(TWU毕业证)西三一大学毕业证成绩单
一比一原版(TWU毕业证)西三一大学毕业证成绩单
 
Levelwise PageRank with Loop-Based Dead End Handling Strategy : SHORT REPORT ...
Levelwise PageRank with Loop-Based Dead End Handling Strategy : SHORT REPORT ...Levelwise PageRank with Loop-Based Dead End Handling Strategy : SHORT REPORT ...
Levelwise PageRank with Loop-Based Dead End Handling Strategy : SHORT REPORT ...
 
一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单
一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单
一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单
 
一比一原版(UofS毕业证书)萨省大学毕业证如何办理
一比一原版(UofS毕业证书)萨省大学毕业证如何办理一比一原版(UofS毕业证书)萨省大学毕业证如何办理
一比一原版(UofS毕业证书)萨省大学毕业证如何办理
 
Data Centers - Striving Within A Narrow Range - Research Report - MCG - May 2...
Data Centers - Striving Within A Narrow Range - Research Report - MCG - May 2...Data Centers - Striving Within A Narrow Range - Research Report - MCG - May 2...
Data Centers - Striving Within A Narrow Range - Research Report - MCG - May 2...
 

B2 b fc credits performance deadlocks

  • 1. B2B FC CREDITSPERFORMANCEDEADLOCKS Jan 31, 2013 3:17 PM ( So thiswasabout gettingthe link"up"onboth ends,butwhataboutactuallysendingdataaccross those links?Longerlinkscanactuallycontainmultiple fibrechannel frames!!The speedof lightisn'tinfinate, so ittakestime (microsecondstosub milli seconds) foraframe to actuallytravel fromTx (transmitter) to Rx (receiver). If a fibre opticpathisan FCISL, theninknowingitsline bit-length,we cancalculate the maximum numberof framesthat can simultaneouslyfit(source todestinationandback) onthat physical link.That numberisthe exactanmountof buffertobufferscreditsyourISLswitchportswill require. Why? To safelystore-and-forwardframesatthe source end,while theyare still intransittothe destination port,and acknowledgedashavingbeenreceived.Sothe sendingswitchwill keepthatframe ina buffer while the ACKhasn'tbeenreceived. To provide a“successfullysent”I/Oacknowledgmenttothe sendingportor HBA soit doesnothave to waitfor the frame to reach the otherside of the link,andthe acknowledgmentthathasto come back. So if youupgrade a port'sspeedfrom2 to 4 Gbps for example,the amountof framesthatcan be on the linksimultaniouslydoubledandthe amountof B2B creditshasto be doubledaswell. Please note thatalthoughthe linkbetweensitescanbe fastenoughandhave enoughbuffercreditsto facilitate linerate communication,the receivingarraycan still be a bottleneckwhichcancause the sendingside toslowdown.Considerforexample MirrorView orSRDF.The primarystorage array is writtentoby a numberof hostsand the the back endof the primaryarray can handle the amountof IOps.All I/Osthatwere writtenare alsosentto the secondaryarray to be replicated.If the receivingend cannot handle thatamountof (write) IOpsbecause the numberof disksistoolow orthere'snot enough cache available,the receiving(busy) arrayisprocessingthe incomingI/Osnotasfastas the ISLbetween the sitescan provide andsoacknowledgementsaren'tsentbackto the primaryarray instantaniously, but a little bitslower.Sointhe endthe sendingapplication receivesthisacknowledgementsomewhat laterand we all knowthat comminucationisbuiltonsend/receive andACK,right?If the ACKcomesin slow,the conversationisslowerthanyou'dlike ittobe.
  • 2. So configuringthe linkbetweensitesisone thing,sizingthe recveivingarrayisanother(important) thing! Before we beginanexample of howtocalculate bufferrequirements,itisimportanttoknow the numerical definitionof aFibre Channel Gigabit,aswell astounderstandthe structure of a Fibre Channel Frame. In the Fibre Channel world,one gigabitisdefinedtobe 1,062,500,000 bits(whichisnot 1024x1024x1024). Other Fibre Channel Gigabitvaluesare thenderivedfromthisreference definition. For example,two(Fibre Channel) Gb=2 x 1,062,500,000 bits= 2,125,000,000 bits.To avoidconfusion withthe traditional (nonFibre Channel) definitionof aGb, throughoutthisdocumentIwill use the symbol Gbfcto mean“1,062,500,000 bits”,or 1 Fibre Channel Gb. In summary: 1 Gbfc = 1,062,500,000 2 Gbfc = 2,125,000,000 4 Gbfc = 4,250,000,000 8 Gbfc = 8,500,000,000 10 Gbfc = 10,625,000,000 16 Gbfc = 17,000,000,000 Next,we showthe anatomyof a Fibre Channel Frame withnotes. Start of Frame:4 bytesor 32 bits StandardFrame Header:24 bytesor192 bits Data (payload):[0– 2,112] bytesor [0 – 16,896] bits CRC: 4 bytesor32 bits End of Frame: 4 bytesor 32 bits TOTAL (Nbrbits/frame):[36– 2,148] bytesor 288 – 17,184 bits Notes: The term byte usedhere means8 bits(notthe 10 bitsthat resultfrom 8/10 bitencoding). The maximumFibre Channel frame sizeis2,148 bytes. The final frame size mustbe a multiple of 4bytes.Thusthe Data (payload) segmentwill,asnecessary, be paddedwith1 to 3 “fill-bytes”toachieve anoverall 4byte frame alignment.
  • 3. The standard Frame Headersize is24 bytes.However,upto64 additional bytes(foratotal of an 88 byte header) canbe includedforapplicationsthatneedextensive control information.Since the total frame size cannotexceedthe maximumof 2,148 bytes,these additional Headerbyteswillsubtractfromthe Data segmentsize byas muchas 64 bytes(perframe).Thisiswhythe maximumData(payload) size is 2,112 (because [2,112 – 64] = 2,048, whichisexactly2K-bytesof data). The final frame,once constructed,ispassedthroughthe 8 byte to 10 byte conversionprocess. In the FC world,1 Word = 4 x 8/10 bit encodedbytes(40bits). Thenwe have the speedof light: 299,792.458 km/ s == 0.00000333564095 s / km, so that's 3.33564095 microsecondsperkilometer, that's 3.3 millionthof asecondfor eachkm "traveled". NOTE: thisisin vacuum!I'll adjustthe outcome later.The speedof lightinfiberisapproximately 200,000 kmper secondinsteadof almost300,000. Nextwe take the lineardistance betweenthe twositesanddetermine: How manysecondsittakesfor 1-bitto travel the one-waydistance linearbetweenthe twosites;thatis, expressthe “distance”betweenthe twositesinseconds.Thisisdeterminedbythe speedof light. Havingdetermined the one-waydistance insecondsbetweenthe twosites(afixednumber),we can nowdetermine the maximumnumberof bitsthatcan exist,intransit,betweenthe twositesatanyone time.Inotherwords,we can calculate the “distance”betweenthe twosites inbits(asopposedto miles).Thisisdeterminedbythe speedof light,aswell asbythe rate at whichthe transmitting equipment(e.g.afibre channel port) cancreate electrical variationsontothe medium(i.e.fibre optic line).Inotherwords,howfastcan itpush bitsontoone endof the fibre opticline (usually1Gbfc,2 Gbfc, 4 Gbfc or 10 Gbfc). Let say,for the purposesof discussion,thatwe have redundant(i.e.two) fibre opticpathsbetweena primaryand secondarysite. The lineardistance (asopposedtodisplacement)is91.732608 Km (or about57 miles) forone path,and 43.452288 km(or about27 miles) forthe otherpath. Suppose the linkspeedis2Gbfc: Distance (Km) Distance (secs) # of Bits(1Way) 8/10 FC bytes 91.732608 (57mi) 0.000305987044 650,222.468 65,022.2468 43.452288 (27mi) 0.000144941231 308,000.116 30,800.0116 Again:thisisin vacuuminsteadof fiber!Butstaywithme,I'll fix itlateron!!
  • 4. Calculationsnotesforthe tablesabove: Column2 indicates the amountof time (inseconds) ittakesone OPTICALVARIATION (howevermany numberof bitsthat optical variationhappenstorepresent) totravel the one-waydistance specifiedin columnone.Itcomesfrom multiplyingthe numberof secondsittakeslight totravel 1 km (i.e. 0.00000333564095 s / km),bythe numberof km traveledwhich,isspecifiedinthe firstColumn. Column3 is the productof column2 (i.e.the line distance inseconds) andthe FCbitinsertionrate (2,125,000,000). This columneffectivelyrepresentsthe amountof additional I/Othatcouldhave been processedatthe host,had the response tothat I/Obeeninstantaneous;(actuallytwice thatamount, since acknowledgmenttime forthose I/O’s,comingbackthe otherway,have to be accounted foras well). Column4 is Column3 dividedby10.This isdone to groupsingle bitsintransitintoequivalent8/10bit “byte”quantities.The Fibre Channel protocol convertsevery8bitbyte intoa 10 bit equivalent(viathe 8/10 bit encodingalgorithm) before transmittingit.Sothe value inthisColumn4will determine the numberof buffersneededforanISL switchport. Frame Length8 (inkm) = (299,792.458 km/s) x (Seconds-Between- Inserted-Bitssecs/bit) x (Number-Of- Bits-Per-Framebits) Frame Length10 (inkm) = (299,792.458 km/s) x (Seconds-Between- Inserted-Bitssecs/bit) x (Number-Of- Bits-Per-Framebits) x 10/8 Where: Seconds-Between-Inserted-Bits=1/1,062,500,000 (for1Gbps FC) = 1/2,125,000,000 (for2Gbps FC) Number-Of-Bits-Per-Frame=Variable dependingonDatapayloadand/orHeadersize.See table and notesabove.Inmostcases the Headerwill be the Standardsize of 24 bytes. Numberof bits/ frame (after8/10 bitencoding) Frame Length(km) @ 2 Gbps FC (.000141078803764705 km/bit) Numberof in-transitframes(1- way) for 91.732608 km leg. 17,184 / 21,480 3.0303 km (2112 PL-bytes) 30.2170 frames(buffers) Andagain: thisisvacuum,not infiber!!!Staywithme a little bitlonger.... Notes: Column1 representsthe total numberof 8/10 bitsin a Fibre Channel frame (withastandardheadersize of 24 bytes) atvaryingData payloads(PL).
  • 5. Column2 representsthe productof the 10 bitvalue inColumn1, and (1/2,125,000,000). Thus,this Column(Column2) essentiallyrepresentsthe lineardistance that1 (one) single frame consumesforthe specifiedpayload(PL). Column3 representsthe quotientderivedbydividingthe longest(worstcase) DWDMline distance (in kilometers),bythe numberof kilometersperframe (calculatedinColumn2).Thus,thiscolumn essentiallyindicateshowmanyadditionalONE-WAYframesworthof datacouldhave beenprocessedby the host/application,hadthe response tothe firstframe beeninstantaneous.Inotherwords,thisishow manyONE-WAY(notround trip) switch buffersyouwouldneedtoallow non-stoptransmission.Double (i.e.roundtrip) the valuesinthiscolumn3to yieldthe numberof buffersrequiredof yourISLswitch ports. So inour example forrunning2longlinksusing2 Gbfc speed(invacuum): the numberof B2B creditsneededforthe 91.7 km legwill be 2 x 30.2 = 60.4, soroundingupto 61 B2B credits. the numberof B2B creditsneededforthe 43.4 km legwill be 2 x (43.4/91.7) = 2 x 14.3 = 28.6, so roundingupto 29 B2B credits. Can't we make a rule of thumbout of this? I admit,the numbersIusedare takenfroman example documentIhave lyingaroundsoI didn'tneedto the math myself ,butmakinga ROT out of itbackfiresatme. The easiestwayto calculate the rule of thumbisgettingbackto 1 km, soat 2 Gbfc speedthe numberof B2B creditsneededfora1 km linkis2 x 30.2170 / 91.732608 = 0.6588 IN VACUUM. Otherexampleswe cannowuse to more easilyrememberthese"nice"numbers: 2 Gbfc overa 2 km link= 2 x 0.6588 = ± 1.32 4 Gbfc overa 2 km link= 4 x 0.6588 = ± 2.64 4 Gbfc overa 20 km link= 40 x 0.6588 = ± 26.4 So whatwouldbe a nice numberto remember?4Gbfc requires1.3x the numberof km? 1.33 x the numberof km? I guesswe have justcreateda rule of thumb!1.33 can be rememberedveryeasily! Right? So runninga 4Gb linkover44 km requires1.33 x 44 = 58.52 := 59 B2B credits.
  • 6. A 2 Gbfc linkusingthe same distance (44km) will needhalf of that,so30 B2B credits.Sohalf the speed, half the buffercredits,doublethe speed,doublethe buffercredits. HOWEVER: the speedof lightinvacuumneedstobe devidedbythe refractionindexof fiber,whichis about1.5. BuffersRule of Thumb(takingthe actual speedof lightintoaccount): 4 Gbfc needs1.33 times1.5 timesthe distance inkilometer=1.995 buffersperkilometer Thisextra1.5 is because of the refractionindex of the carrierused.Mostfibershave anindex of approximately1.5,whichwill "slowdown"the speedof lighttoabout200,000 kilometerspersecond. A longdistance connectionrunningat4 Gbfc needs2buffersperkilometer A longdistance connectionrunningat4 Gbfc needs3.22 bufferspermile (fromkm to mile youneedtomultiplythe outcome inkmby1.609, whichisnotthat easyto remember, but youcan figure outa numberthatworksfor you,right?) EMC as well asBrocade recommendaddinganextra20% B2B creditsto the amountyou justcalculated. Message waseditedby:RRR Added20% extrasimilartothe bestppracticesbyEMC and Brocade. ReportAbuse Like Show2 Likes(2) 16. Re:Ask The Expert:Discussingthe challengesof LongDistance Links RRR Nov20, 2012 3:17 AM(inresponse toRRR) If anyone thinksImade a mistake here,please informme,sowe can setthisstraight. ReportAbuse Like Show0 Likes(0) 17. Re:Ask The Expert:Discussingthe challengesof LongDistance Links Vincze Nov20, 2012 4:48 AM(inresponse toRRR)
  • 7. Nice breakdown,RRR ReportAbuse Like Show1 Like (1) 18. Re:Ask The Expert:Discussingthe challengesof LongDistance Links RRR Nov20, 2012 6:01 AM(inresponse toVincze) Thanks.AndI almostlostmy post!!WhenI was done Iaccidentlyswitchedtothe advanced editorand nothinghappened....aaaargh!FortunatelyIcopiedthe html texttonotepadonlyaminute before,soI was able torestore mypost. Tookme an hourand a half or so to type this,so I wasgladit wasn't lostin the end. So whatabout this1.33 factor for a 4Gb link?Doyouthinkit's correct?I can't findanyerrorsin my calculations ReportAbuse Like Show0 Likes(0) 19. Re:Ask The Expert:Discussingthe challengesof LongDistance Links JonKlaus Nov20, 2012 7:32 AM(inresponse toMark) AndI was afraidmy postwas long...yikes! I originallycalculatedall buffercreditsbackfrom2gbit,whichis/was1creditper km.4Gbit wouldneed 2 creditsperkm,etc. Don't forgetthat toomuch creditscan't harm performance (assumingyou're notrunningshortonother links),andthatyoucan alwaysmonitorcreditusage onthe switch.CiscoDevice Managerhasa counter that showsthe slackyou've got:
  • 8. In thiscase it's an ISL that's maybe a couple of hundredmeterslong,soitcan cope with1 or 2 credits dependingonactual speedanddistance.The portisneverthelessassigned32credits,of which32 are still available(seebottom2numbers,CurrRxBbCreditsandCurrTxBbCredits. ReportAbuse Like Show1 Like (1) 20. Re:Ask The Expert:Discussingthe challengesof LongDistance Links RRR Nov22, 2012 1:43 AM(inresponse toMark) Tonight(Europe time) we plannedtodothe TweetChat,butyesterday SeanThulin mentionedtousover TwitterthatThursday Novthe 22nd isThanksgivinganditmightnotbe a goodday for the TweetChat. So aftersome careful considerationswe decidedtomove the TweetChattonextMonday,November the 26th. Same time,same place,newday! ReportAbuse Like Show0 Likes(0) 21. Re:Ask The Expert:Discussingthe challengesof LongDistance Links JonKlaus Nov23, 2012 4:26 AM(inresponse toRRR) Happy Thanksgivingeveryone inthe USand aroundthe world!I hope the turkeytastedgood! So..A lotof people are readingthistopic,butthe repliesare abiton the low side.Isthere no-one else that wantsto share theirexperienceswithlongdistance links?Are longdistancelinksthateasy?
  • 9. Please join the conversation;we won'tbite! ReportAbuse Like Show1 Like (1) 22. Re:Ask The Expert:Discussingthe challengesof LongDistance Links RRR Nov28, 2012 2:49 AM(inresponse toJonKlaus) So we talkedaboutlight,multi mode andsingle modeaswell asattenuation.Sothe maximumdistance isdefinedbyhowsensitive the Rx side is. Alsowe explainedwhyBuffertoBufferCreditsare neededandhow youcalculate how manyof these youneed. So the nextthingwe'dlike todiscussisa wayto make optimal use of the expensivefiberlinkyoumight have.A way to do thisisby usingcolors.Since lasersare monochromaticanywayusingasort of prismto bundle colorscomingfromdifferentlasersintoasingle multicoloredbeamisthe solution! TechniqueslikeCWDM,DWDM andEWDM were developedtofacilitateasmanycolorsas possible into a single beam. WDM standsfor wavelength-divisionmultiplexing.Multiplexingsaysitall:itcombinesmultiple source intoone. The bestknownWDM productis CWDM: Course WDM. In 2002 the standardwas setfor CWDM as using wavelengthsbetween1270 and1610 nm as well ashaving20 nm spacingsbetweenthe "colors".The mostcommonlyusedCWDMMultiplexers(the prisms) provide 8connectionsso8 sendinglongwave ports can use the same physical darkfiber.Andalthougheachof these "colors"isnamedaftera visible color(like brown,yellow,blue andsoon) the actual wavelengthsare farbeyondthe visibilityof the humaneye. The wavelengthsbetween1270 and 1470 are consideredunusablebecause of the increased attenuation,soonly1470 to 1610 issupported.
  • 10. The "colors"usedfor CWDM are: 1470 nm (gray) 1490 nm (violet) 1510 nm (blue) 1530 nm (green) 1550 nm (yellow) 1570 nm (orange) 1590 nm (red) 1610 nm (brown) The mentioned colorsare the namesCiscocallsthese differentwavelength.Byusingcoloredtagson each SFPthe humaneye can noweasilyidentifyeachwavelength. Needlesslytosaythat to connecta networkonsite A usingforexample the 1530 nmwavelength,the same wavelengthof 1530 nm is neededonsite B.
  • 11. CWDM isunaware of the protocol usedtotransport data accross,so you can easilycombine tcp/ip,fibre channel andevenanalogue tvsignalsaslongas eachsignal usesa differentwavelength. ReportAbuse Like Show1 Like (1) 23. Re:Ask The Expert:Discussingthe challengesof LongDistance Links JonKlaus Nov23, 2012 8:22 AM(inresponse toRRR) So we knowhowto getthe signal acrosslongdistancesandwe know how to efficientlyloadthe link usingbuffercredits.If we needmore bandwidththanone linkcandeliver,we cansenddifferent wavelengthsoverone linkusingCWDMandDWDM to make thingsevenmore efficient.Butthere'sone thingwe can't influence (much):latency. Whenwe sendinformationbetweentwodistanceswe use light.The speedof lightis299,792,458m/s. Thisis ina vacuum; infiberit'sa bit lower,somewherearound200,000,000m/s. Puttingitdifferently, that's 200,000km/s or 200km/ms. This meansthatif we wantto cover200km of distance,we'll have 1ms of latencybetweenputtinglightonthe fiberandthe otherendseeingit. To performreliable communications,we can'tsignal uni-directionallyandleave itatthat.We wantto knowif the data arrivedat the other endintact.Thismeansthat we needtouse the bi-directional latency,alsocalledround-triptime.Our200km linkisnow costingus 2ms of latency.Nottoo much right?Well...helloSCSI! FC data transportusesSCSIcommands.If we assume Iwill be the sendingstorage arrayonthe source endand RRR will be the receiving storage onthe otherend,our(SCSI) conversationwouldbe something alongthe linesof: RTT direction1:HeyRRR,I wantto sendyou some data. RTT direction2:Sure Jon,goahead. RTT direction1:Okay,here isthe data. RTT direction2:ThanksJon,gotit ingoodshape. Or, since a picture saysmore than a thousandwords,a picture fromthe Brocade whitepapers:
  • 12. Thismeansthat insteadof 1ms latency,our200km linkisactuallycostingus4ms of latency.Andthat's onlyforthe linkitself. If we send32KB of data,we also needtoput that onthe line.IgnoringFCframe overhead,at1Gbit/sa 32KB I/Otakes0,244ms to load.You can compare thisto a truck enteringthe highway:once the front fendercrossesthe startingline,the backof itis still not"loaded"ontothe highway. If we alsohave protocol convertersinbetweensource anddestination(because forexampleyouswitch fromFC to FCIPand at the otherendback fromFCIPto FC) youwill needtoaddanother0,5ms for each conversion.With4round-trips,you'll endupwith4msof protocol conversiontime. So we've got4ms of delaydue tothe speedof light.We have 4ms due to protocol conversionsor routers.Andwe have 0,244ms of latencydue tothe fact we can onlyloadthe data on the line at 1Gbit/s.Addit all up and at 200km youhave an additional latencyof 8,244ms. Consideringthataunmirroredwrite I/Othatishittingwrite cache onlycostsus somethinginthe neighborhoodof 0,5ms,thisisa lot.Switchon mirroringoverthatsecondarylinkandyourwrite latency isnow 0,5 + 8,244 + 0,5ms = 9,244ms. If the secondarystorage systemisalsorunningoutof write cache and needstoforce flush,you're ina worldof pain... Moral of the story:be careful of synchronousreplicationoverlongdistances! Andhave a goodweekend... ReportAbuse Like Show1 Like (1)
  • 13. 24. Re:Ask The Expert:Discussingthe challengesof LongDistance Links JonKlaus Nov26, 2012 10:07 AM (inresponse toJonKlaus) Andwe're off withthe tweetchat!Joinusontwitterwithhashtag#EMCATE or go the the following website:http://tweetchat.com/room/EMCATE Hope to see youthere for questions,commentsorjust a casual chat! ReportAbuse Like Show0 Likes(0) 25. Re:Ask The Expert:Discussingthe challengesof LongDistance Links RRR Nov26, 2012 12:13 PM (inresponse toJonKlaus) We talkedaboutFCIP,buffervcredits,inorderdelivery,portgroups,sharedbandwidth,butalsoSONET OC-48 to coveralmost1,000 miles.Prettyimpressive! Lots of questions,lotsof answer,butstill alotof unansweredones.Needmore time....... ReportAbuse Like Show0 Likes(0) 26. Re:Ask The Expert:Discussingthe challengesof LongDistance Links RRR Nov27, 2012 3:50 AM(inresponse toRRR) I fixedit.Itotallyforgotaboutthe speedof light,whichislowerinfibercomparedtovacuum.It'sabout 1.5 timesslower,sothe speedof lightinfiberisapproximately200kkm/s. Thismeansmore frameswill live onthe link,somore buffersare needed. ReportAbuse Like Show0 Likes(0) 27. Re:Ask The Expert:Discussingthe challengesof LongDistance Links
  • 14. merlijnNov27,2012 4:59 AM(inresponse toJonKlaus) Hi Jon, Can the counteractuallydropto 0, or is1 the minimum? Because there’salwaysatleast1 BBC for a port. ReportAbuse Like Show0 Likes(0) 28. Re:Ask The Expert:Discussingthe challengesof LongDistance Links JonKlaus Nov27, 2012 5:46 AM(inresponse tomerlijn) Hi Merlijn, Yes,the countercan actuallydropto 0. At that point,transmissionof new frameswillhaltuntill atleast 1 ACKisback and the counteris incrementedagain. If you run the followingCLIcommandagainstan interface,forexample fc1/1: sh intfc1/1 countersdetails|grepcredit You will see somethinglike: 0 waitsdue to lackof transmitcredits 14576233333 transitionsof tx BB creditout of zero state 14 transitionsof rx BB creditto zero state I had to google abit to make sense of it..apparently"transitionsof tx BBcreditout of zero state" does not indicate aproblem.Ihave resetthe countersandit keepsincrementing;the othertwovalues remain0. Thisis a 1km linkwhichhas32 credits,so ithardlyeverdipsunder31. ReportAbuse Like Show0 Likes(0) 29. Re:Ask The Expert:Discussingthe challengesof LongDistance Links
  • 15. RRR Nov27, 2012 7:22 AM(inresponse toJonKlaus) 0 waitsdue to lackof transmitcredits 14576233333 transitionsof tx BB creditout of zero state 14 transitionsof rx BB creditto zero state Is this"waitsdue to lackof transmitcredits"cumulativeorsimplyacounterfora certainpointintime to presentthe value atTHAT moment?Ibet that if it'scumulative,youcaneasilytrackbuffershortages and act uponthat. ReportAbuse Like Show0 Likes(0) 1 2 3 PreviousNext Go to original post Actions More Like This No similarcontentfound IncomingLinks Re: Askthe Expert:SAN (Connectrix), FCConnectivityRecommendationsandBestPractices Re: Askthe Expert:SAN (Connectrix),FCConnectivityRecommendationsandBestPractices Re: Re:Askthe Expert:SAN (Connectrix),FCConnectivityRecommendationsandBestPractices Re: Howto buildanHA SQL cluster Re: Mirrorview/Sperformance impact Dell Technologies©2017 EMC Corporation.All rightsreserved.PrivacyLegalIntelContactUnitedStates You are onthe Dell EMC UnitedStateswebsite.If you wouldlike tochange yourpreferredlanguageor countryof origin,please clickhere. Products Solutions Shop Support Services
  • 16. Partners Company My AccountLogIn BROWSE PRODUCTS Data Storage Servers ConvergedInfrastructure Data Protection Security Networking Dell ProductsforWork SearchProductsby Name ProductsA-Z ShopEMC Products ProductCommunity Software Downloads Contact Sales Call 1-866-438-3622 Call 1-866-438-3622 Storage Categories Data Storage OverviewEnterprise StorageEntry&Midrange StorageSoftware DefinedStorageAll-Flash StorageCloudStorageStorageManagement&Networking Storage ProductFamilies ElasticCloudStorage (ECS)IsilonScaleIOUnityViPRVMAXAllFlashVNXXtremIO ServerOverviewRackServersTowerServersModularInfrastructure ServersServersOptimizedforSDS ConvergedInfrastructure Categories ConvergedInfrastructure OverviewConvergedSystemsHyper-convergedSystemsHybridCloudPlatforms
  • 17. Converged Infrastructure ProductFamilies VxRackSDDCVxBlockVxRackFLEXVxRailVisionSoftwareVscale ArchitectureXCSeries Data ProtectionCategories Data ProtectionOverviewDataBackupandProtectionStorageDataBackupandProtectionSoftwareData ProtectionSuitesCloudBackupandProtectionCopyDataManagement Data ProtectionProductFamilies Data DomainDataProtectionSuite Detect,investigate,andrespondtoadvancedthreats.Confirmandmanage identities.Ultimately, preventIPtheft,fraud,andcybercrime. Explore productsandsolutionsfromRSA. VisitRSA.com NetworkingOverviewSwitchesRoutersandWirelessNetworking OverviewDell LaptopsDellDesktopsDell ThinClientsandVDIProducts Top of Form Search Bottomof Form No resultsfound No results found BROWSE SOLUTIONS All-Flash Big Data Cloud ConvergedInfrastructure Data Protection ServerSolutions HighPerformance Computing NetworkingSolutions Software Defined Virtualization
  • 18. IT Transformation Modernize,automate andtransformyourbusiness. Contact Us Let’stalkabout yourIT transformation. Contact Sales Call 1-866-438-3622 Call 1-866-438-3622 SHOPNOW Data Storage Servers ConvergedInfrastructure Data Protection Security Dell ProductsforWork Questions? We can help. Contact Sales Call 1-866-438-3622 Call 1-866-438-3622 How to Buy International Sales Entry and Midrange StorageEnterpriseStorageAll-FlashStorageSoftware-definedStorageStorage ManagementandNetworkingCloudShopAll DataStorage Products Rack ServersServersOptimizedforSDSModularInfrastructure Servers ConvergedSystemsHyper-convergedSystemsHybridCloudPlatformsShopAll ConvergedInfrastructure Products Backup andProtectionStorageBackupandProtectionSoftwareShopAll DataProtectionProducts OverviewDell LaptopsDellDesktopsDell ThinClientsandVDIProducts ShopAll SecurityProducts
  • 19. DELL EMC SERVICES& EXPERTISE Accelerate yourbusinessandITtransformationwithcloud,bigdata,andtechnologyconsultingand services. ProfessionalServices CustomerService Training& Certification Dell IT Lifecycle Services Contact Us Let’stalkabout yourIT service needs. InFocus Gain insightsandexpertise onthe topicsshapingITTransformation—visitInFocus. Contact EMC Support Contact Sales Call 1-866-438-3622 Call 1-866-438-3622 Top of Form Search Bottomof Form EMC SUPPORT MyService360 Supportby Product Downloads Community Service Center Learn aboutCustomerService Create a Service Request Manage Service Requests Chat witha SupportAgent ViewandManage CompanyInformation
  • 20. Manage LicensesandUsage Intelligence Supportfor Dell Products PARTNERS Drive yourbusinesstogreatersuccess.Locate partners—orlearnaboutbecomingone. FindStorage FocusedPartners FindDell EMC Partners Dell EMC PartnerProgram PartnerCommunity PartnerPortal RSA Partners Contact Us PartnerwithDell EMC today. Contact Sales Call 1-866-438-3622 Call 1-866-438-3622 CompanyInformation Keepupwiththe news,jobs,andinnovationsinITtransformationfromDell EMC. Dell EMC at a Glance Newsroom LeadershipTeam Sustainability Dell Technologies Contact & Office Locations Dell EMC 176 SouthStreet Hopkinton,MA 01748 UnitedStates Glossary Careersat Dell EMC
  • 21. Social at Dell EMC RSS Subscriptions Email General Inquiries SalesInquiries Call 1-866-438-3622 Call 1-866-438-3622 BusinessOverviewBrandInnovationatDell EMCProductSecurity Top of Form Search Bottomof Form No resultsfound ViewAll SearchResults CLOSE MENU Products Solutions Shop Support