WPC9   z]QV93ږݏO4F $ryų zn{c5FMpx㋦=mٵFyg /^G*S1,o3C} _U!GgPP{[6J܂$e42^gA.r_6\ 4t~zMzWy/NKlz ƺ=fUN؎ u×v:=i8'ϓcGXoIHh+u8_~r7vo3[_ߋAV%x>TֳxJ$C'1# 0R.5 kb9Z89:^84he~ޔ|Y#U N % 0(^  w' 4+ ? N mP 1g 1 1 1 N 1 1" 1 0Tc0 0 w 1u  72 1 728 1j 72 0# 0 0  0  0 & 0  1f(a*f>a@ 0 T 0 / 1 1 1. 1 1< 1 1J 1 1X 1 1n 1 1| 0 0l 0DWfa 0 0 0x! 0W"C3# 0v( 0O) 0%* 0+ 0+ 0, 0- 0S. 0 / 0/ 00 0u1 0P2 0(3 03 04 05 0j6 037 07D8 0N9 BN9:k9B9HP Color LaserJet 4500 PCL 6,,,,,,0(9 Z6Times New Roman RegularX($i*s bY*Q 3|xU(ehCEOYcmwAutoList41.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 (uhCEKQW]cioAutoList51.1.1.1.1.1.1.1.(hCEKQW]cioAutoList61.1.1.1.1.1.1.1.(hCEKQW]cioAutoList71.1.1.1.1.1.1.1. 6(CEKQW]cioAutoList11.a.1.1.1.1.1.1.(hCEKQW]cioAutoList81.1.1.1.1.1.1.1.(hCEKQW]cioAutoList91.1.1.1.1.1.1.1.(;3$2#  0  .3  0  (O;$0  2#  a  .3  0` (#(#3#37=CIQYag1.a.i.(1)(a)(i)1)a)i)(CEKQW]cioAutoList21)1)1)1)1)1)1)1)1)(CEKQW]cioAutoList31)1)1)1)1)1)1)1)1)2G+J 0_level1  X /%4 4 <DL/23  ..  2( 4 <DL2  2D+J 0_level2   ," <DL,23  ..  2( 4 <DL2  (b$0  0` (#(#2#   .3  0 ` (#` (#(xir$0  0` (#(#0 ` (#` (#2#(  0  )3  0 (# (#($0  0` (#(#0 ` (#` (#0 (# (#2#(  a  )3  0h(#(#(F$0  0` (#(#0 ` (#` (#0 (# (#0h(#(#2#(   )3  0h(#h(#(գEGMSY_ekqAutoList101.1.1.1.1.1.1.1.pTABLE A'TABLE B($0  0` (#(#0 ` (#` (#0 (# (#0h(#(#0h(#h(#2#  0  )3  0(#(#({$0  0` (#(#0 ` (#` (#0 (# (#0h(#(#0h(#h(#0(#(#2#  a  )3  0p(#(# &'xAGaeimquy}Bullet ListBullets List(EGMSY_ekqAutoList111.1.1.1.1.1.1.1.(EGMSY_ekqAutoList121.1.1.1.1.1.1.1.(EGMSY_ekqAutoList131.1.1.1.1.1.1.1.(EGMSY_ekqAutoList141.1.1.1.1.1.1.1.(%EGMSY_ekqAutoList15I.I.I.I.I.I.I.I.(5EGMSY_ekqAutoList161.1.1.1.1.1.1.1.(EEGMSY_ekqAutoList171.1.1.1.1.1.1.1. ;EGMQW]cioAutoList181."1.1.1.1.1.1.  &'hZEGKOSW[_cAutoList19"""""""")1)a) &'hpZEGKOSW[_cAutoList20"""""""")1)a) &'hZEGKOSW[_cAutoList21"""""""")1)a)(5EGMSY_ekqAutoList221.1.1.1.1.1.1.1.2A+J 0_level3   ) <DL)23  ..  2( 4 <DL2  ((3$ !      0  (#$  0  T:TABLE C2>+J 0_level4  ` &<<DL&23  ..  2( 4 <DL2  2;+J 0_level5   #DL#23  ..  2( 4 <DL2  28+J 0_level6    DL 23  ..  2( 4 <DL2  25+J 0_level7  h DDL23  ..  2( 4 <DL2   9 7$    1    _XXԀ_WSOM_ԀChapterD31statesthe_BECMG_Ԁ_GGGeGe_group shallbeusedtoindicateachangetoforecast  prevailingconditionsexpectedtooccurateitheraregularorirregularrateatanunspecifiedtimewithintheperiod t GGto_GeGe_.Hence,_BECMG_Ԁgroupsintroducesomeambiguityastowhenthenewprevailingconditionsare 8 expectedtotakeeffect.Forflightbriefingandverificationpurposes,thebeginningvalidtimeofthenewprevailing L conditionsisalwaysassumedtobetheendtime(_GeGe_)ofthe_BECMG_Ԁgroup.Forexample,witha_BECMG_Ԁ2123  group,AviationVerifyverifiestheoldprevailingconditionsuntiljustbefore2300_UTC_Ԁandbeginsverifyingthe  newprevailingconditionsat2300_UTC_.#XXS#22+J 0_level8   L23  ..  2( 4 <DL2  2/+J 0_level9    L23  ..  2( 4 <DL2  2GJ 0_levsl1  X /%4 4 <DL/23  Ԁ  2( 4 <DL2  2DJ 0_levsl2   ," <DL,23  Ԁ  2( 4 <DL2  2AJ 0_levsl3   ) <DL)23  Ԁ  2( 4 <DL2  2>J 0_levsl4  ` &<<DL&23  Ԁ  2( 4 <DL2  2;J 0_levsl5   #DL#23  Ԁ  2( 4 <DL2  28J 0_levsl6    DL 23  Ԁ  2( 4 <DL2  25J 0_levsl7  h DDL23  Ԁ  2( 4 <DL2  22J 0_levsl8   L23  Ԁ  2( 4 <DL2  2/J 0_levsl9    L23  Ԁ  2( 4 <DL2  2GJ 0_levnl1  X /%4 4 <DL/23   2( 4 <DL2  2DJ 0_levnl2   ," <DL,23   2( 4 <DL2  2AJ 0_levnl3   ) <DL)23   2( 4 <DL2  2>J 0_levnl4  ` &<<DL&23   2( 4 <DL2  2;J 0_levnl5   #DL#23   2( 4 <DL2  28J 0_levnl6    DL 23   2( 4 <DL2  25J 0_levnl7  h DDL23   2( 4 <DL2  22J 0_levnl8   L23   2( 4 <DL2  2/J 0_levnl9    L23   2( 4 <DL2  mailto:charles.kluefield@noaa.gov(O$ dmailto:michael.graf@noaa.govmailto:charles.kluepfel@noaa.gov !  _"HXX   8XXdd8AviationVerify #XX"H+#  M   `     (eh83 1.0  Overview \(#(#  AviationVerifyisaMicrosoftExcelapplicationwrittenbyAndrew_Rorke_Ԁ _WFO_ԀLOX.The 0  programevaluatesTerminalAerodromeForecasts(_TAFs_)withrespecttoobservedconditions  l andmodeloutputstatistics(MOS)fromthenestedgridmodel(_NGM_).Thisprogramattemptsto  X verifythe_TAF_Ԁinthemannerinwhichapilotmustuseit,usingoperationallysignificantceiling  D andvisibilityvalues.AviationVerifygeneratesverificationstatisticsonamonthlybasis,but  0  statisticsforanyperiodoftimeintheExceldatabasemayberequested.Statisticscanbe   generatedfortheindividualforecasterortheentireoffice.   AviationVerifybreakseach_TAF_Ԁinto288discrete5minuteblocks.Itdoesthesamefor   corresponding_METAR_/_SPECI_ observations.Whenobservationsaretakenattimesthatdonot |  endin 0or 5,thetimesareroundedtovaluesthatendin 0or 5.Observationsarethen h comparedto_TAFs_ԀandMOSguidance,andeach5minuteblockisverifiedseparatelyforceiling, T visibility,flightcategory,winddirection,windspeed,windgusts,andweather. @ ForecastswithinthePROBandTEMPOgroupsarealsoverified.Verificationstatisticsare h stratifiedbyprojection(03,36,612,1218,and1824hours)and_TAF_Ԁinitiationtimes(0000, T 0600,1200,and1800_UTC_). _TAF_Ԁamendmentsarenotverified. @ AviationVerifyQuicksetupinstructionsareprovidedinAppendixA.  ! ! 0(;08  2.0  MultipleForecastsAtOneTime(#(#  Duringanysingle5minuteinterval,oneortwoforecastsmaybeineffect,dependingupon \ whetherornotaTEMPOorPROBgroupisineffect.IfneitheraTEMPOnorPROBgroupisin H  effect,verificationisdonebysimplycomparingtheprevailingforecast(FMor_BECMG__? 8#  1      _Ԁgroup) 4! totheobservation.IfaTEMPOorPROBgroupisineffect,thentwoforecasts(onefromthe  "p prevailinggroupandonefromtheTEMPOorPROBgroup)arevalidforthat5minuteinterval.  #\  Forevery5minuteintervalthataPROBgroupisineffect,thelowest(worst)forecastcondition $4 " _isusedforverification.  Forevery5minuteintervalthataTEMPOgroupisineffect,atwostepprocessisusedto  determinewhichforecastisusedforverification.Thefirststepcheckstheobservational t databaseforvariabilitysinceTEMPOgroupsareonlyjustifiedwhenatmosphericconditionsare ` varying.Oncejustificationbaseduponvariabilityisestablished,thesecondstepdetermines L  whichofthetwoforecastsaremostoperationallysignificant,andthatforecastisusedfor 8  verification. $ t  0   Step1. Foreach5minuteinterval eachelementischeckedseparatelyforvariabilityto  L  seeifaTEMPOforecastisjustified.ATEMPOgroupisjustifiedifconditionschange  8  twiceormore duringaperiodofthreehoursorless.$ (#(# 0   (#(# ";"  ;0  2;"3  0` (#(#  Forceilingorvisibility,changeisdefinedasmovementbetweencategoriesas   listedinSection4.1.1(CIG)andsection4.1.2(VIS).;݌ ` (#` (# Ќ  0   (#(#  2 &'(Zx00"3"  0  32Z"3  0` (#(#  Forweather,eachelement(i.e.,thunderstorm,rain,fog,snow,andfreezing p precipitation)isevaluatedseparatelyandachangeisdefinedasthestartingor \ stoppingofthatelement.3݌H` (#` (# Ќ   3 &'(pZxx2 &'"3"  0  32pZ"3  0` (#(#  Forwindspeed,changeisdefinedasanincreaseordecreaseinthesustained  p speed ofgreaterthan7knots.3݌ \` (#` (# Ќ  "3"  0  3:2pZ"3  0` (#(#  Forwindgusts,changeisdefinedasanincreaseordecreaseinthegustspeedof 4 greaterthan9knots.Changeisalsodefinedaswheneversubsequentobservations   shiftfromtheoccurrenceofguststotheoccurrenceofnogustsorviceversa3:s݌ ` (#` (# Ќ     4 &'(Zxx3 &'"3"  0  32Z"3  0` (#(#  Forwinddirection,changeisdefinedasashift indirectionofgreaterthan30  degrees.3݌` (#` (# Ќ  0   Step2. Followtheappropriateinstruction,below:X (#(# Ѐ D!   "3"  3z2Z"3  0 `   IftheTEMPOgroupisjustified,each5minuteintervalisevaluatedwiththe 0"  forecastfromeithertheprevailingorTEMPOconditions,whicheverproducesthe #l! mostfavorableverificationscore.3z݌$X"` (#` (# Ќ    "3"    3%2Z"3  0 `    IftheTEMPOgroupisnotjustified,each5minuteintervalisevaluatedwiththe %0!$ forecastrepresentingthelowest(worst)conditions,theconditionsforwhichthe &"% pilotmustplan.3%^݌'#&` (#` (# Ќ  3.0  Statistics|*%)(#(#    `   h+&*  AviationVerifygeneratesamultitudeofstatistics,withoutputindifferentformatsdependingon  whatisrequested.Whenthemonthlyreport isrun,afilecalled RawStats,ifdesired,maybe  generatedthatcontainsalloftheoutputstatistics.  Usersmaythenusethisfiletocreatetheirownspecializedoutputtomeetlocalneeds.  Inall ` statisticaloutputfiles,decimalpointsarenotused.Forstatisticsthatnormallyrangebetween L  zeroandone,i.e.,POD,FAR,thenumberismultipliedby100.T hus,aPODof0.76wouldbe 8  listedas76.Allotherstatisticsareroundedtothenearestwholenumber. $ t Thefollowingtermsareusedinthestatisticaloutput:  L   Hours(Hrs) arethenumberofhoursaphenomenon(e.g.,lightwindsorwindgusts)was $  observedduringTAFverification.WheneverstatisticsforallTAFinitiationtimes(00,06,12,   and18UTC)areparsedtogether,eachhourlyobservationiscoveredbyfourTAFS;therefore,   thenumbersinthe hoursroworcolumnarefourtimeshigherthanactuallyobserved.This   definitiondoesnotapplytoTEMPOandPROBgroups(seesections4.4and4.5).    %C (%correct)isthepercentageoftotalforecastsissuedthatwerecorrect.Itissimilarto \ POD,but%correctisusuallyusedtoevaluateallcategoriesofagivenelement(e.g.,alleight H ceilingcategories),whereasPODisusuallyusedforevaluatingasinglecategoryorthreshold 4 (e.g.,ceilingsbelow200feet).  p  m%C isthepercentcorrectforMOS. H    `    POD (probabilityofdetection)isequaltothenumberoftimestheTAFmatchedthe   correspondingobservationdividedbythe totalnumberoftimestheelementwasobserved.Itis   similarto%correct,butPODisusuallyusedforevaluatingasinglecategoryorthreshold(e.g.,  ceilingsbelow200feet),whereas%correctisusuallyusedforevaluatingallcategoriesofa  givenelement.PODisusuallyexpressedwithafalsealarmratiobecauseitispossibleto  achieveaveryhighPODbyissuingalotof falsealarms. l  mPOD (MOSPOD)isthesameasPODexceptitusestheMOSforecast. D!  FAR (falsealarmratio)isequaltothenumberoftimeselementwasforecastbutnotobserved  #p! dividedbythetotalnumberoftimesitwasforecast. $`"  mFAR (MOSFAR)isthesameasFARexceptitusestheMOSforecast. %8!$  FAHr (FalseAlarmHours)istheactualnumberofhoursanelementwasforecastbutnot '#& observed.Thisprovidesclearerinformationoneventsthatrarelyoccur. ($'  CSI (CriticalSuccessIndex)isequaltothenumberoftimesaforecastmatchedtheobservation *%) dividedbythesumofthetotalnumberoftimestheelementwasobservedplustotalnumberof t+&* timestheelementwasforecastbutdidnotoccur.   mCSI istheCriticalSuccessIndexforMOS   %T>M (TAFbetterthanMOS)isthepercentage oftimetheTAFwasmoreaccuratethanthe ` MOSforecast.  P  %TOb isthepercentageoftimetheMOSandTAFagreedbutbothwereincorrect. H    `    `     h    5(58x4 &' 4.  Output   \ Theoutputisdividedinto(1)basicstatistics,(2)verificationstatistics,and(3)advanced 0 verificationstatistics.  ThebasicstatisticscombinethedatafromallTAFbeginningtimes(0000,0600,1200and1800  UTC),andforecastprojectionsareonlyparsedintotwogroups,0to12hoursand12to24hours.  ЀThemorespecificverificationstatisticsalsocombinethedatafromallTAFbeginningtimesbut h parsetheforecastprojectionsperiodsintothefollowing:0to3(3),3to6(6),6to12(12),12to T  18(18),and18to24(24)hours(thenumbersinparenthesesshowhowtheprojectionperiodis @! abbreviatedintheoutput). ,"|  Theadvancedverificationstatisticscontainthehighestlevelofdetail,andthedataareparsedby $T" forecastprojectionandTAFbeginningtime.CSIs,whichdonotfitontheotherpages,arelisted $@ # ontheadvancedpages.TEMPOandPROBgroupevaluationismorecompleteintheadvanced %,!$ verification &"%  4.10  GeneralCeiling,Visibility,andFlightCategorydefinitions/statistics )$((#(# Thissectionisdividedintothreesectionsfor(1)ceiling(CIG),(2)visibility(VIS),and(3)flight \+&* category.   4.1.10  Ceiling(CIG) p(#(# Ceilingsareverifiedbycategory.AforecasthitoccursiftheTAF(MOS)ceilingcategoryequals D  theobservationceilingcategory.Thesecategories,whicharesimilartoNGMMOScategories 0  andNWSTAFamendmentcriteria,shouldnotbeconfusedwiththeFAAflightcategories(see  l section4.1.3).  X *"V#ddd Xdd Xdd X(#(#,dd ,dd +  :0 0  0   ?1?:1 3)'D   ?1 ? 3<200feet 4* D   @2@42 3)'   @2 @ 3200to400feet 4*    @3@43 3)'D   @3 @ 3500to900feet 4* D   @4@44 3)'  @4 @ 31000to1900feet 4*   @5@45 3)'D  @5 @ 32000to3000feet 4* D  @6@46 3)'  @6 @ 33100to6500feet 4*   @7@47 3)'D  @7 @ 36600to12000feet 4* D   @8 @48 3)'   @8  @ 3>12000feetornoceiling   Notethatcategories4and5combinetoform asingleNGMMOScategory(10003000feet).  AllMOSforecastswithinthiscategoryareassignedtocategory4oftheabovetable(10001900  feet).   4.1.2.0  Visibility(VIS) ` (#(# Visibilitiesareverifiedbycategory.AforecasthitoccursiftheTAF(MOS)visibilitycategory 4!" equalsthesurfaceobservationvisibilitycategory.Thesecategories,whicharesimilartoNGM  "p# MOScategoriesandNWSamendmentcriteria,shouldnotbeconfusedwiththeFAAflight  #\$ categories(seesection4.1.3). #H%   *x$V%dddd dd "V#(#(#x,dd ,dd +  :0& "(& "  ?1?:1 3)' 'p")  ?1 ? 3<0.5statutemile 4*  'p"*  @2@42 3)'(#+  @2 @ 3Ѐ0.5to<1statutemile 4* (#,  @3@43 3)' *p%-  @3 @ 31to<2statutemiles 4*  *p%.  @4@44 3)'+&/  @4 @ 32to<3statutemiles 4* +&0  @5@45 3)'d  @5 @ 33to5statutemiles 4* d  @6@46 3)'  @6 @ 3>5statutemiles      Notethatcategories3and4combinetoform asingleNGMMOScategory(1to<3miles).All  MOSforecastswithinthiscategoryareassignedtocategory3oftheabovetable(1to<2miles).    4.1.30  FlightCategory D  (#(# TherearefourFederalAviationAdministrationflightcategorieswhicharedefinedinthe h  followingtable.Iftheceilingandvisibilityvaluesdisagreeonflightcategory,theflightcategory T  isdefinedastheworstofthetwo. @     `     h      p *9V:dddd dd $V%(#(#,9dd ,dd +     LIFR  ,|  LowInstrumentFlightRules;Visibility<1statutemile;Ceiling<500feet  ,|  IFR   InstrumentFlightRules;Visibility1to<3statutemiles;Ceiling500to900feet   MVFR  ,| MarginalVisualFlightRules;Visibility3to5statutemiles; ,| Ceiling1000to3000feet  h VFR   VisualFlightRules;Visibility>5statutemiles;Ceiling>3000feet   Flightcategorystatisticsappearsimilartotheceilingandvisibilitystatistics(sections4.1.1and  4.1.2),butthenumbersarenotcomparablebecauseofdifferencesinthenumberandsizeofthe  categories. x Duetospacelimitations,VeryLowInstrumentFlightRule(VLIFR)statisticsaresometimes P presentedwiththeflightcategorystatistics;however,VLIFRisnotaflightcategory.Seesection < 4.1.4foradefinitionofVLIFRconditions. (x  4.1.40  VeryLowInstrumentFlightRules(VLIFR)!8"(#(#  VLIFRconditionsarenotanFAAflightcategorybutareoftenthecriteriaforclosingmajor #$ airports.VLIFRconditionsexistwhenevertheceilingisbelow200feetorthevisibilityisbelow $% statutemile.Theselowestcategorystatisticsarealsocomputedseparatelyforceilingand % & visibility. |&!'  4.20  WeatherStatistics8)$*(#(#     `  Thefollowingweathertypes/obstructionstovisionareverified:thunderstorm(TS),rain(RAor  +\&, SHRA),snow(SNorSHSN),andfreezingprecipitation(FZRAorFZDZ),andfog(BR,FGand +H'- HZ).AforecasthitoccursiftheTAFandsurfaceobservationcontainthesameweather.  Intensityforecastsarenotverified,e.g.,heavyrainverifiesalightrainforecast.Precipitation  beginningandendingremarksintheMTRareusedtodetermineprecipitationtimestothe  nearest5minuteverificationbin.   t  4.30  WindStatisticsL (#(#  Verificationisdoneforfourelements: windspeed(SPD),winddirection(DIR),lightwinds  p (LGT),andwindgusts(GST).ThereisnoMOSguidanceforwindgusts,hence MOS  \ comparisonsarenotmade.   H  4.3.10  WindDirection  (#(# Winddirectionisnotevaluatediftheobservedwindspeedis5knotsorless.Aforecasthitis   countediftheTAFwinddirectioniswithin30degreesoftheobserveddirection. t   4.3.20  WindSpeed 4(#(#   Lightwinds(LGT)aredefinedas5knotsorlessforTAFsandMOSand 6knotsorlessfor X  MTRs.Aforecasthitoccurswhenbothconditionsaretrue. D Forallotherwinds(SPD),aforecasthitoccursiftheabsolutedifferenceinTAFandMTRwind  speedislessthan8knots.    4.3.30  WindGusts |(#(# MOSdoesnotforecastwindgustssoMOSstatisticsarenotavailable.Aforecasthitoccursif P gustsareforecastandobservedandtheabsolutedifferencebetween theTAFandMTRwindgust <  speedislessthan10knots.Allwindgustslessthan16knotsareignored.  (!x   4.40  TEMPOGroups#<"(#(#  TheTEMPOgroupisdefinedinWSOMD31as ..shallbeusedtoindicatetemporary %!$ fluctuationstoforecastmeteorologicalconditionswhichareexpectedto: &!%   1)haveahighpercentage(50percentorgreater)probabilityofoccurrence,and, (#'   2)lastforonehourorlessineachinstance,and, p)$(   3)intheaggregate,tocoverlessthanhalfoftheperiod... \*%)  ThismeansconditionsforaparticularelementshouldvarywheneveraTEMPOgroupisusedfor 4,'+  thatelement.TheinclusionofaTEMPOgroupintheforecastmeanstwoforecastsarevalidat  thesametime.Refertosection2foradescriptionofhowAviationVerifyselectswhichforecast  toverify.   InadditiontothestandardTAFverificationstatistics,thefollowingspecializedstatisticsare ` computedforjustTEMPOgroups.Thesestatisticsarenotstratifiedbyprojection(all24hours L  oftheTAFareconsideredtogether).Eachelement(i.e.,ceiling,visibility,weather,etc.)is 8  talliedseparatelyforevery5minutesthattheTEMPOgroupisvalid.Theboldfacedtitlesare $ t theabbreviationsusedintheoutput.  `  ( &'(Ax85"3"  3_2A3  0    Hours(Hrs): NumberofhourseachelementwasforecastinTEMPOgroups. 3__݌ 8 (#(# Ќ  "3"  3`2A3  0    GoodTempo(GT): ThisisthepercentageoftimetheelementusedintheTEMPO   groupvariedenoughtojustifyTEMPOusage. Variedenoughforeachelementis   definedinsection2,step1. 3``݌ (#(# Ќ    "3 "  3b2A3  0    GoodTempo"Hit(GTHIT): 󀀀Thisisthepercentageoftime(1)theelementusedin x theTEMPOgroupvariedenoughtojustifyTEMPOusage (section2,step1)and(2)the h forecastelementintheTEMPOgroupwasahit,i.e.,matchedtheMTRobservations. T Ideally,thisnumberwouldbearound50.Example:Theobservationsindicatedthat @ ceilingsvariedsufficientlytojustifyaTEMPOgroup,theTAFprevailinggroupforecast ,| ceilingsat800feet,theTEMPOgroupforecastceilingsat300feet,andceilingsbelow h 500feetwereobserved40%ofthetime.GTHIT:40.3bb݌T(#(# Ќ   "3 "  3f2A3  0    GoodTempo"Improved(GTIMP): Thisisthepercentageoftime(1)theelement , usedintheTEMPOgroupvariedenoughtojustifyTEMPOusage(section2,step1),and  (2)theforecastintheTEMPOgroupimprovedupontheforecastintheprevailinggroup  eventhoughtheforecastintheTEMPOgroupdidnotmatchtheMTRs.Example:The  observationsindicatedthatceilingsvariedenoughtojustifyaTEMPOgroup,theTAF  prevailinggroupforecastceilingsat1200feet,theTEMPOgroupforecastceilingsat | 700feet,ceilingsbelow500feetwereobserved40%ofthetime,andceilings1000feetor h  higherwereobserved60%ofthetime.GTIMP:40.󀀀3f7f݌T!(#(# Ќ  "3 "  3i2A3  0    TempoS/BFM: GiventhattheMTRsdidnotvaryenoughtojustifyaTEMPOgroup, ,#|! thisisthepercentageoftimetheTEMPOgroupproducedacorrectforecast,whilethe $l" prevailinggroupwasincorrect.Example:Theobservationsindicatedthatceilingsdid %X # notvaryenoughtojustifyaTEMPOgroup,theTAFprevailinggroupforecastceilingsat %D!$ 1200feet,theTEMPOgroupforecastceilingsat800feet,ceilingswereobservedbelow &0"% 500feet100%ofthetime.TEMPOS/BFM:100.3ij݌'#&(#(# Ќ  "3 "  3l2A3  0    TempoBenign: OfallTEMPOhoursforagivenelement,thisthepercentageoftime(1) )$( theTEMPOgroupproducedaforecastmoreinerrorthantheprevailinggroupand(2) *%) TEMPOgroupforecastbetterflyingconditionsthantheprevailinggroup.Hence,the +&* moreerroneousTEMPOgroupwasbenign"itwasunnecessarybutalsonotharmfulto  theTAF.Example:TheTAFprevailinggroupforecastceilingsat700feet,theTEMPO  groupforecastceilingsat1200feet,andceilingswereobservedbetween500and900  feet90%ofthetime.TempoBenign:90.3lm݌t(#(# Ќ  "3 "  3Np2A3  0    TempoHurtTAF: OfallTEMPOhoursforagivenelement,thisisthepercentageof L  time(1)theTEMPOgroupproducedaforecastmoreinerrorthantheprevailinggroup, <  and(2)theTEMPOgroupforecastworseflyingconditionsthantheprevailinggroup. ( x Hence,themoreerroneousTEMPOgrouphurttheTAFoperationallybyforcingthepilot  d toplanforworseconditionsthatdidnothappen.Example:TheTAFprevailinggroup  P  forecastceilingsat1400feet,theTEMPOgroupforecastceilingsat600feet,and  <  ceilingswereobservedbetween1000and1900feet90%ofthetime.TEMPOHurtTAF: (  90. 3Np~p݌ (#(# Ќ     ` 4.50  PROBGroups (#(#  ThePROBgroupisdefinedinWSOMD31as ... shallbeusedbyNWSofficesonlytoforecast T alowprobabilityoccurrence(30or40percentchance)ofathunderstorm(andassociated @ precipitation)orprecipitationevent,alongwithassociatedweatherandobscurationelements ,| (wind,visibilityand/orskycondition)whoseoccurrencesaredirectlyrelatedto,and h contemporaneouswith,thethunderstormorprecipitationevent.  T  WheneveraPROBgroupisused,twoforecastsareineffect.Baseduponoperational 0 considerations,oneofthosetwoforecastsisselectedforverification.Iftheconditioninthe  PROBgroupisworse(morerestrictivetoflying)thantheconditionintheprevailinggroup,the  PROBconditionisverified,sincethatistheconditionforwhichthepilotmustplan.Ifthe  conditioninthePROBgroupisbetterthantheprevailinggroup,theprevailingconditionis  verified. | InadditiontothestandardTAFverificationstatistics,thefollowingspecializedstatisticsare T  computedforjustPROBgroups.Thesestatisticsarenotstratifiedbyprojection(all24hoursof @! theTAFareconsideredtogether).Eachelement(i.e.,ceiling,visibility,weather,etc.)istallied ,"|  separatelyforevery5minutesthatthePROBgroupisvalid.Theboldfacedtitlesarethe #h! abbreviationsusedintheoutput.  $T"  "3"  3z2A3  0    Hours(HRS): NumberofhourseachelementwasforecastinPROBgroups. 3z!{݌%,!$(#(# Ќ  "3"  3{2A3  0    %Verified(forweatherelement)(%V): Thisisthepercentageoftimetheweather '#& elementinthePROBgroupmatchedtheweatherelementintheMTRs.Thenumberof5 (#' minutesegmentswhenPROBweatheractuallyoccurredisdividedbythenumberof5 )$( minsegmentsthatPROBweatherwasforecast.Thefractionisthanconvertedtoa *%) percentage.Forexample,a3hourPROBgroupforraincontainedtwentyfour5minute l+&* segments(twohours)withrainobserved:(24/36)100%=66%.Thisstatisticiscomputed  separatelyforeachofthefollowingweatherelements:thunderstorms,rain,snow,and  freezingprecipitation.Ideally,thisnumbershouldbebetween30and40.Note:This  statisticisalsocomputedforeachnonweatherelementincludedinthePROBgroup(see t nextbullet).3{-|݌`(#(# Ќ  "3"  3x2A3  0    %Verified(fornonweatherelement)(%V): Thisisthepercentageofthetimeeach 8  nonweatherelementinthePROBgroupverified. 3x݌( x(#(# Ќ  "3"  3с2A3  0    VWX: GivenonlytheverifiedPROBgroupsforeachweatherelement(thunderstorms,  P  rain,snow,freezingprecipitation),thisisthepercentageoftimeeachnonweather  @  element(ceiling,visibility,wind,windgusts)intheforecastverified.Ideally,thisscore ,  wouldalwaysbe100. 3с݌ (#(# Ќ  "3"  32A3  0    %ImprovedTAF(+): Thisisthepercentageoftimethenonweatherelementsinthe   PROBgroupresultedinamoreaccurateforecastthantheprevailinggroup.Forexample,   LIFRceilingsareobserved,VFRceilingsareforecastintheprevailinggroup,andIFR | ceilingsareforecastinthePROBgroup.ThePROBgroupimprovedtheforecast.3&݌h(#(# Ќ  "3"  3B2A3  0    %HurtTAF(): Thisisthepercentageoftime(1)thenonweatherelementsinthe @ PROBgroupresultedinalessaccurateforecastthantheprevailinggroup,and(2)the 0 PROBgroupforecastworse(lower)flyingconditionsthantheprevailinggroup.For l example:MVFRceilingswereobserved,IFRceilingswereforecastintheprevailing X group,andLIFRceilingswereforecastinthePROBgroup.3Br݌D(#(# Ќ     `  4.60  VerificationParameters (#(#  "3"  3K2A3  0    PeriodofEvaluation 󀄀Datesaregiven3Kx݌(#(# Ќ  "3"  342A3  0    TAFHour34a݌` (#(# Ќ  "3"  32A3  0    Forecaster 3&݌4" (#(# Ќ  "3"  3Ë2A3  0    PercentageofMTRs isthepercentageofMTRsthatwereavailablefortheTAFsthat $X" wereevaluated.IftwodaysworthofMTRsweremissing,andtheTAFsthatreferredto $D # thoseMTRswerealsomissing,thisstatisticwouldnotbeaffected.3Ë݌%0!$(#(# Ќ  "3"  32A3  0    PercentageofTAFs isthepercentageofpossibleTAFsthatwereverifiedforthe '#& requestedperiod.3ˍ݌(#'(#(# Ќ  "3"  3ӎ2A3  0    PercentageofMOS isthepercentageofpossibleMOSforecastsverifiedforthe |*%) requestedperiod.3ӎ݌h+&*(#(# Ќ    ! ! -(%8 x( &'  U XXIfyouhaveanyquestionsaboutthedocumentation...pleaseemail  4XanUO  5  charles.kluepfel@noaa.gov64UOH_  7anPvԀ4TUO  5  6UO   75or4WUO  5  michael.graf@noaa.gov6UOpilo  7thݒԀ x Ifyou   haveanyproblemswiththeprogram,pleasenotifyyourRegional @ AviationFocalPoint.#XX  U#AFAQwebsitewillbecomeavailablebasedonquestionsform & v thefield.AskyourregionalRAMforthiswebsite. \     `    `   4    XXAppendixA#XX#      AviationVerifyQuickSetUp   ~  1.OnaWindowscomputer(fastwithatleast128MBofRAM)withMicrosoftExcelinstalled, ~ opentheCdriveandcreateanewfoldercalledTafVer. j     `     h 2.CopythefileAVNVerify_1.1a.xlsintothefolder. B  3.CopythethreedatafilesperstationthatyouwanttoverifyintothefolderTafVer.Betteryet  j  havetheLDADFTPthefilesdirectlyintotheTafVerfolder. TODOTHISSEEAPPENDIXB. V   (Note:SambauserscanpullfilesdirectlyfromtheLDAD)ThethreefilesarefortheTAFs,the F  MTRs,andtheMOS.Thefilesmustbenamedintheformat: 2    XXXTTTNNN_yymm.txt     Where:0 XXXisthenodeID (# (#    `  TTTisthefiletypeeitherTAF,MTR,orFWC ~    `  NNNisthestationID j    `  yyistheyear(ProgramisnotY3Kcompliant) V    `  mmisthemonth B   ExampleforSantaMariaCalifornia(KSMX)forJulyof2000 j   MetarFile0 SFOMTRSMX_0007.txtB (# (#   TAFFile0 SFOTAFSMX_0007.txt. (# (#   MOSFile0 LAXFWCSMX_0007.txt (# (# 'S XX'UsuallyMOSfilescomeinwithyournodeIDirregardlessofwhatnodethestations  nodeIDis.  ( XS X(4.LaunchAVNVerify f!    `    5.ClickontheTABlabeled SetUp >#! ! ! (88 -  Fillinthefollowing: %f #   TAFDataandOutputOptions (VerifyallTAFsfromlastmonthoption.) &>"%   Rows1to17andColumnsAtoO ($'  X   FillindataforeachTAFsitetobeverified.EverystationneedsaTAFnode(first *%) column)andaMTRnode(secondcolumn).TheTAFnodeandMTRnodeareusually +&* thesamebutnotalways.FillinthethreeletterTAFsiteID(thirdcolumn);do not include  theinternationalletter.       ` Thenextthreecolumns (OUTPUTOPTIONS )areusedtostoreoutputoptions x forthe 3rd buttononthe startpage. 󀀀The VerifyAllTAFsfromlastmonth h buttonallowsyoutocreateamonthlyverificationreportforeachTAFsitewithasingle X  command.The OUTPUTOPTIONS are: D   4     `  Column4 TYPE : Thisindicatesthetypeofoutputyouwishtogenerate  p forthissite.Use B(Basic); C(Combo);or A(Advanced)  `    L     `  Column5 ALLZ : Thisindicatesiftheoutputshouldbeonepagewith 8  alltheZtimeslumpedtogether( A)or4pageswitheachTAFissuetimebrokenout (  separately( I)Thisoptiondoesnotaffectadvancedoutputsinceitisbrokendowninto   Zgroupsalready.         `  Column6 RawStats : IndicatesifaRAWstatsfileshouldbegenerated  aswellastheprintedoutput.Enter YESinthiscolumnifyouwantRAWstatsfiles x generated. (Usuallynot) Thisoptiongivesyoutheabilitytocreateyourownstats. d  T   FWCNODEID  @  ,|   Row3columnsZtoAC.TypeinthethreeletterNODEthatyourFWCdatahas.Thisis h usuallyyourstationnode. T  @   InternationalLetterID  ,     Row13columnsZtoAC.TypeintheoneletterInternationalLetteryourTAFsand  MTRsareassigned.Itis KintheConusand PinAlaskaandthePacific.      InputDataDriveID  x   d!   Row3columnsAEtoAI . ThisholdsthedriveIDfortheharddriveandfolderthatthe P"  inputfilesarestoredin.OrdinarilythiswillbeC:\TafVer\,butsitesusingSAMBAcan @#! changethistotheLDADfileandfolder.Spellingandformatmustbeperfect. ,$|"  %h #   OutputDataDriveID  &T!$  &@"%   Row3columnsAKtoAO . ThisholdsthedriveIDfortheharddriveandfolderthatthe ',#& RawStatsfilesarestoredin.OrdinarilythiswillbeC:\TafVer\,butitdoesnothavetobe. ($' Spellingandformatmustbeperfect. )%(    `  +&*   IndividualForecasterData       Rows21to57   t   ForecasterData(ColumnsCtoM) `  L  ! ! (6(08  Thissectionisusedifyouwishtoproduceverificationforindividualforecasters.Fillin 8  theforecasternamesorinitialsinthefirstcolumn.ThesenamesarefortheAviation $ t focalpointonlyandareneverusedinAviationVerifyoutput.Thenplacehisorher  ` correspondingforecasternumberinthesecondrow(forecastnumbercanbeanynumber  L  from0to1000.Thenumbersdonothavetobeinorder).Thethirdcolumnholdsrandom  8  lettersthatareusedintheoutputforprivacyprotectionandaretheonlyidentificationthat $  iseverattachedtooutput.Iffurtherprivacyisdesiredatyouroffice,thenamesthat   correspondtotheforecasternumberscanbekeptinaseparatelocationbytheMICor   Aviationfocalpoint,leavingtheforecasternamecolumnblank.        WhowrotewhichTAF(ColumnsOtoBW) p  \   Everymonthfillinthematrixwiththeforecasternumberoftheforecasterwhowrote H eachTAFcycle.Ztimesgoacrossanddatesgodown.(Youonlyhavetodothistorun 4 individualstatistics).Ifpossible,haveforecastersfilloutamatrixinrealtimeand  p transferthedatatothisprogramattheendofeachmonth.Takesabout20minutes.  \  X' 56.YoumustnowchangeExcelserrorhandlingpreference. (VeryImportant!)  4 0  InExcelgototheToolsmenu,findtheMacrosubmenuandthenopenthe VisualBasic  Editor(youcanalsopresstheALTkeyandtheF11keyatthesametime) (#(# 0  Findthemenubarforvisualbasic(notExcel)GototheVisualBasicEditorToolsmenu  gotooptions.Thiswillbringuptheoptionsfloatingwindow.p(#(#   Clickthe Generaltab H!   Findthesectioncalled ErrorTrapping  #p!   Clickthebuttonlabeled Breakonunhandlederrors. $H #   ClickOkandQuittheVisualBasicEditor. & "%  0  (Ifyoustartgettinglotsoferrorscheckheretoseeiftheerrorhandlinghasbeen (#' switched.) )$((#(# 7.InExcelclickonthetablabeled StartPage l+&* Ї8.Clickabuttoncorrespondingtothetypeofverificationyouwanttorun.      a.Button1 VerifyoneTAFforonemonth Allowstheforecastertoseespecific L  biasesforonestation. <    Pickthesite,month,year.TheTEMPO/PROBoptionallowsyoutoviewyourstatswith ( x orwithoutthesegroups.ԀThepurposeistoseeifyourforecaststatsimprovewithouttheaddition  d ofTEMPO/PROBgroups.The generaterawstatsoptionismoreforthepersonwhowantsto  P  maketheirownstats.Formostitsnotneeded.Createindividualreports...thiswillnotwork  <  unlesstheforecaster#shavebeenenteredinthesetuppage.Thisprocessisusually2030 (  minutes.Printoutput...selfexplanatory.Outputparameters,thefirstoptionisfairlybasicandthe   timesarein12hourincrements.Thecombinedpagebreaksupthedatainto3and6hour   intervals.TheadvancedpagestakeonmorerelevancetospecificTAFissuances.Forecasterswill   notestatisticsthattheymightotherwisemiss.Whenthebasicorcombinedbuttonsareclicked   on,anotherboxwillpopup.Itscalled separatebyZtime.Thiswillallowyoutounmask t diurnalbiasesthatmightotherwisebesmearedoutbylumpingallTAFissuancestogether. `     b.Button2 VerifyoneormoreTAFsforoneormoremonths Allowstheforecaster $t toviewallorsomeTAFstogether.PerhapsaWFOhas2outof8stationsthatare d climatologicallyeasytoforecast.Withthisoption,thebiasesfortougherareastoforecastare P easiertodiscern. Theremainderoftheoptionsremainthesameasinbutton1. <     c.Button3 VerifyallTAFsfromlastmonth Thisbuttonsoutputisdeterminedin  thesetuppagefromabove.Itsaquickwaytoseetheofficesstatsforthemonth.Eitherall  togetherorforeachTAFissuance.Editinthissetuppagethekindofoutputyouwant.Ifyou  wantarawstatsfilegeneratedenter yesinthe rawstatsbox.Thestatisticswillalsobe x availableundertheappropriatetabs. d     `   t+&* Ї XX  AppendixB  Printingproblems  (#XX #XX   #XX#Forpageprinting: 8 1.Clickonthetabofthesheetie"A1"   2.Clickonthefilemenu   3.Select"PageSetup"   4.ThePagesetupfloatingpalletshouldpopup    5.SelectthePageTAB p  6.Clickonthe"Fittoonepage"button \  7.SelecttheMarginsTAB H  8.Setallfourmarginsto.25 4  9.Clickboththe"CenterVertical"and"CenterHorizontal"boxes  p  10.Closepagesetupboxandsaveapplication  \ 11.repeatforA2,A3,A4,A5 H      `  +@'* Ї XX  AppendixC  TransferringdatafromLDADtothePC #XX#  !Thefollowingareexcerptsfromseveralfieldsitesontransferringthedata.Itstogiveyouan  ideaonwhichwayyoumayprefertogo.Sincemostsiteshaveapreferredmethodofsending  data.    1) Thescriptftp'sfromls1tomysacwhereIcreatedanaccountforldad. h  Ihaveitonls1in/data/ldad.Itscalledtafxferanditsownedbyldad D   andhaspermissions755. 0  ̀Hereitis... X  !#/bin/csh-f 0  cd/data/ldad/archive  #ftptosac...entersacip  ftp-nivxxx.xxx.xxx<<_EOF_  #supplyusernameandpassword | userxyzxyz!xk1Mk? h binary T #cdtosacdirectory @ cd/users/ldad ,| mput* h bye T _EOF_ @ Next,Iaddedittoldad'scron.Sitesmayhavetomodifycron.allowfor  this:  00***csh-c'/data/ldad/tafxfer" ! Finally,IhaveaprofilesetuponaWindowslanpcusingwsftp95_lewhichisavailableonthe d#! web(http://www.ipswitch.com).Thisisguiprogramwhichlogsintothesacasuserldadand P$" allowstheusertotransferthefilestoc:/tafver10. <% #    `    2) HerearetheinstructionsIhavewrittenupforouraviationfocalpoint: (<$' 1)OpenaDOSwindow *&)  +'* 2)Gotoj:\tafver  3)typeftpls1-pub  Ѐattheuserprompttypeldad t Ѐatthepasswordpromptentertheldadpassword ` 4)typecd/data/ldad/archive 8  5)typeascii  ` 6)typemgetfilename  8  Ѐ $  Ѐex:mgetDENFWC*_0101.txt   ЀmgetDENTAF*_0101.txt   ЀmgetDENMTR*_0101.txt   Ѐ(wherethe0101isyymm)   7)typebyethiswillendtheftpsession \  3) InresponsetothissecondprocedureaboveIreceivedthefollowingreply... x   p Thisisexactlywhatwedo,justintheoppositeorder.Insteadofftp'ing L TOthewindowsmachine,theyareftp'ingFROMthewindowsmachine.Inmy 8 case,it'seasiertouseacronfromLDADthanawindowsscheduler. $    `  XXEND #XX#