Testing l gL qu trnh thc hin mt chng trnh (hay mt phn ca mt chng trnh) tm ra liL pha quan trng trong qu trnh pht trin h thng gip cho ngi xy dng h thng v khc hng thy c h thng mi tho mn yu cu ra chaTest phn mm l vn k thut thch thc hn c vic xy dng phn mm

Tm quan trng ca n i vi ngnh phn mmMt phn mm c lm ra khng ai c th m bo n khng c liTesting s tm v pht hin li (mang tnh ng dng hoc thm ch mang tnh cng ngh) vi mc ch cui cng l bo m sn phm n tay ngi dng phi l tt nht, nhanh nht, n nh nhtHoch nh chin lc nghin cu v ng dng, m bo sp lm ra t tiu ch v k thut raGhi nhn cc kin, xut hoc bo co hng hc t ngi dng

Cc phng php testingBlack box testWhite box test

Black-box Test Khi nimBlack box test: hay cn gi l test hp enTest da trn hot ng ca chc nng, khng i hi kin thc v cc m phn mm hoc cu trcPhng php ny quan tm ti vic thc hin cc chc nng (hnh vi), d liu u vo v kt qu u ra ra sao fi chun b v s dng cc kh nng c th xy ra ca d liu Input

Black-box Test Phng php thc hin phng php ny cn da trn:Yu cu ca phn mmCc trng thi Cc trng hp s dng (use case)Kim tra cc gi tr binPhn lp tng ngTest c phpTest lung d liu (d liu c ly t c t yu cu)

White box Test Khi nimQuan tm ti cu trc v logic bn trong ca on m. cn c kin thc v cu trc phn mmc nh ngha bi: Programming styleControl methodLanguageDatabase designCoding details

White box Test K thutTest cu trcTest nhnhLung d liu testTest iu kin nhnhTest iu kin nhnh tch hpTest cc iu kin thay i

Cc giai on test

Cc giai on testUnit TestIntergration TestSystem TestAcceptance Test

Unit Test Khi nim Mt Unit l thnh phn nh nht ca phn mm, nh l: Function, Procedure, Class, MethodL k thut kim nghim cc hot ng ca mi chi tit m vi mt quy trnh tch bit vi QT PTPM gip pht hin sai st kp thi trc khi a ra test

Unit Test c imTest mc thp nhtS dng phng php test hp trngKim tra c lp tng thnh phnThng c thc hin bi lp trnh vinC gi tr khi pht hin cc vn tim n hoc li k thut

Intergration test Khi nimL test kt hp cc thnh phn ca mt ng dng v kim tra nh mt ng dng hon thnhMc chPht hin li giao tip xy ra gia cc UnitTch hp cc Unit n l thnh cc h thng nh v cui cng l nguyn h thng hon chnh

Intergration test - TypeKim tra cu trc (structure): Tng t White Box Test, ch trng n hot ng ca cc thnh phn cu trc ni ti ca chng trnh Kim tra chc nng (functional): Tng t Black Box Test, ch kho st chc nng ca chng trnh theo yu cu k thutKim tra hiu nng (performance): Kim tra vn hnh ca h thngKim tra kh nng chu ti (stress): Kim tra gii hn ca h thng

Intergration test - PlanCn c thc hin tng ng vi giai on thit k kin trcTh t tch hp c xc nh theo th t xy dngCc thnh phn hon thnh ng thi hnPht trin cc thnh phn v test tch hp c thc hin song song

Intergration - GuidelinesMi thnh phn s c tch hp 1 ln(tch hp theo hng tng dnBaseline 0: test thnh phnBaseline 1: 2 thnh phnBaseline 2: 3 thnh phn)Tch hp tng mc nh ca tng thnh phn ti mt thi imCc thnh phn chnh hoc thnh phn c kh nng nhiu liKt hp cc thnh phn lin quan n gin

Intergration-Approaches Top-downBottom-downBig-bang

Intergration-ApproachesTop-DownCc module cp trn c kim th trcBaselines:baseline 0: component abaseline 1: a + bbaseline 2: a + b + cbaseline 3: a + b + c + dEtc

Intergration-Approachesu im Top-downPht hin sm cc li thit kC phin bn hot ng smNhc imKh c th m phng c cc chc nng ca module cp thp phc tpKhng kim th y cc chc nng

Intergration-ApproachesBottom-upCc module cp thp c kim tra trc Baselines: baseline 0: component baseline 1: n + ibaseline 2: n + i + obaseline 3: n + i + o + dEtc.

Intergration-Approachesu im Bottom-upThun tin cho pht trin cc m un th cp dng li cNhc imPht hin chm cc li thit kChm c phin bn thc hin c ca h thng

Intergration-ApproachesBig-bangTt c cc module c kt hp trong 1 bcL phng php tch hp thng thngL phng php t hiu qu nhtHn ch dng Big-bangRt kh tm ra ngun gc ca vn Khng bit ni no xem xtKhng ngoi tr recommended cho cc h thng rt nh

System test Khi nimL kim tra thit k v ton b h thng (sau khi tch hp) c tha mn yu cu t ra hay khngL Black box testc thc hin c lp bi mt nhm test (test h thng)

System test Khi nimV chc nng, tha mn:Requirements-based testingCc yu cu l iu kin u tin cho vic testPhn tch ri ro xc nh thnh phn quan trng nhtBusiness process-based testingNgi s dng mong i: ci g c s dng thng xuyn v quan trng nht cho vic kinh doanhThc hin cc giao dch kinh doanh qtrng

System test Khi nimYu cu phi chc nng:UsabilitySecurityStorageVolumeConfiguration/installationReliability/qualitiesBack-up/recoveryPerformance, load, stressFunctional

Acceptance testc thc hin sau giai on System test, do khch hng thc hin (hoc y quyn cho mt nhm th 3 thc hin)Mc ch: chng minh phn mm tha mn tt c cc yu cu ca khch hngi vi nhng PM bn rng ri trn th trng, cn thc hin: Alpha test v Beta Test

Acceptance testAlpha test: ngi s dng kim tra phn mm ngay ti ni PTPM, lp trnh vin ghi nhn li hoc phn hi v ln k hoch sa chaBeta test: PM c gi ti cho ngi s dng kim tra ngay trong mi trng thc, li, hoc phn hi cng s gi ngc li cho lp trnh vin sa

Process Test

u vo/ u ra cho testingu voYu cu ca khch hng, cc tiu chunCc yu cu thay iSRSTi liu thit k (ADD, DDD)Chng trnhu raTi liu: test plan, test case v proceduresList liBo co test

Test Plan Khi nimM t cc module cn kim tra, phng php kim tra (black box hoc white box)Xc nh cc yu cu da trn cc yu cu ngi dngXc nh chin lc test: test type, stage, toolsXc nh ngun lc v trch nhim, xc nh h thng (phn cng, phn mm)Xc nh nhng yu t, module quan trng

Test Plan-Hot ngPhm vi test: Trng thi v loi test?Xc nh yu cu cho test: Test s lm g?Xc nh chin lc test: Thc hin nh th no?Xc nh ngun lc v mi trngLp lch trnh Test.Tng hp thng tin, lp k hoch TestXem xt v thng qua k hoch Test.Tiu chun hon thnh.Cng c s s dng Testnh gi ri ro v lp mc ri ro cho cc yu cu.Chuyn giao test.

Test Plan Ni dung

nh ngha ti liuGii thiuTest cc mc nhCc c trng cn testa ra cc phng phpa ra cc tiu chun nh gi mt mc l pass hay failLp k hoch cho cc tiu chun b dng li v cc yu cu c bt u li

Phn chia cng vic cn testCc task v cn thc hin testMi trng cn thc hinPhn cng ngi chu trch nhim cho cc task v Nhn cng v vic o to Lch biuRi ro v cc s vic xy ra khch quanPh duyt v chuyn giao sn phm.

Test SpecificationTest designCi tin phng php testXc nh cc vn (feature) cn phi cover khi thc hin testXc nh cc test casec t r cc tiu chun no pass/ fail cho mi vn (feature) a ra

Test SpecificationTest caseTi liu cc gi tr input thc t v kt qu mong i cho mi test case c thc hin.nh ngha cc rng buc da trn cc th tc test.Vic nh ngha cc test case l c lp vi vic thit k test c th s dng li mt cch dng.Test procedurenh ngha tt c cc bc thc hin testChy h thngThc hin cc testcasea ra cc ch dn

Test Design-Ni dung

nh ngha ti liu testCc vn cn c testCc phng php yu cunh ngha cc trng hp testTiu chun nh gi cc tiu chun pass/fail

Test case, Procedure Ni dungTest casenh ngha ti liu testTest itemsc t cc d liu input c t d liu out putMi trngCc yu cu c bitTest Procedurenh ngha ti liuMc chCc yu cu c bitProcedure steps (thc hin tng hin)

Test ReportTest Item Transmittal Reportnh dng phn mm c chuyn giao ti cc nhm test c lp.S dng trong trng hp m cc mu ban u ca vic test c a ra.Test LogS dng cho nhng ngi tham gia vo vic qun l cc kt qu tesMc ch l ghi li nhng g xy ra trong sut qu trnh test.Test Incident ReportM t mt vi s kin xut hin trong sut qu trnh test m trong mong mun c pht trin xa hn.V d nh:Thit b, cng c liCc s kin, phn khng c r rng, chnh xc.Cc bt thng xy ra.

Test Log, Test Incident Ni dungTest Lognh ngha ti liuM tCc s kin v hot ng (Activity and event entries)Test IncidentDocument identifierSummaryIncident descriptionImpact

Test Report Ni dungnh ngha cc ti liuTng ktCh ra cc mu thun, thay inh gi mt cch ton dinTm tt s lc kt quc lng/Tng kt cc hot ngPh chun.

KT vit TC hiu quMt testcase c cho l hiu qu:Test case hiu qu l test case m tm thy bug.Tm c nhiu bug kh.Ch ra c nhng im ban u m khi thc hin test khng tm ra vn Tun theo ng cc con s thng k bugTheo di cc li theo cc trng hp c tm thy

KT vit TC hiu quFor each identified requirement; define test cases.Test CasesFor Req. #1Requirement #1Requirement #2Requirement #3Test CasesFor Req. #2

KT vit TC hiu quEquivalence class partitioningControl flow testingData flow testingTransaction testingDomain testingLoop testingSyntax testingFinite state machine testingLoad and stress testing

Equivalence class partitioningXc nh mt nhm cc yu cu h thng, functions, behaviorsPhn cc testcase vo cc class. Mi class l mt nhm cc testcase tng t nhauTrong mi class chn test ch mt vi testcasePhn cc test case theo nhm cc TestCase cng loi, gi l class hay lp cc TestCaseCc class li c th xp vo 2 nhmPositive tests (clean tests)Test da trn defined requirementsTest nhng trng hp, hon cnh s dng thng thngNegative tests (dirty tests)Test nhm tm ra liTest nhng trng hp, hon cnh s dng c bit, bt thng (nh invalid input, vt gi tr bin, chu stress)

Control FlowL k thut test cn bnS dng lung x l thit lp cc phng php testL s m hnh ha hnh vi ca h thng, (khng m t cc cu lnh trong code)p dng c cho hu ht cc phn mm, c hiu qup dng c trong mi testing stagesMi r nhnh trong lung x l l 1 TestCase

Control Flow Testing Strategy - SummaryKim tra cc m hnh system or sub-systemnh ngha i tngnh ngha cc mi quan hIndetify the weightsIdentify paths through the model to cover objectsIdentify paths through the model to cover linksEach path is a test casea ra cc iu kin u vo v kt qu mong i cho mi testcase

Data Followp dng cho cc h thng data-intensive, v d:HT sn sinh bo co, thng kHT c tnh ton thay i s liuPhng php xy dng testcase:Lp s lung d liu (data flow)Ln theo tng ng dn trong s Bt u t node outputLn ngc li ti khi gp node inputPhn tch cc TestCase theo s m hnh lung d liu

Transaction testingp dng cho cc h thng x l giao dch (nh t v my bay, t phng khch sn)S dng m hnh x l ca h thng, ch trng n im bt u, im kt thc ca tng x l, ch trng ti hnh i (queu)Tng t nh data flow, nhng bao gm cc khi nim:Birth:n bt u khi noDeath:hon thnh khi noQueues: tun t cc giao dch i n lt

Transaction Flow Testing StrategyPhn loi TC theo loi cc giao dch, ch trng vic xcnh im khi u, kt thc v hng i cc im giaodch cn x lXc nh tt c cc loi giao dch.Xc nh ngun gc v im kt thc cho mi loi giao dch.Xc nh queues (ni m cc giao dch ch i c x l)Xc nh cc thnh phn (nhng khng nht thit phi ph hp vi cc thnh phn phn mm)Xy dng m hnhXc nh hng i (paths)

Domain testp dng cho cc x l m c xc nh phm vi gi tr d liuCh trng test cc gi tr bin On, OffTm ra nhng ni m phn mm cho gi tr khc nhau -- Phn loi TC theo vng gi tr ca bin, c bit ch trng cc TC quanh bin ranh gii, ni h thng c nhng x l khc nhau so vi cc gi tr bin khcTesting TechniqueTm cc gi tr bin c lpKim tra mt im trn bin v c oChn off point mt gi tr gn vi gi tr bin

Loop TestNi v vic lp trong cu trc, or white box, testingp dng trong Black box test: quan tm n vng lp trong hnh vi ca h thng ch khng quan tm n vng lp trong codePhn loi cc TC theo s gi tr tng ln r nhnh cc vng lpV d: khi h thng fari tm ra tt c cc bn ghi tha mn mt tiu ch tm kim no Gi s kh nng h thng c th h tr ti a Max vng lp, ch cn chn thc hin nhng testcase sau l :- 0 ln, 1 ln, 2 ln qua vng lp- X ln,- Max-1, Max, Max + 1 ln

Loops Test Cases To UseThc hin vng lp 0 lnLp 1 lnLp 2 lnMt s c trng cc ln lpThc hin vic test lp vi s lng maxium-1 lnThc hin vic test lp vi maxium lnThc hin vi maxium + 1 ln lp

Syntax TestingRt hu ch cho Test Cc cu lnh c snCc trng thc th c cu trc khun dng, nh dng trc hoc theo mt quy nh no V d:Ngy thnga ch EmailS in thoiMailing addresses

Syntax Testing - TechniqueThit k cc Test case xc thc r rng (d liu valid)bng cch s dng k thut phn lp tng ng.Thit k cc testcase tiu cc (negative)vi lp d liu InvalidThc hin cc Test Case

State Machine TestingL mt chin lc test kh hon hop dng khi:Cc ng dng c thc hin qua nhiu cc trng thi khc nhauH thng c thit k s dng phng php hng i tngMt vi phn mm c lc chuyn trng thi

State machine : phng phpCc TC c phn loi t vic lp cc biu chuyn trng thi ca h thngV mt s chuyn i trng thi cho i tng cn testPositive tests: thit k test cases cho tng ln chuyn i trng thiNegative tests: thit k cc testcases nhm c chuyn i trng thi mt cch bt hp l

Load testingTy thuc vo tng loi h thng bt h thng phi chu ti ln.S lng ln cc giao dch cn thc hin.Cc file ln.S lng ln cc file.S lng ln cc client cng truy nhp.Cc vn hnh lp i lp.Thc hin vic ny yu cu mt s tool t ng.

Stress TestBt h thng hot ng trong iu kin bt thng:Dung lng b nh b gii hn.Mng li h thng:Hot ng vi mt s lng nh cc node.Kt ni mng b ngt khi ang vn hnh.Kt ni CSDL b ngt khi ang vn hnh.

u tin testDanh sch cc u tin test - where to focus testingNhng vng quan trng nht ca phn mmNhng vng phn mm hay c dng nhtNhng vng c c trng ring, khc bit hn vi cc vng khc ca phn mmNhng vng phn mm d b nh hng nht ca cc thay i va c (khi regression test)Nhng li d xy ra nhtNhng li (ngi dng) d nhn thy nhtNhng loi li kh fix nhtNhng loi li m tester bit r nhtNhng loi li m tester bit l m nhtPositive test trc, negative test sau (test cc trng hp hp l trc, cc trng hp khng hp l sau)u tin sp xp test theo quality dimensionS 1: thng l Function testing, v phi bao qut c bussines cycle ca h thng.S 2: Usability testing, ch test GUI, m bo ng syntax, theo standards v user friendly.