From 69facd54a4005eacbfe35e9105fc6d1ed33e13c2 Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?Jacob=20St=C3=B8ren?= Date: Thu, 24 Oct 2013 12:36:26 +0200 Subject: [PATCH] User Doc : Split out RegressionTestSystem --- .../UsersGuide/CommandLineParameters.md | 45 +----------------- .../UsersGuide/RegressionTestSystem.md | 44 +++++++++++++++++ Documentation/UsersGuide/UsersGuide.md | 11 ++++- .../UsersGuide/images/CaseProperties.png | Bin 0 -> 4984 bytes Documentation/UsersGuide/images/TopLink.png | Bin 0 -> 554 bytes 5 files changed, 54 insertions(+), 46 deletions(-) create mode 100644 Documentation/UsersGuide/RegressionTestSystem.md create mode 100644 Documentation/UsersGuide/images/CaseProperties.png create mode 100644 Documentation/UsersGuide/images/TopLink.png diff --git a/Documentation/UsersGuide/CommandLineParameters.md b/Documentation/UsersGuide/CommandLineParameters.md index 91b1fcd578..069813ca84 100644 --- a/Documentation/UsersGuide/CommandLineParameters.md +++ b/Documentation/UsersGuide/CommandLineParameters.md @@ -10,47 +10,4 @@ Parameter|Description `-regressiontest ` | Run a regression test on all sub-folders starting with `TestCase*` of the given folder. **RegressionTest.rip** files in the sub-folders will be opened and snapshots of all the views is written to the sub-sub-folder **RegTestGeneratedImages**. Then difference images is generated in the sub-sub-folder **RegTestDiffImages** based on the images in sub-sub-folder **RegTestBaseImages**. The results are presented in **ResInsightRegressionTestReport.html** that is written in the given folder. `-updateregressiontestbase ` | For all sub-folders starting with `TestCase*`, copy the images in the sub-sub-folder **RegTestGeneratedImages** to the sub-sub-folder **RegTestBaseImages** after deleting **RegTestBaseImages** completely. -## Regression test system - -A regression tool for QA is build into ResInsight. This tool will do the following: - -1. Scan a directory for sub directories containing a RegressionTest.rip files. -2. Each found project file will be opened, and all views in this project will be exported as snapshot images to file. -3. When snapshot images from all projects are completed, difference images based on generated and QA-approved images are computed. -4. Based on these three sets of images, an HTML report is created and automatically displayed. - -### Starting regression tests - -To be able to run regression tests you need the *compare* tool from the ImageMagic suite. - -You can start the tests either from the command line or from the ResInsight Gui. -From the ResInsight Gui select : **Debug -> Regression Test Dialog** - -![](images/RegressionTestDialog.png) - -The **Application Working Folder** is basically the path to the executable of the image compare utility used, even though the CWD of Resinsight is temporarily changed to this path during execution. - -### Creating regression tests - -An example of the folder structure is shown below: - -``` -RegressionTestFolder/ - TestCase1/ - RegressionTest.rip - RegTestBaseImages/ - RegTestDiffImages/ - RegTestGeneratedImages/ - TestCase2/ - ... -``` - -To create regression tests you need to do the following: - -1. Create a root directory containing one directory for each testcase. -2. In each of the Test Case folders create a Resinsight project file called RegressionTest.rip. -3. Run the regression test for the first time, and thereby creating images that can be used as Base images. -4. Rename the generated RegTestGeneratedImages/ folder to RegTestBaseImages/ - -Now you are all set to test new releases of ResInsight towards your own Regression tests. - +See also the [Regression Test System ](RegressionTestSystem.md) for a more in-depth explanation. \ No newline at end of file diff --git a/Documentation/UsersGuide/RegressionTestSystem.md b/Documentation/UsersGuide/RegressionTestSystem.md new file mode 100644 index 0000000000..d8e7fe8356 --- /dev/null +++ b/Documentation/UsersGuide/RegressionTestSystem.md @@ -0,0 +1,44 @@ + +## Regression test system + +A regression tool for QA is build into ResInsight. This tool will do the following: + +1. Scan a directory for sub directories containing a RegressionTest.rip files. +2. Each found project file will be opened, and all views in this project will be exported as snapshot images to file. +3. When snapshot images from all projects are completed, difference images based on generated and QA-approved images are computed. +4. Based on these three sets of images, an HTML report is created and automatically displayed. + +### Starting regression tests + +To be able to run regression tests you need the *compare* tool from the ImageMagic suite. + +You can start the tests either from the command line or from the ResInsight Gui. +From the ResInsight Gui select : **Debug -> Regression Test Dialog** + +![](images/RegressionTestDialog.png) + +The **Application Working Folder** is basically the path to the executable of the image compare utility used, even though the CWD of Resinsight is temporarily changed to this path during execution. + +### Creating regression tests + +An example of the folder structure is shown below: + +``` +RegressionTestFolder/ + TestCase1/ + RegressionTest.rip + RegTestBaseImages/ + RegTestDiffImages/ + RegTestGeneratedImages/ + TestCase2/ + ... +``` + +To create regression tests you need to do the following: + +1. Create a root directory containing one directory for each testcase. +2. In each of the Test Case folders create a Resinsight project file called RegressionTest.rip. +3. Run the regression test for the first time, and thereby creating images that can be used as Base images. +4. Rename the generated RegTestGeneratedImages/ folder to RegTestBaseImages/ + +Now you are all set to test new releases of ResInsight towards your own Regression tests. diff --git a/Documentation/UsersGuide/UsersGuide.md b/Documentation/UsersGuide/UsersGuide.md index 0ae015aec1..2c5633cf12 100644 --- a/Documentation/UsersGuide/UsersGuide.md +++ b/Documentation/UsersGuide/UsersGuide.md @@ -14,11 +14,18 @@ information and the corresponding cell property data sets. ResInsight also have support for extensive processing of the data sets through an interface to octave, and can also export modified cell property data sets to single Eclipse input files. +### Contents + - [ Getting Started ](GettingStarted.md) - [ Working with 3D Views ](ReservoirViews.md) - [ *Todo:* Well paths ]() - [ Multiple realizations and statistics ](CaseGroupsAndStatistics.md) - [ Octave Interface](OctaveInterface.md) -- [ Command Line Arguments](CommandLineParameters.md) -- [ Octave Interface Reference](OctaveInterfaceReference.md) + +### Appendix + +- [ Octave Interface Reference](OctaveInterfaceReference.md) +- [ Regression Test System ](RegressionTestSystem.md) +- [ Command Line Arguments](CommandLineParameters.md) + diff --git a/Documentation/UsersGuide/images/CaseProperties.png b/Documentation/UsersGuide/images/CaseProperties.png new file mode 100644 index 0000000000000000000000000000000000000000..fe98659132b4796abd674dc7f442bbd020ac8acd GIT binary patch literal 4984 zcmZWt2UJtdwmyKMf`CYuqJk8u`qP!B1Ve8^=!8x}3B5!JK@p@VO^{ARL^_Dnpnx=y z8ak4INSEFrq2BoJTko#7?q1)_IeX8nnKLtc@A=k=HqZmp(_W_q0DxXo17rjM6f)%Z zxJ#7edivreL-K>d*9iOwDDUT9CM%b{G|YVgfR6cZp#UuTJ%)(jdK zUMPC)mBL=Y=%2KzJ@qmr=~EKFHpMgkef!HQHy!tHx!G}9Az0u78w0Bc8`e`_2q}kl z-{-b_iHx>wz;yh3Scv@Y1DF1+&67}Jj+ zg;IOEv@Grl12DEf%m5jm0{1#U77%7Cp~Fk@f(_n7Va}h-#6Bmv%MxJcSRUT0sNPa( zO>2jl^$dS8qmh8C>mv?V0r5NLg3eBwPUrAu);a6p?pID?+z&+L1OoD|O)HoUa`zqb;e zqeU%#GMpa;{DUOGD_=#JwmH0yw@I%Y@p=BQn&oTqq9NoU}9aU4XMhxIClD?w#pZOVrAzhhj*Dfpyug_hlF$`g)M0n4wR-vpmXNv@m_8eDNU}R_ za}fnO-cX*l-m6O{A@;vqQQC`&lfdo=7g6WOh7#Q)U<(s%+jQYOL|M!EK~UX?oTtRkdF8!0Q z8={EVHshtWsXadVgi7oe<*xNR)jY7Q1Y;s|%(LDSKnL62!2;pk8x&qeb(IwT2uh$jOag;*U;zehPB#&Gx5WW`oTok)y7#;uTa%4D4;yBzR&!Z$Tg=%Q ze{ghaA1uv8>hOIyU%+#rZYjHNDiTLir zNNn{t(~wZZ`%v-%tU`Eyux&7w_!pP@!&!av1Kez0XiZ5vN*3fGv@E-9LfwnR1P{8g zoj1CvOCj~hKvf}bM6Q9b*Z}jT>N`iTN+)__3Lff?zl}W`kv&y^<RHyJFE*nN#j z>Fm=-`TVjQiaL|MiY}7z#&E=T7u6UNFjZ!U3bWWYQqNH1`8tnwHH$jETho`O2 zAd-H;njvd9)XclXRHn&ez&;Zy5o7uc=PrXHZS{TI#m%GMvP0MvV9ClAxS{GszhT+M zg@vWFZy->zWlSlPp~N5h#i*=jAwIP#HJZ+ZjH`uX5xo`yI>FKe_sC6lS~^qSHI!3L zI!yIkJ&<1m>rkEKyG%MMiS}MoQ3eYIhc6LDuopxE6;OelS zhk`=pb@5-{IP;kbmhrlT>c%Rv_=x1QokwoV(k*DsvuScmH%)lD9P1~1|jnOd?ZE{re zDOUb$6|*!5hk=qiFa@-(U~-7E0fbM|V1xgyWKW$gt=l7>%Fljkqwd4w7#q!c(*D8{ zTejXwy=%FcW31dm5L@B=s(flS$G2O#|NuW>Ht#Da6= z>RP7!p{koZ;(RHyqM0wWeRl#JyT^5E(aZ*W8{wQrxrN!n0B5@&K3B!gU;fR}+clh~ zGV^*IdOC+W-|@K^Js4I?{2~WEUoL3Q2|%6g4MU+G<94zDeZP+RLp0WyHS z%YPw%MQ`quz%FUy?%^>rNmVvDJiL2A@Wce55FQ?l#~WW0Q}5CPwMLG>VOc_ z;6#-Rnn=)*HCtjqtA)Og;iB@puL#5cP^*J}*#pIO>}35!w|^^V3GNYh79>aO}a zyyUbs9+`KD?H5dRo|uAVc^?awftF!@sYB6M<-UEfBG0e8HbIK0UNPWqw;j;Q0mATEL&O8JD+DQX!94UHVL%`y zB_*;Gbi3G5$nT`z5mk77=t&{Z_WSfX0K5Kgq6eTT|AK*PKK`Pr=uNaD(@rOq?(>sv zfdmy^n3o>INEUjo=TK2kk0IY#A^u0H5nXz6B@$vcXR?;mq zhJPNn%xDE3?M?hX*#@<*`?Q;J^4SXsMc2PzV>ng`Xfi*mYp(Bp;t^Zu$ZyQ7W|~DbERYL#JEkxvdLHJ&NbMXcV+}$=H2=DiDrBfdhnZ_eq{f zqPWg&NI}DcSZfH;Acv$rD3GFE7b50?V5|~Z^SA0WU$18|$Cvo6*;dHI1I~zk(k#=r zVu(-n9v^ZY)tyh|D=zL>*SA|GAEgCZC9!DyqR{G9SBNw!${u=12eyO?9;0tsu*t@D z)gAtc`(O@^t_MlC?Q7xZuleS}O!K$p@M-kw*F9@mMN)gL_0D6_`;|IK9JYOuZo<1D zFSIgm8Mb#W!c%eA=P~#mD-!99f*8d!Mj3;(WLK>0_tWBi^H)_Hc^>=})yv3M`L(hm zUvIy(_}*v=qNmWzyhIbC%x-vp1*-cA0vV)u&l9&z4EbV+zP<8W4#Heo`}C|Wq?m|MAphe(x&SD4zpEjvAfoza}Bz3!s* z@w(6VCfB(Py@Fzw>Dq=#I9ht$*WW~%`M zULCz!Q0=cANUG#r(#l(TA0F^(<*8H4;6i)_nmvVqd!+PslM>N7!yp7K?~-3-29_%= zbujU6)3GtTacCUp)f$-%(LQqcYDQ9vx9hG7U!EXcR#3eWhQE;Q!02; zeeBue^eH(V_P>GtqHus5p&eC!c1em1a}0HsgiEU{1Pw-lD<%{+|A%5QL>j z8z7iHaq4Y9yJ>VpKBK z$~pW69Rvk!`*2w9R#GGEBvDn#FJT+aF}CoVPnX+*{``5^d4IxsohKqIn(8D{AT0YGA)k+0WADz+`oGE5Aw}3r z%wtMe7tE{?maaASx!tR>7my8U4Un+MFFQv&QyPQAiZX5EJ8$h9O^LXFohUe6XfTIU6_{ z+?YM8_@ri&o~O=mXh+_SlBf^-R*|70XAJuOu7(Z9?4Z9%Bfy!jiTZa?*va;PWts3{ z;%WD!DRlIS$4+W<`w1|x#N@SL+FWci)8ZK#-bEo@fwS_0#cYT}rLyb!p=XcJF&%Sb{SO3N41z%7y-LG8IY@7f|Tpecr zoKHLDwpms5BK^bI^2WY_!NIXX1k6*4W3McYO||5xbav9GCHGcEpvI!5Hf@crKD9$j zQPgq68{_%qCS`j|QCjIm)<(F5{D=aJ71N1}gqiz0(nfWDeuwQqT^(n?A4h*R*L^&_ z2Mx+HlVX^X{8?_p0Zt*7M{eCuB{8_AzwFo$`-sf%_F(NO{bd?oZ6+VItxuc|3-!vC z+b-~ zY1F`-oH}$~rL%+~=+up^S>HGv1J|m_mh|3Q+Ktpyp+wL-$A$n;Ss6TBlDWFeJ#PzE zAoqCwim-*Ju*X+rTy>+*$40W0mG#-)<+u_V7sv4L;ToclV0h>+StWsZZC~v~nHKT* zNKKZ);+*VfA(PgRirpims-UcRy?x znaybFw3C%4*)WeB4FCQ$PZ}f1?)M))3*EqQt*Ou-$%flhjPHJShr1Q&Oc{GEH<;_Kh^Jof8Fse*O# z=z-T1mM{VM#>EdQfknpdxoBDJWbZMSXWau$q#FPA3jvd=uBlnxf10fargrs+P<{sa z*|R$#v`|Ou3q_gWHeYTXD|=OE{W?)2l6d94&zJ$P`ZH!+>VGr1gy|1_#4~19447&s zGmJS`e_oD4^}#CcbV-g$bPH#>l>7)B$_y}k{A;Pa9ADPnl=jiQLkj=HlTwvx&%6U` zg7fr2$@&YW^-yoV5JHH&h&&Mlq#t39`#tR&0)}OkWLPWjya~V6d>PPv<*AJ>dpq5Z zM7`AzP~h0f1O|GE2evoKZ7)mo)kEK`?10F#9n7g8KpKtyPo>_;EDS#p{Qcu0xl!-c x`2~Qx{JeeF34pQxKbr6#cKW}ZvTyO6;sksXr`bB+@b@p6rn(-e{E_YRe*tFw&{O~b literal 0 HcmV?d00001 diff --git a/Documentation/UsersGuide/images/TopLink.png b/Documentation/UsersGuide/images/TopLink.png new file mode 100644 index 0000000000000000000000000000000000000000..be404c4ffdd8f622085623923ca1a5420c0e6289 GIT binary patch literal 554 zcmeAS@N?(olHy`uVBq!ia0y~yU@8N$1vuD%L?`uu!b%WvhGAA9DicwV~5x~E?7h18rIo|9BmA3S)#essF(v}xBloF(?z9jH+B z*P3d@)7US6HzDnt@ZP<#KEC%J`J`8`nKy6aWED@Z1AlgliixeZkvSbGaeC8+h^J?7 zPxbH>$T2XqJ90f?^3Ej9GXG|vH9<^3GZ{{#{yvfZo1x-=qG{0Q2X%d`o5dM_1pO7; zy*zp&(3zY!ZmnXR;J5wKkHrf&UiM1LRncCt>-%GT^CaGvL zF8