summaryrefslogtreecommitdiffstats
path: root/start-testsuite.sh
AgeCommit message (Collapse)AuthorFilesLines
2018-04-11fix build: don't clean out expected-results.log: rename to *.xmlNeels Hofmeyr1-1/+1
'make clean' as generated by ttcn3_makefilegen removes all *.log files, which of course cleans out expected-results.log, which should not happen. Since this is a junit XML file, rename the suffix to .xml. Change-Id: Ic334f6b758eef865e3a497aa430691a3ae696d25
2018-04-06add compare-results.sh, call from start-testsuite.shNeels Hofmeyr1-2/+26
Compare current test results to the expected results, and exit in error on discrepancies. Add compare-result.sh: (trivially) grep junit xml output to determine which tests passed and which didn't, and compare against an expected-result.log, another junit file from a previous run. Summarize and determine success. Include an "xfail" feature: tests that are expected to fail are marked as "xfail", unexpected failures as "FAIL". In various subdirs, copy the current jenkins jobs' junit xml outputs as expected-results.log, so that we will start getting useful output in both jenkins runs and manual local runs. In start-testsuite.sh, after running the tests, invoke the results comparison. Due to the single-line parsing nature, the script so far does not distinguish between error and failure. I doubt that we actually need to do that though. Related: OS#3136 Change-Id: I87d62a8be73d73a5eeff61a842e7c27a0066079d
2018-03-18fix regression in start-testsuite.sh (false shellcheck advice)Harald Welte1-1/+1
Change-Id: If05d13c0dedfedf517005e5418acc677ddc5e75f
2018-03-18start-testsuite.sh: Use shellcheck to harden scriptHarald Welte1-2/+2
Change-Id: Iaf887da7ad95ba8b1fe93fe6c29f0518961d2fbb
2018-02-06start-testsuite.sh: Pass a third parameter to ttcn3_startDaniel Willmann1-1/+5
The name of the parameters is a little misleading, since the second parameter could just be a testname. Change-Id: Ibe207a83c477c918a865a8a34cad7ca5d45c7eac
2018-01-29start-testsuite.sh: Add archlinux tccn3 path to LD_LIBRARY_PATHPau Espin Pedrol1-1/+1
Archlinux installs ttcn33 libaries in /usr/ttcn3/lib (titan-git package from AUR). Change-Id: I99219f4ab36c82e562ef3fed047d3c52d64497f1
2017-08-19generalize 'start.sh' script for executing synamically linked testsuiteHarald Welte1-0/+18