aboutsummaryrefslogtreecommitdiffstats
path: root/start-testsuite.sh
AgeCommit message (Collapse)AuthorFilesLines
2020-05-29start-testsuite.sh: allow overriding TTCN3_BIN_DIROliver Smith1-1/+4
Override the default of /usr/bin with the environment variable of the same name, if set. Related: OS#4564 Change-Id: I245ae368a97558006fc9f85d4fcb4e4cd52fb19a
2019-11-23re-implement compare-results.sh as compare-results.pyNeels Hofmeyr1-1/+1
The compare-results.sh is annoyingly slow. Since our ttcn3 tests containers support Python 2, re-implement in Python for much quicker evaluation. Change-Id: I0747c9d66ffc7e4121497a2416fca78d7b56c8e6
2019-08-15start-testsuite.sh: Add commented-out section for using custom TITANHarald Welte1-1/+9
Sometimes it's useful to test with a non-installed locally-compiled version of Eclipse TITAN. This adds an example on how to do that. Change-Id: I6a8c26becff868a3d2fcd3a01e2c03adfc748e0a
2019-06-21Put build / run scripts under Apache 2.0 licenseHarald Welte1-0/+15
The license of the build or execution scripts doesn't affect the license of the actual program, and we want to explicitly state that these scripts may be used in any kind of context. Change-Id: I553925cd88b05903aab52ae1afb093aa9ab9d035
2019-06-04start-testsuite.sh: do not override LD_LIBRARY_PATHVadim Yanitskiy1-1/+2
The Eclipse titan.core may not only be installed to hard-coded '/usr/lib/titan' patch, but to any other location too. In the later case, one would have to make sure that the custom path is in $LD_LIBRARY_PATH. So we shall not override it. Change-Id: I1ec28e8c3081d5de1bea90a7451791ac8cbbd27c
2019-05-19start-testsuite.sh: remove superflouse `set -e`Alexander Couzens1-1/+0
The set -e will not interfere with the next command, as it's executed and not included. The exit code of the last command is returned with and without -e. Change-Id: I820d59b29b4ba4a1d094c5c2a2af367e6ef4e5b6
2018-04-11fix build: don't clean out expected-results.log: rename to *.xmlNeels Hofmeyr1-1/+1
'make clean' as generated by ttcn3_makefilegen removes all *.log files, which of course cleans out expected-results.log, which should not happen. Since this is a junit XML file, rename the suffix to .xml. Change-Id: Ic334f6b758eef865e3a497aa430691a3ae696d25
2018-04-06add compare-results.sh, call from start-testsuite.shNeels Hofmeyr1-2/+26
Compare current test results to the expected results, and exit in error on discrepancies. Add compare-result.sh: (trivially) grep junit xml output to determine which tests passed and which didn't, and compare against an expected-result.log, another junit file from a previous run. Summarize and determine success. Include an "xfail" feature: tests that are expected to fail are marked as "xfail", unexpected failures as "FAIL". In various subdirs, copy the current jenkins jobs' junit xml outputs as expected-results.log, so that we will start getting useful output in both jenkins runs and manual local runs. In start-testsuite.sh, after running the tests, invoke the results comparison. Due to the single-line parsing nature, the script so far does not distinguish between error and failure. I doubt that we actually need to do that though. Related: OS#3136 Change-Id: I87d62a8be73d73a5eeff61a842e7c27a0066079d
2018-03-18fix regression in start-testsuite.sh (false shellcheck advice)Harald Welte1-1/+1
Change-Id: If05d13c0dedfedf517005e5418acc677ddc5e75f
2018-03-18start-testsuite.sh: Use shellcheck to harden scriptHarald Welte1-2/+2
Change-Id: Iaf887da7ad95ba8b1fe93fe6c29f0518961d2fbb
2018-02-06start-testsuite.sh: Pass a third parameter to ttcn3_startDaniel Willmann1-1/+5
The name of the parameters is a little misleading, since the second parameter could just be a testname. Change-Id: Ibe207a83c477c918a865a8a34cad7ca5d45c7eac
2018-01-29start-testsuite.sh: Add archlinux tccn3 path to LD_LIBRARY_PATHPau Espin Pedrol1-1/+1
Archlinux installs ttcn33 libaries in /usr/ttcn3/lib (titan-git package from AUR). Change-Id: I99219f4ab36c82e562ef3fed047d3c52d64497f1
2017-08-19generalize 'start.sh' script for executing synamically linked testsuiteHarald Welte1-0/+18