aboutsummaryrefslogtreecommitdiffstats
path: root/suites
AgeCommit message (Collapse)AuthorFilesLines
2020-04-07Move suites/ dir inside example/Pau Espin Pedrol54-1839/+0
example/paths.conf and documentation are updated accordingly. Test suites should have been moved a long time ago, since the they are user or setup-specific based on what needs to be tested. Change-Id: I154b19979b545deba8b232b60172903f63fd9e28
2020-04-06suites/gprs/: beautify output result of ping testsPau Espin Pedrol2-6/+25
Print ping output at the end and replace the whole test stdout report with ping execution. Change-Id: I90001ddc6bc1145ac9d115aee762f4f3500e8dc8
2020-04-03Add modem resource features attributes: 2g, 3g, 4gPau Espin Pedrol1-1/+2
This allows selecting modem by supported network type. It will allow using 4G modems with type different than srsue in 4g suite in the future. Change-Id: I38bcf6abf789f52c3ed0bee7911567fa872e2491
2020-04-01iperf3: add config to adjust the duration of the iperf runAndre Puschmann2-2/+2
the time is passed as a string param and is then converted into seconds when literals "h" or "m" are found. So it would accept 2m and would convert it to 120s, for example. Example: +cfg-iperf3-time@15+ Change-Id: Iff28816f83670751e9e91de31ec59b1b0ad8fc0d
2020-03-31Introduce initial Amarisoft ENB supportPau Espin Pedrol1-1/+0
* object class expects the amarisoft software to be placed in directory provided by env var AMARISOFT_PATH_ENB. On local runs, it will run the software from there. On remote runs it will copy over that directory to the slave. * Configuration provided works with 6 PRBs, but probably won't work for other values (yet). * ZMQ support not yet available, only UHD. One can select the Amarisoft ENB by declaring it in resources.conf: """ - label: AmarisoftENB-B200 type: amarisoftenb rf_dev_type: uhd rf_dev_args: "type=b200,serial=317B9FE,recv_frame_size=9232,send_frame_size=9232" remote_user: jenkins addr: 10.12.1.206 """ And running: """ $ export AMARISOFT_PATH_ENB=/path/to/binaries $ osmo-gsm-tester.py ... -s 4g:amarisoftenb-rftype@uhd+srsue-rftype@UHD+mod-enb-nprb@6 -t ping """ Change-Id: I1ddf4962ea6438ad977382ab201b724028ca46b3
2020-03-21relax max_rate for iperf UL/DL testsAndre Puschmann2-2/+2
Change-Id: Ia243156931918d5ab013c64c37823bc2e400798e
2020-03-09suites/4g/ping.py: Overwrite test stdout with ping outputPau Espin Pedrol1-1/+4
Change-Id: I83403a21c46758132b4fbb930000df67d8650016
2020-03-04Allow overwriting test's report stdout text from inside test codePau Espin Pedrol2-2/+4
Change-Id: Ie1c0ecf7464209a4241665025fda33ae624fc049
2020-03-04suites/4g: Introduce iperf4 downlink testPau Espin Pedrol2-0/+48
Change-Id: Ifc4bb7394120d57ca6d26459be1cf8365a16249c
2020-03-04srsue: Introduce metrics verification proceduresPau Espin Pedrol2-1/+8
Change-Id: Ib1da58615cdc4f53ac1a27080e94e5b47760c508
2020-03-02tests: Improve logging of iperf3 resultsPau Espin Pedrol2-17/+18
Change-Id: I6563c11f4ad6e9519400268e63944cdf8973dad0
2020-03-02iperf3: Support configuring data direction (dl vs ul)Pau Espin Pedrol2-2/+2
Change-Id: I6b5b740beac22015c952ce826c034031ad4c4465
2020-02-18suites/debug: Allow jumping into python debuggerPau Espin Pedrol1-1/+4
Change-Id: Ia6262299981f1d7ac2d81c22b7b9b007e096259a
2020-02-13Initial srsLTE supportPau Espin Pedrol4-23/+70
2 tests (iperf3, ping) working against a full srs{UE,ENB,EPC} network using ZeroMQ backend for RF (so no real RF support yet, that will come next). Related: OS##4295, OS#4296 Change-Id: I290c0d79258a9f94f00c7ff2e1c6c5579c0e32f4
2020-02-03contrib: Add scripts to build srsLTE softwarePau Espin Pedrol2-0/+28
Change-Id: Id9d63920a44a80af187e649c9be5fd7498fa5f44
2019-06-19tests: voice: Add voice call test with Osmux enabledPau Espin Pedrol3-52/+80
Change-Id: Ie4f360a77f6fcbc74f140a7fcb5feef2d94ac734
2019-05-08virtual: Make it possible to add tests to the ms driverHolger Hans Peter Freyther1-2/+3
Introduce an Executor that forwards all testcase related methods to a list of testcases. Allow to instantiate them by name and use the result to access the statistics. Change-Id: Ia65ee53987e92b24e6b8c40e1376bc74dc260180
2019-04-28virtual: Have a single result class that can store dataHolger Hans Peter Freyther1-10/+2
We want to have LU, SMS and other tests run at the same time. Begin by creating a single result where testcases can store additional data. Move the stats code into the UL test case handling and out of the suite. Change-Id: Ie99351bee1515de8cf6870467f08256a53701907
2019-04-28virtual: The completion ratio is success / success+failureHolger Hans Peter Freyther2-2/+2
Fix the stats code to calculate the real completion ratio. Change-Id: I1b8f32dfbe8faa4c255a8d2d9806303fc8e5933b
2019-04-05suites: gprs: Keep terminating all iperf3 processes if one fails to terminatePau Espin Pedrol1-1/+4
Change-Id: I0cc183529988463800e0d40c8cf3a4cea041031c
2019-03-07nitb_netreg_mass: Provide 100 subscriberszecke/testHolger Hans Peter Freyther1-1/+1
Change-Id: I386885f4179d4fc2df23cc48cd1eda850b5a990b
2019-03-07nitb_netreg_mass: Add code to declare a run successful/failureHolger Hans Peter Freyther1-4/+35
Change-Id: If26047f0635db8c7209af143fbd1da4c9b2312d1
2019-03-07nitb_netreg_mass: Allow a suite to configure num subscriberHolger Hans Peter Freyther1-3/+5
Remove hardcoded configuration and replace it with a reservation in the suite. Change-Id: Ic9fd560c2924731e4fd6eea5aaf3ad565cb4ef52
2019-03-07resource: Add a mobile resource for the virtual testHolger Hans Peter Freyther1-0/+3
Add a new resource and make a reservation in the suite. Change-Id: Ic26aa63cad62323bb85f952640672eb28af0eadc
2019-03-05Revert "nitb_netreg_mass: Add code to declare a run successful/failure"Holger Freyther1-35/+4
This reverts commit b4ad8d72431df2336b9c7fbc6eb9597daa80a35c. Reason for revert: There was a true dependency on earlier changes (len(mobiles)). Rollback until the resource configuration is merged. Change-Id: If0f5e24cec2f0d1d144b464180b341cacbdf0ebb
2019-03-05nitb_netreg_mass: Add code to declare a run successful/failureHolger Hans Peter Freyther1-4/+35
Change-Id: I49a821e8e4656466259e519ef901726cbb76ef86
2018-12-13ms_driver: Add a virtual bts and make use of itHolger Hans Peter Freyther1-1/+1
It's very close to the osmo-bts-trx but without osmo-trx. Modify the suite to make use of this BTS. Change-Id: I9f5a2501eb4473ccf2287c902ee207c6a45a1bc5
2018-12-05test: cs_paging_gprs_active: Make sure gprs data (TBF) is ongoingPau Espin Pedrol2-79/+36
PACCH is used for paging only if the MS is actively using a PDCH, and the only way to be sure that's happening is to place some data through the GPRS path so MS has TBF in use when the call is placed. Change-Id: Id29391d75101d94e2cd58f444b383f4c5217ab6a
2018-11-24suites: Add an initial test for the ms_driverHolger Hans Peter Freyther2-0/+35
Things to make configurable: * IMSI and matching MSISDN ranges (start + count) * Timeouts and number of MS (which should be related) Change-Id: I5be2a6b4d3d21bf48625624b9e2cccb33765fe39
2018-11-23suites: gprs: Add test to verify CS paging works while MS is GPRS attachedPau Espin Pedrol2-1/+88
Related: OS#2204 Change-Id: If2844d78b52eda59c1f6d9e18363b858f2b5f007
2018-11-23suites: gprs: Add test to verify MS can use gprs after long idle timePau Espin Pedrol1-0/+66
Change-Id: I1a726049d1e4a95f1145dcf1f654c63503ceb78a
2018-11-19tests: iperf3: Support testing parallel iperf3 clients in testPau Espin Pedrol4-71/+123
Since tests running a single MS and several of them are really similar, generic code handling the test for N concurrent iperf3 sessions is writen an moved to testlib, and existing and new test use that code. Change-Id: I57799fde49e6845379cca332eec0a1f70aaecd2b
2018-10-31Introduce iperf3 testing infrastructurePau Espin Pedrol2-1/+75
Change-Id: I6ff6bef14feb535d98ca41b9788700d699e1ef1e
2018-10-31Add support to test gprs IPv4 data planePau Espin Pedrol1-2/+4
Since the modem iface and the GGSN iface are on the same host/netns, it's really difficult to conveniently test data plane without getting routing loops. As a result, either GGSN or modem iface must be moved to a different namespace. The decision after a few discussions was finally to move modem interfaces to a different netns. Expected setup: * ofono is patched to avoid removing modem if it detects through udev that its net iface was removed (due to for instance, net iface being moved to another netns and thus not being reachable anymore by systemd-udev process running in root netns). * After ofono is started (and successfully configured all the modems and detected its net ifaces through syfs/udev), script "modem-netns-setup.py start" which creates a netns for each modem, naming it after its usb path ID. net ifaces for that modem are moved into its netns. * Modem is configured to use 802-3 data format, and as a result the net iface is configured through DHCP (DHCP req only replied AFTER pdp ctx is activated!). * Since osmo-gsm-tester knowns the modem USB path ID (available in resources.conf), it can run required steps (ifup, DHCP) to configure the interface. The interface name is provided by ofono to osmo-gsm-tester. * As a result, any process willing to transmit data through the modem must be in the modem netns. Related: OS#2308 Change-Id: Icb06bdfcdd37c797be95ab5addb28da2d9f6681c
2018-09-25Add dynts suite to test switch between PDCH and TCHPau Espin Pedrol2-0/+108
It seems for not yet clear reasons the MS require some time after the PDCH channels have been activated again to use them reliably. If no sleep is used between call hangup and gprs activate pdp ctx, the MS fails to activate the pdp ctx due to QMI error respone to the "Start network" requested. Related: OS#2582 Change-Id: I73b51c31309ac4c28c64ed7eb7c8c649e535aa22
2018-09-25suites: encryption: Add test register_a5_3_authreqPau Espin Pedrol1-0/+8
Change-Id: I279e78e741b3ca841cb8508db40874f3c17b0785
2018-09-19encryption: Reuse code using test lib featuresPau Espin Pedrol4-125/+66
Change-Id: I9b6944516c524a0c11a47aec6839f8ee9d571661
2018-09-17Sanitize existing suite namesPau Espin Pedrol34-278/+278
When first suites were added, osmo-nitb was used. Then new tests using regular split components were added with "aoip_" prefix. At some point it was clear that osmo-nitb was being deprecated so new tests for split components were added without any prefix, as they are expected to be the default one. Since most current and future development is going to be done for split components, as well as new tests added, it makes sense to move the few old testsuites using osmo-nitb to have all "nitb_" prefix, while keeping the split component tests without prefix as it's the regular network topology. Change-Id: Idea2e053d337548e0e9b1b47441dbb262124f909
2018-08-21Replace suites dyn_ts_ipa* and voice using scenario modifiersPau Espin Pedrol12-264/+56
Now that we support modifiers in scenario files, we don't need to duplicate tests and testsuites to dynamically set trx configuration at run time. It can be done more easily with scenario modifiers. Change-Id: I80c441bb5b98d5d2e95d4c6ae1efab3e5f3c40d9
2018-08-13osmo-hlr.cfg.tmpl: Add ussd routing prefix for *#100# and fix expected ↵Pau Espin Pedrol1-1/+2
answer format Since osmo-hlr.git I1d09fab810a6bb9ab02904de72dbc9e8a414f9f9, USSD processing has been moved to osmo-hlr and prefix routing needs to be configured, otherwise USSD requested are answered back to the MS with an error "ss-NotAvailable (18)". mesage received for extension resolution (*#100#) had its format change, so update to new format (carriage return at the end was dropped). Change-Id: I5f75eff0df2d20d7f9b39e69184cffb0e635713d
2018-05-15tests: dyn_ts_*: Add tests to verify dyn ts with gprs disabledPau Espin Pedrol4-8/+42
Change-Id: If943ae0fb4e56787df02b09dea7387cb13eb9db3
2018-05-09Unload suite local modules after suite exit to avoid collisionsPau Espin Pedrol4-0/+8
Since sys.path is modified idynamically to load modules from "lib" subdir of each suite, from python env point of view all those modules share a namespace. As a result, there can be name collisions. If a name collision appears (eg test1 loads "testlib.py" and test2 afterwards also loads its own "testlib.py"), then python interpreter thinks the testlib.py module is already loaded, so test2 ends up using "testlib.py" from test1. The way to solve this is to make suite local modules to live only through the scope of the suite, and unload the modules once the suite is finished. Change-Id: I4efe815f85bc4ec2ca91aa9c2d3a369048f21571
2018-05-08suites: Remove rebase artifacts from latest commitsPau Espin Pedrol4-4/+0
Change-Id: I8afc446d4291810c63bfaeabb7167113667dd8d1
2018-05-08tests: dyn_ts_*: Add tests to verify dynamic timeslots during phone callsPau Espin Pedrol6-0/+130
Two different test suites are created since we want to run them with different HW, because some HW support one type of PDCH channels, and other HW supports the other one. Change-Id: Id5e61eaff39ac7a6585dc7de2aeb2469dd2ce726
2018-05-08tests: voice: Move mo_mt_call.py to mo_mt_call_tchf.pyPau Espin Pedrol2-5/+18
Change-Id: I7306e62ad4c4294370690cf9006871f798a7b9ec
2018-05-08tests: voice: test voice calls on TCH/H timeslotsPau Espin Pedrol1-0/+18
Change-Id: I897757a21fee516ce96808a180121b09f06a0fea
2018-05-08tests: voice: Move logic to lib/testlib.pyPau Espin Pedrol2-53/+62
This way we can have several tests sharing similar logic. Change-Id: I5cfcc56970380a7c5400186fac5f504263d63c5f
2018-02-26osmo-msc: Use osmo-mgw instead of osmo-bsc_mgcpPau Espin Pedrol12-37/+36
osmo-msc now requires osmo-mgw and it's not expected to work properly anymore with old mgcp code. Change-Id: I93033f7b6133a4914f12f37511ad870b3dea3201
2018-01-30aoip_smpp: Since recent osmo-msc, we accept all sms in store&forward modePau Espin Pedrol1-2/+8
Change-Id: Ieb5656f3ca93f4343441d90e30fbe904382c44e3
2018-01-29Revert "aoip_smpp: Disable check in esme_ms_sms_storeforward due to known issue"Pau Espin Pedrol1-7/+6
This reverts commit 4a22ac7d2c0b24dba1939760121381e83827aa57. Issue has been fixed in OS#2354, osmo-msc 1e67fea7ba5c6336066b78f98a28ab33b05c36c4. Change-Id: I83d857c639db35abcd05bc87db9962d092c10eca