Commit Graph

266 Commits

Author SHA1 Message Date
Pierre Kancir 58358d9f97 Tools: correct arguments passing on autotest.py 2021-05-26 18:46:03 +10:00
Pierre Kancir 458b6084fa Tools: don't make report test failure on coverage 2021-05-20 14:54:47 +10:00
Peter Barker 117a44b589 autotest: remove corefiles at start of run
These lead to false-positive failures in the test suite
2021-05-01 17:22:36 +10:00
Iampete1 0628aa9e29 Tools: autotest: add sailboat autotest 2021-04-28 15:16:35 +10:00
Peter Barker c350268918 autotest: correct compilation of Replay in autotest suite 2021-04-05 16:39:36 +10:00
Peter Barker d2c00f7b26 autotest: ensure RC thread is killed after each run_test
Every run_test starts a thread.  del is not being called.  So clean it
up in the caller
2021-04-01 11:00:54 +11:00
Peter Barker 500679ec5b autotest: correct creation of default parameters
Simulation won't start if nothing is connected to 5760 - so just connect
mavproxy there
2021-03-31 23:29:47 +11:00
Peter Barker ef4ebbf126 autotest: add a do-nothing --autotest-server option
This option is currently ignored, but if given allows the script to
continue normally.

This allows us to change the autotest server to pass the option in - and
then we can change autotest.py so that unless the option is given we
spit out a help message rather than completely stuff up the user's
development environment
2021-03-26 22:52:35 +11:00
bugobliterator 5074b6d336 autotest: add test case for GPS ordering
also fix flake8 issues
2021-03-12 16:32:36 +09:00
bugobliterator 48277b43e4 Tools: add autotest for checking GPS ordering 2021-03-12 16:32:36 +09:00
Peter Barker e3887c8d93 autotest: make and mark autotest.py flake8-clean 2021-02-18 10:43:05 +11:00
Peter Barker be8f747b7a autotest: adjust timeout for Valgrind; disable for gdb 2021-02-16 13:18:41 +11:00
Pierre Kancir 2b71bf8e99 Autotest: fix subtests completion 2021-01-27 08:27:54 +11:00
Peter Barker 2e2e34d784 autotest: correct run_one_test case (vehicle.testname case) 2021-01-21 22:59:34 +11:00
Peter Barker c7a6047904 autotest: add option to retry tests / create and use Test definition object 2021-01-21 10:23:17 +11:00
Peter Barker cd8a393ac2 autotest: create own RC thread to handle setting of RC overrides
autotest: prevent method-on-undef problem in case of early test failure

autotest: plumb MAVProxy rc input back in for switch test

autotest: close off rc thread in case of timeout
2021-01-15 20:56:30 +11:00
Peter Barker 8e6d144d72 autotest: re-raise KeyboardInterrupt after closing pexpects
this gives a stack trace, which is handy if the tests get caught
indefinitely somewhere
2021-01-09 15:16:50 +11:00
Peter Barker 6908a776fa autotest.py: timeout after 5400 seconds 2020-12-31 14:55:32 +11:00
Pierre Kancir cd98129022 Autotest: fix css loading for autotest.ardupilot.org 2020-11-28 19:14:16 +11:00
Andrew Tridgell f674d124d6 autotest: use SITL replay 2020-11-10 16:15:45 +11:00
Andrew Tridgell a37cae5dae autotest: added test.Copter.Replay test 2020-11-10 16:15:45 +11:00
bugobliterator c72c96fa9c Tools: setup CI test for CANBus 2020-11-04 19:59:40 +11:00
Pierre Kancir 4ca8f6bf1e Autotest: fix githash on python 3 for firmware html page 2020-10-24 10:30:09 +11:00
Pierre Kancir de927691f2 Tools: remove empty fields in autotest.ardupilot.org 2020-10-24 10:30:09 +11:00
Buzz 586e9f80d5 AutoTest: break copter autotests into smaller "under 10 minute" chunks to speedup github actions CI 2020-10-21 18:01:47 +11:00
Andrew Tridgell 8b95fac214 Tools: added --Werror option to autotest.py 2020-09-15 09:40:03 +10:00
Peter Barker 749b678e14 autotest: add scan-build autotest steps 2020-08-07 16:00:18 +10:00
Pierre Kancir 1fa6138ca1 Tools: Autotest.py: Allow autotest subtests completion 2020-08-06 20:55:13 +10:00
Peter Barker 6490a57179 autotest: move check_logs to be an AutoTest-class function
This makes the AutoTest instance cognizant of the binary log files it is creating.  This will be useful for checking the contents of the log files created.
2020-06-04 20:15:31 +10:00
Peter Barker d08e9b3363 autotest: --list-subtests works for QuadPlane, Heli and BalanceBot 2020-06-04 10:13:57 +10:00
bugobliterator 183e50b31f autotest: fix autotest on mac os x 2020-05-17 16:12:43 +10:00
Peter Barker 475027e03a Tools: autotest.py: add --enable-math-check-indexes 2020-04-28 15:12:39 +10:00
Peter Barker 864717310d autotest: allow specification of EKF type to use on commandline 2020-04-24 13:37:47 +10:00
Samuel Tabor e30f0a9173 autotest: Move soaring test into plane. 2020-04-19 11:09:16 +10:00
Peter Barker 7c20a1ee05 autotest: rename apmrover2.py to rover.py 2020-04-15 19:29:04 +10:00
Peter Barker 691ae58a79 Tools: rename APMrover2 to Rover 2020-04-14 09:50:34 +09:00
Samuel Tabor a4c5e12fac Tools: Make soaring test a subclass of plane test. 2020-04-08 09:11:54 +10:00
Samuel Tabor 528dcc3f6b Autotest: Add test for soaring. 2020-04-08 09:11:54 +10:00
Peter Barker d966f5718d autotest: add option to list subtests 2020-04-03 17:00:22 +11:00
Peter Barker 45ccced4df autotest: add examples to help output 2020-04-03 17:00:22 +11:00
Peter Barker 2fb31e69ea autotest: correct test class map for Helicopter 2020-04-01 11:17:56 +11:00
Peter Barker 9da91b2005 autotest: execute check-logs step for Tracker
... and newly-renamed steps.

Also, eliminate no-longer needed step prefixes as we've canonicalised
them.
2020-03-30 13:34:08 +11:00
Peter Barker be49396d32 autotest: canonicalise step names (e.g. drive.APMrover2 -> test.Rover)
Map from older step names to newer test names added for
backwards-compatability
2020-03-27 09:29:19 +11:00
Peter Barker d464db9c70 Tools: create log of build_binaries.py builds 2020-03-07 20:49:36 +11:00
Peter Barker 82f53abee2 autotest: restore fly.ArduCopter as running all tests
the test list for ArduCopter is made up of those from tests1 and tests2
2020-02-22 16:51:39 +11:00
Andy Piper 05a0fe615b Tools: split Copter tests into two runs to balance time on travis 2020-02-22 11:15:37 +11:00
Peter Barker e3e152ae3e autotest: make all-parameter-documentation-working a full autotest 2020-02-19 15:09:16 +11:00
Peter Barker be7ae6fbc9 autotest: add --validate-parameters autotest option
After each reboot, the complete list of parameters is downloaded and
checked against parameter documentation generated from the source code.
2020-02-13 21:31:20 +11:00
Andy Piper 5f34ec6578 Tools: support lldb debugging for sim_vehicle and autotest 2019-09-26 09:02:11 +10:00
Peter Barker 642935fd43 Tools: random Python cleanups based on lgtm analysis 2019-09-21 22:26:03 +10:00
Peter Barker 87e43d6e44 Tools: autotest: add option to disable breakpoints at sim startup 2019-07-12 12:48:05 +10:00
Andrew Tridgell 1f98665699 moved build.Binaries ahead of build.All
ensure we get new builds out quickly
2019-06-03 17:59:28 +10:00
Peter Barker fd19b257f9 Tools: autotest: print test failure summary at end of running all steps 2019-05-08 10:27:50 +10:00
Andrew Tridgell 0cbc612ef6 autotest: fixed copy of gen_stable.py 2019-05-04 11:20:37 +10:00
Peter Barker 2a9e0859c7 Tools: autotest: use class map for getting test class for full test name 2019-03-09 15:32:28 +11:00
Peter Barker 243abe8751 Tools: autotest: allow balancebot tests to be run individually 2019-03-08 23:28:00 +11:00
Peter Barker a2ebdf6f2e Tools: autotest: Indicate we have handled an alarm 2019-03-06 10:36:32 +09:00
Peter Barker 31a9ac7dbd Tools: autotest: add test suite for Tracker 2019-02-26 08:03:56 +11:00
Peter Barker 624f196fb3 Tools: autotest: increase timeout to 3600 seconds
Right on the edge on my laptop at 3000
2019-02-19 14:09:59 +11:00
Willian Galvani 963905f812 Autotest: Add badge to index.html 2019-02-13 09:28:19 +11:00
Peter Barker cf2c0ec334 Tools: autotest: print time taken for each test 2019-02-12 13:30:28 +11:00
Peter Barker f3cbf72f41 Tools: autotest: all autotest classes now take a frame 2019-02-09 14:55:11 +11:00
Pierre Kancir 8a7555bf56 Tools: autotest: fix up the arming tests
Tools: unify arm function failure message

Tools: get autodisarm time from parameter for autodisarm test

Tools: disable autodisarm for arm/disarm tests.

Tools: fix interlock channel for heli

Tools: simplify arming_test sub exclusion

Tools: fix empty string in progress

Tools: add back arming test to plane

Tools: allow single test run on Sub

Tools: remove old comments on autotest common

Tools: add vehicle type getter function

Tools: make get_rudder_channel abstract method

Tools: common make get_disarm_delay abstract method

Tools: make set_autodisarm_delay abstract method

Tools: rename set_throttle_zero to zero_throttle and use it

Tools: common.py remove unnecessary exception

Tools: subclass vehicle type
2019-02-09 10:04:57 +11:00
Peter Barker d9d9745c11 Tools: autotest: add test for QuadPlane QAutoTune 2019-02-04 21:18:21 +11:00
Peter Barker b66f80f452 Tools: autotest: allow heli tests to be run individually 2019-01-16 21:36:13 +11:00
Andrew Tridgell 9596358f3c CI: removed px4 builds 2018-12-22 11:06:59 +11:00
Peter Barker 69293f46f3 Tools: autotest: convert Heli to new tests framework 2018-12-18 10:06:09 +11:00
Peter Barker 7aa1d51585 Tools: autotest: move balancebot to new tests structure 2018-12-18 10:06:09 +11:00
Peter Barker 8541a28637 Tools: autotest: support named tests 2018-12-15 10:02:11 +11:00
Peter Barker f94755b5a1 Tools: autotest: collect logs correctly for Sub 2018-11-05 12:45:52 +11:00
Peter Barker 55377b424e Tools: autotest: add extra-configure-args option to autotest.py 2018-10-03 13:34:59 +10:00
Peter Barker 4023f847c8 Tools: add ability for autotest to run examples 2018-09-19 22:40:20 -07:00
Pierre Kancir f6cc934678 Tools: pep8 corrections + correct variable shadowing 2018-08-27 17:08:47 +10:00
Peter Barker aa36d20aa1 Tools: autotest: add steps to autotest to build and run unit tests
This is Linux-specific ATM
2018-08-15 12:11:43 +10:00
Ebin 9c3b7e7c7d Tools: Autotest for balance bot 2018-07-28 08:44:18 +10:00
Peter Barker 6dd8dbeb40 Tools: autotest: add ability to add breakpoints in autotest 2018-07-27 09:58:15 +10:00
Peter Barker 4c581a0522 Tools: autotest: correct invocation of build_all 2018-07-05 09:02:02 +10:00
Peter Barker 0ae82751b8 Tools: autotest.py: flake8 compliance
Also fixed a bug where CalledProcessError has not been imported
2018-07-04 14:05:07 +10:00
Peter Barker 167553e8a5 Tools: autotest: tidy usage and simplify vehicle build steps 2018-05-11 13:43:33 +10:00
Andrew Tridgell 3b143a99bf autotest: removed sitl-debug varient 2018-05-04 18:33:53 +10:00
Peter Barker a03ddc6798 Tools: autotest: correct default parameter names and paths 2018-03-29 09:19:36 +11:00
Peter Barker 5aa8890e5b Tools: autotest: fail convertgpx if zip or gpsbabel fail 2018-03-22 09:11:44 +11:00
Peter Barker b348cfa985 Tools: autotest: flake8 compliance
Taking the opportunity to make massive changes while we're destroying
history anyway.
2018-03-15 07:54:21 +09:00
Pierre Kancir 259dda810d Tools: use base class to share code between vehicle tests
Autotest: common.py add new base class and test

Autotest : Common add heartbeat handling on wait_mode timeout

Autotest: common.py add reach_heading_manual and reach_distance_manual

Autotest: new autotest implementation for Rover

Autotest : rover add drive_square test

Autotest: new autotest implementation for Copter

Autotest: new autotest implementation for Plane

Autotest: new autotest implementation for Sub

Autotest: new autotest implementation

Autotest: new autotest implementation for QuadPlane

Autotest : Sub disable GCS_Failsafe on autotest to prevent timeout. The failsafe aren't currently tested on Sub
2018-03-15 07:54:21 +09:00
Peter Barker 50ccbb5d0c Tools: autotest: correct speedup parameter handling 2018-02-13 17:15:05 +11:00
Peter Barker 94afaebdb7 Tools: autotest builds each vehicle parameters individually 2017-12-16 11:08:35 +11:00
Andrew Tridgell 20d44136b0 autotest: fixed handling of core files 2017-12-12 08:45:56 +11:00
Peter Barker 47ffad7cdc Tools: autotest: copy generate_manifest aside for build_binaries.py 2017-10-26 07:57:48 +11:00
Peter Barker e3320ca953 Tools: autotest.py: run build_binaries.py instead of build_binaries.sh
Note we still copy the script sideways.  This is probably not
required for a python script.
2017-10-25 12:02:19 +11:00
Andrew Tridgell b88f2f1da3 autotest: fixed exception in convertgpx 2017-10-22 16:26:24 +11:00
Peter Barker 20bfb82a7b Tools: autotest.py: add --no-clean and --no-configure options 2017-09-11 12:45:27 +10:00
Peter Barker 2738fc34f0 Tools: autotest.py: exit if step not matched
Also, stop shadowing a variable
2017-09-08 21:51:26 +10:00
Peter Barker 6928618de8 Tools: autotest.py: allow specification of a buildlogs directory 2017-09-01 23:39:38 +10:00
Peter Barker 1b7122d733 Tools: add a --speedup parameter to autotest to control speed of all sims 2017-08-29 22:49:40 +01:00
Peter Barker 24e616af7d Tools: autotest.py: factor write_fullresults 2017-08-26 17:54:32 +01:00
Miguel Arroyo 38297c4d19 Tools: Adds GDBServer with screen option for debugging 2017-08-24 21:37:06 +10:00
Daniel Orbach 3c66663880 Tools: autotest.py: Squashed the code for default.* steps in run_step(). 2017-08-14 12:16:29 +10:00
Daniel Orbach 91e25bb937 Tools: autotest.py: Made use of shutil.copy2() where appropiate. 2017-08-14 12:16:29 +10:00
Daniel Orbach befd8b028b Tools: autotest.py: Moved all imports to top of file. 2017-08-14 12:16:29 +10:00
Daniel Orbach e951df7d50 Tools: autotest.py: Simplified binary_path through lookup table 2017-08-14 12:16:29 +10:00