Commit Graph

338 Commits

Author SHA1 Message Date
Peter Barker bd50f288a1 Tools: autotest: get mavproxy to heartbeat at speedup rate
This should resolve a race condition we have with guided position modes.

MAVProxy's heartbeat rate defaults to 1Hz.

When GCS failsafe is active on Copter because we're in GUIDED (or
GUIDED_NOGPS mode) we require a heartbeat every 5 seconds.  At speedup
8, we can only expect a heartbeat every 8 seconds of sim time.

We also only check for this heartbeat every 3 seconds - leading to this
awesome race condition.
2019-07-12 12:48:05 +10:00
Peter Barker 87e43d6e44 Tools: autotest: add option to disable breakpoints at sim startup 2019-07-12 12:48:05 +10:00
Pierre Kancir 12cb09a3f4 Tools: factorize sitl rangefinder setup 2019-07-11 11:52:44 +10:00
Pierre Kancir daaf769055 Tools: add arm/disarm testing on all modes 2019-07-11 11:42:45 +10:00
Pierre Kancir 9850d1afec Tools: update with flake8
W605 invalid escape sequence '\s'
F402 import 'time' from line 10 shadowed by loop variable
E101 indentation contains mixed spaces and tabs
E703 statement ends with a semicolon
2019-07-09 12:46:39 +10:00
Peter Barker 899db3d3ac Tools: autotest: add test for sensor config error loop
Tools: autotest: exempt failing vehicles from SensorConfigError test
2019-07-09 10:01:23 +10:00
Peter Barker 6332d2e729 Tools: autotest: fix race condition with getting parameters 2019-07-08 16:51:25 +10:00
SergeyBokhantsev c9447776b2 Tools: autotest: correct debounce tests under Rover
Channel 8 is the mode channel under Rover
2019-07-04 11:35:05 +10:00
Peter Barker 98cb68157f Tools: autotest: add a test for Copter surface tracking 2019-06-21 13:50:55 +10:00
Peter Barker 5992cc8782 Tools: autotest: clear mission between tests 2019-06-20 11:51:13 +10:00
Peter Barker d8278335a1 Tools: autotest: move upload_using_mission_protocol up to common.py 2019-06-07 16:29:37 +10:00
Peter Barker c8a4af76fe Tools: autotest: add tests for Plane fence 2019-06-07 16:29:37 +10:00
Peter Barker 6047ef105e Tools: autotest: correct text MAVProxy-dedupe check in mission load
This failed to protect against multiple rapid calls to load_mission
2019-06-06 10:33:28 +10:00
Peter Barker e9552ec4e1 Tools: autotest: more efficient set_rc_from_map 2019-06-02 10:02:24 +10:00
Peter Barker 3ed55ea3c5 Tools: autotest: add drain_mav_unparsed and use it 2019-05-28 20:41:56 +10:00
Peter Barker 8d90b09829 Tools: autotest: add tests for upload/download rally using mission protocol
Tools: autotest: add tests for mission clearing

Tools: autotest: add tests for out-of-range mission counts

Tools: autotest: add test for Plane DO_CHANGE_SPEED
2019-05-22 08:53:45 +10:00
Francisco Ferreira 4f153f06b3
Tools: autotest: increase timeout for arming param check 2019-05-15 22:44:22 +01:00
Francisco Ferreira e95d603a73
Tools: autotest: parse all heartbeats when looking for mode change 2019-05-15 22:44:22 +01:00
Peter Barker d76894d883 Tools: autotest: drain mav before getting message rates, improve debug 2019-05-09 19:53:53 +10:00
Peter Barker a2105e1f81 Tools: autotest: correct statustext sending under Python3 2019-05-02 13:15:37 +10:00
Peter Barker 18391d8a9a Tools: autotest: produce stacktraces under Python3 2019-05-02 13:15:37 +10:00
Peter Barker 4a237af093 Tools: autotest: ensure reboot if dataflash-over-mavlink test fails
Will stop cascading failures from occuring
2019-04-30 19:19:58 +10:00
Peter Barker 0cd5d66e3a Tools: autotest: increase epsilon
our round-trips etc cost precision
2019-04-23 10:06:17 +10:00
Peter Barker 2cb69366c8 Tools: autotest: facilitate changing mode by number 2019-04-19 07:51:49 +09:00
Peter Barker 5e69758661 Tools: autotest: factor out a start_mavproxy method 2019-04-16 21:10:22 +10:00
Peter Barker b2acd15a55 Tools: autotest: encode string to bytes before passing to statustext_send 2019-04-15 18:40:01 +10:00
Peter Barker b7eca63073 Tools: autotest: send statustext with test name to autopilot
This gets logged into the dataflash so you can quickly find relevant
logs
2019-04-14 07:56:39 +10:00
Peter Barker 696de42eea Tools: autotest: check we're seeing PL messages in the log during
precland
2019-04-04 11:54:58 +11:00
Peter Barker 4eaee039f0 Tools: autotest: avoid touch RC*_OPTION on sub 2019-03-30 12:01:49 +11:00
Peter Barker 6f52fa5622 Tools: autotest: do not set ARMING_RUDDER on sub and tracker 2019-03-29 19:07:18 +11:00
Peter Barker ffccd6f263 Tools: autotest: stop using mav.location() for Tracker test
Turns out that since we don't stream vfr_hud mav.location won't ever
work
2019-03-29 07:40:45 +11:00
Peter Barker 9a16b40a73 Tools: autotest: rename get_rudder_channel to get_stick_arming_channel
... as some of these aren't actually rudder inputs...
2019-03-27 11:29:53 +11:00
Peter Barker 265d8d62cd Tools: autotest: add timeout to wait_ekf_flags waiting for EKF_STATUS_REPORT 2019-03-26 20:55:32 +11:00
Peter Barker 6fe7db2f43 Tools: autotest: add test for REQUEST_MESSAGE 2019-03-26 16:20:50 +11:00
Peter Barker c6b8335392 Tools: autotest: improve debug for lack of mode map 2019-03-25 16:57:41 +11:00
Peter Barker 16476332b2 Tools: autotest: fix no-gps switch-to-location test 2019-03-22 08:19:42 +11:00
Peter Barker 1e2cf4bb60 Tools: autotest: fix sethome test under Python3 2019-03-22 08:19:11 +11:00
Peter Barker 935840ebb0 Tools: autotest: add test for setting home to current location 2019-03-19 19:56:13 +11:00
Peter Barker 6bf600c587 Tools: autotest: cope with being unable to reboot while armed 2019-03-19 10:53:37 +11:00
Peter Barker 873096f791 Tools: autotest: add test for Rover offboard-in-auto function 2019-03-15 14:51:35 +09:00
Peter Barker 9ca2c9d692 Tools: autotest: python3 fixes
Tools: autotest: use inbuilt zip on Python3
2019-03-13 20:26:24 +11:00
Peter Barker 841c222a12 Tools: autotest: add check that GPS is good before arming 2019-03-13 17:13:10 +11:00
Peter Barker 0aeb6c0e26 Tools: autotest: ensure initial home position is similar to sitl start pos 2019-03-13 13:20:29 +11:00
Peter Barker d53f787a14 Tools: factor init up into parent class
Tools: autotest: use speedup 8 for all suites

for reliability
2019-03-13 08:20:20 +11:00
Peter Barker 844999c458 Tools: autotest: get accuracy before doing RTL
It can take a very long time to get our parameter value, so get it while
we're NOT moving away from the RTL location!
2019-03-13 08:20:20 +11:00
Peter Barker 65d0443c26 Tools: autotest: drain mav either side of initialising-after-reboot 2019-03-12 12:15:39 +11:00
Peter Barker f71f100d6a Tools: autotest: make drain_mav truly drain the mavlink connection 2019-03-12 12:15:39 +11:00
Peter Barker b47b97a981 Tools: autotest: add test for QuadPlane controller pre-arm checks 2019-03-12 10:14:14 +11:00
Peter Barker 28e27b4120 Tools: autotest: improve test reliability
Also remove redundant reset code

Tools: autotest: drain mav and all pexexpects before running each test

Tools: autotest: increase some timeouts for failures when running under GDB

Tools: autotest: correct ordering of operations in mount test
2019-03-11 13:59:51 +11:00
Peter Barker 6418226106 Tools: autotest: increase test diagnostics
Tools: autotest: improve wait_distance_home_gt output

Tools: autotest: emit progress for parameter sets

Tools: autotest: add progress for RC health checks

Tools: autotest: remove pointless context
2019-03-11 11:25:04 +11:00
Peter Barker 2ef24e700e Tools: autotest: correct gripper tests
set_rc swallows messages - like the statustext messages we are looking
for
2019-03-11 10:46:57 +11:00
Peter Barker d48eab893a Tools: autotest: stop swallowing critical messages with get_sim_time() 2019-03-10 21:55:51 +11:00
Peter Barker 38e26757fd Tools: autotest: add option to quieten some functions
Useful when you know the output is not going to be useful
2019-03-10 21:55:51 +11:00
Peter Barker a504f9ac8d Tools: autotest: add option to use cached home for distance_to_home 2019-03-09 12:44:06 +11:00
Peter Barker 4d3ca97a0f Tools: autotest: correct pre-arm flags-OK checks 2019-03-08 23:22:22 +11:00
Peter Barker 194142b343 Tools: autotest: add simple test for fence prearms 2019-03-08 08:57:27 +09:00
Peter Barker f2e3d377ad Tools: autotest: drain mav during RTL test to improve reliability 2019-03-07 14:22:09 +11:00
Peter Barker 91436c5314 Tools: autotest: add test for high-throttle-at-mode-change 2019-03-07 11:33:20 +11:00
Peter Barker b1bbe09602 Tools: autotest: increase timeout on pid tuning 2019-03-07 00:15:05 +11:00
Peter Barker f23c6e1624 Tools: autotest: better streamrate reset 2019-03-06 21:25:16 +11:00
Peter Barker b4af1dae0f Tools: autotest: skip rudder disarm for balancebot 2019-03-06 10:45:56 +11:00
Peter Barker 5f315aab59 Tools: autotest: fix infinite hang in wait_statustext 2019-03-06 10:45:56 +11:00
Peter Barker 8c35ddc0eb Tools: autotest: add PID_TUNING test 2019-03-05 10:41:56 +11:00
Peter Barker 792fbc6240 Tools: autotest: allow imprecise home in set-home test
float<->integer conversion issues means this comes back imprecisely
2019-03-04 23:46:40 +11:00
Peter Barker 6103d5ebac Tools: autotest: add a simple dataflash-over-mavlink test 2019-03-02 09:28:19 +11:00
Pierre Kancir 4ac5fb42cd Tools: don't upload failed log on ardupilot server by default 2019-03-01 20:48:39 +11:00
Peter Barker 9dad451ef5 Tools: autotest: use start_subtest in arming test 2019-03-01 14:56:05 +11:00
Peter Barker d6674a3bb1 Tools: autotest: correct progress message 2019-02-28 12:53:49 +11:00
Peter Barker 50687c9add Tools: autotest: ArmFeatures is common to all vehicles; use inheritted tests 2019-02-28 12:53:07 +11:00
Peter Barker 6fc4086726 Tools: autotest: accept home position before or after ack
autopilot may be out of space or time to send home position packet after
we have requested it
2019-02-26 14:01:41 +11:00
Peter Barker 31a9ac7dbd Tools: autotest: add test suite for Tracker 2019-02-26 08:03:56 +11:00
Peter Barker e9fc158c8a Tools: autotest: eliminate use of recv_match with condition
We have functions for achieving this

Also, a lot of these places were missing timeouts, so any failure would
cause the entire suite to stop running
2019-02-22 16:30:05 +11:00
Francisco Ferreira 08fdd5c36c Tools: autotest: strip newline chars for comparing mission files
Windows is different from other OSes so remove the newline characters before comparing lines when making sure mission files are the same
2019-02-22 08:27:08 +11:00
Pierre Kancir 7e12f16be6 Tools: fix lambda test 2019-02-22 08:04:03 +11:00
Peter Barker a117e4571d Tools: autotest: add simple Rally test 2019-02-20 18:03:38 +11:00
Peter Barker 27d6bebed3 Tools: autotest: add test that ArduPilot indicates it can do PARAM_FLOAT 2019-02-19 13:14:52 +11:00
Peter Barker c0394e9577 Tools: autotest: tidy handling of SITL start position 2019-02-16 19:14:48 +11:00
Peter Barker 025f007f96 Tools: autotest: simplify mission loading 2019-02-16 10:27:41 +11:00
Peter Barker e3368e193d Tools: autotest: add test for throttle failsafe 2019-02-14 11:49:59 +11:00
Mark Whitehorn fd385c0f91 Tools: autotest: add quadplane output_motor_mask check
add comparator arg to wait_servo_channel_value and cleanup
2019-02-13 15:28:47 +11:00
Peter Barker 957f637043 Tools: autotest: add autotest for setting home position with command-int 2019-02-13 09:42:26 +11:00
Peter Barker cf2c0ec334 Tools: autotest: print time taken for each test 2019-02-12 13:30:28 +11:00
Peter Barker edfa2646f0 Tools: autotest: repeatedly apply parameter file 2019-02-09 18:17:00 +11:00
Peter Barker 6f1f98dc3c Tools: autotest: add assumption run_tests is only called once - remove hasInit 2019-02-09 11:31:17 +11:00
Pierre Kancir 8a7555bf56 Tools: autotest: fix up the arming tests
Tools: unify arm function failure message

Tools: get autodisarm time from parameter for autodisarm test

Tools: disable autodisarm for arm/disarm tests.

Tools: fix interlock channel for heli

Tools: simplify arming_test sub exclusion

Tools: fix empty string in progress

Tools: add back arming test to plane

Tools: allow single test run on Sub

Tools: remove old comments on autotest common

Tools: add vehicle type getter function

Tools: make get_rudder_channel abstract method

Tools: common make get_disarm_delay abstract method

Tools: make set_autodisarm_delay abstract method

Tools: rename set_throttle_zero to zero_throttle and use it

Tools: common.py remove unnecessary exception

Tools: subclass vehicle type
2019-02-09 10:04:57 +11:00
Peter Barker fe2f9f1f14 Tools: autotest: improve autotest output 2019-02-07 08:51:13 +11:00
Peter Barker 4d2d1350c4 Tools: autotest: make changing mode more reliable
There are race conditions between setting mode switches and using
MAVProxy to change mode.  This should remove some of the issues.
2019-02-06 09:32:10 +11:00
Peter Barker d33e5ea012 Tools: autotest: look for mavproxy files in cwd
While correct if you run autotest.py from the root of an ArduPilot git
repo, this is generally not correct.  The autotest server does not have
such a cwd; it runs it from one-directory-up.
2019-02-05 14:14:14 +11:00
Peter Barker 1fcd7fac06 Tools: autotest: add test for flip mode 2019-02-04 11:07:28 +09:00
Peter Barker e23313e16b Tools: autotest: ensure RC input is at defaults before each test 2019-02-04 08:00:07 +11:00
Peter Barker fa37ad344b Tools: autotest: refactor setting of rc defaults 2019-02-04 08:00:07 +11:00
Peter Barker 2834fd8017 Tools: autotest: add test for channel override cancel 2019-02-01 11:48:01 +11:00
Peter Barker 9aefaf5b92 Tools: autotest: add tests for GET_MESSAGE_INTERVAL 2019-01-30 13:56:55 +09:00
Peter Barker 429217f392 Tools: autotest: correct division-by-zero error 2019-01-17 12:30:56 +11:00
Peter Barker d0aaf34db5 Tools: autotest: add option to skip tests if they're annoying us in CI 2019-01-14 20:15:47 +11:00
Peter Barker 55f751a8f4 Tools: autotest: add some tests for Copter parachute functions 2019-01-09 13:16:03 +11:00
Peter Barker fe1ac46840 Tools: autotest: correct log Tee'ing 2019-01-04 13:41:36 +11:00
Peter Barker 7cb1051aee Tools: autotest: correct error message for mission upload/download 2019-01-02 20:33:17 +11:00
Peter Barker e6bfbe5f07 Tools: autotest: fix initial mode switch position race
Solves a race condition where an initial setting of mode via mavlink
could be overwritten by the vehicle polling the RC channels and changing
mode based on the new positions.

This will require each vehicle to specify the mode expected without an
RC inputs present and the expected mode once the RC defaults have been
installed.  These two modes will need to be different to eliminate the
race condition.
2018-12-27 15:15:59 +11:00
Peter Barker 320ea4d7f5 Tools: autotest: remove old run_test function 2018-12-21 11:53:38 +11:00
Peter Barker 3b57635ec9 Tools: autotest: convert Copter to new tests framework 2018-12-18 10:06:09 +11:00
Peter Barker 22cc55a500 Tools: autotest: give message rate in drain 2018-12-18 10:06:09 +11:00
Peter Barker 7ad299c526 Tools: autotest: clarify arming tests messages 2018-12-18 10:06:09 +11:00
Peter Barker 7aa1d51585 Tools: autotest: move balancebot to new tests structure 2018-12-18 10:06:09 +11:00
Peter Barker 1f8db08dab Tools: autotest: show test output filename in summary 2018-12-15 21:39:29 +11:00
Peter Barker 28b0267b6c Tools: autotest: add timeout on Rover test_rc_overrides 2018-12-15 21:38:48 +11:00
Peter Barker 686bfc367e Tools: autotest: tee MAVProxy output to per-test file 2018-12-15 17:11:44 +11:00
Peter Barker 8528bcf78c Tools: autotest: tee individual test output to separate files 2018-12-15 10:02:11 +11:00
Peter Barker 8541a28637 Tools: autotest: support named tests 2018-12-15 10:02:11 +11:00
Peter Barker dd78a5a921 Tools: autotest: use wallclock time for reboot 2018-12-14 16:57:29 +11:00
Peter Barker da1f04e78c Tools: autotest: add a test for SYSID_ENFORCE 2018-12-14 12:44:31 +11:00
Peter Barker e6c30f6405 Tools: autotest: use change_mode in apmrover2 for changing modes 2018-12-14 11:10:41 +11:00
Peter Barker a320a54f66 Tools: autotest: new wait_heartbeat raises exception if none received 2018-12-14 11:10:41 +11:00
Peter Barker ec288cd867 Tools: autotest: make reboot detection more reliable 2018-12-14 09:48:17 +11:00
Peter Barker 0d34052cef Tools: autotest: move code up 2018-12-10 12:52:41 +09:00
Peter Barker dd88e6e85c Tools: autotest: correct wait_servo_channel_value error path
Also make flaps test a little more verbose
2018-11-29 09:48:31 +11:00
Peter Barker 02993b4ad0 Tools: autotest: delay between transitioning aux switch for arming
... on the theory that we debounce these so it's a good idea to give the
RC library a good look at each value
2018-11-26 17:35:07 +11:00
Peter Barker 88a003edd9 Tools: autotest: flake8 compliance 2018-11-24 08:30:02 +11:00
Peter Barker f84370bb04 Tools: autotest: consolidate mission-loading functions
Also add sanity checks for mission loading

Tools: autotest: add missing import for arduplane.py
2018-11-16 10:06:25 +11:00
Peter Barker 1d2f8555c0 Tools: ardupilotwaf: adjust for new location of uploader.py 2018-11-15 09:55:14 +11:00
Andrew Tridgell 6b5088207b autotest: upload failed CI logs to autotest server 2018-11-10 21:23:02 +11:00
Peter Barker 7600d3205a Tools: correct race condition in interlock check 2018-11-04 21:38:15 +11:00
Peter Barker 4e82250055 Tools: autotest: add test for Copter loiter-to-alt 2018-10-30 17:50:46 +09:00
Peter Barker a01c915173 Tools: autotest: improve debug in arm-with-radio 2018-10-30 15:37:18 +11:00
Peter Barker 2157999307 Tools: autotest: add tests for gripper mission items 2018-10-30 15:37:18 +11:00
Peter Barker 8985cc05c7 Tools: autotest: raise exception on get_parameter failure 2018-10-23 14:49:44 +11:00
Peter Barker b8e1d26708 Tools: autotest: reduce dummy streamrate
Given we have trouble with the amount of data flowing around, doubling
this seems somewhat unfortunate.
2018-10-23 10:35:21 +11:00
Willian Galvani bf1429ead7 Tools: Autotest: Fix ArduSub autotest 2018-10-21 09:01:14 +11:00
Peter Barker e9d6c47f76 Tools: autotest: correct lamda->lambda 2018-10-19 08:54:56 +11:00
Peter Barker a66cc52573 Tools: autotest: provide description of exceptions in constructors 2018-10-19 08:52:44 +11:00
Peter Barker 14d2012f54 Tools: autotest: add test for ekf navigation speed limits 2018-10-09 10:47:38 +11:00
Pierre Kancir 53e36931fb Tools: correct channel configuration for gripper test 2018-10-03 20:10:13 +10:00
Pierre Kancir e087b03dd0 Tools: disable autodisarm test (broken) 2018-10-03 10:11:13 +02:00
Pierre Kancir 15e291aac9 Tools: don't set zero_throttle on arm/disarm 2018-10-03 10:10:25 +02:00
Pierre Kancir 0785706a94 Tools: test that heli interlock output cannot be high when disarmed
Co-authored-by: bnsgeyer <bnsgeyer@aol.com>
2018-10-03 10:09:30 +02:00
Pierre Kancir 752f78c80e Tools: test ARMING_RUDDER restrictions
Co-authored-by: bnsgeyer <bnsgeyer@aol.com>
2018-10-03 10:09:30 +02:00
Pierre Kancir 31d4f1b065 Tools: test that copter cannot arm with throttle too high
Co-authored-by: bnsgeyer <bnsgeyer@aol.com>
2018-10-03 10:09:30 +02:00
Pierre Kancir 553874f14a Tools: add arm/disarm with switch tests
Co-authored-by: bnsgeyer <bnsgeyer@aol.com>
2018-10-03 10:09:28 +02:00
Pierre Kancir d37a74f46a Tools: fix arm_motors_with_rc_input and disarm_motors_with_rc_input 2018-10-03 17:24:52 +10:00
Pierre Kancir 9b7e406a55 Tools: fix use of unassign variable 2018-10-03 17:19:38 +10:00
Pierre Kancir 55f4be0515 Tools: make do_set_mode function more generic 2018-10-03 16:57:01 +10:00
Pierre Kancir b80937cbd4 Tools: add timout to arm/disarm functions 2018-10-03 16:57:01 +10:00
Peter Barker a7042e3847 Tools: autotest: tweak output messages, loosen camera trigger timeout 2018-09-08 12:56:15 +10:00
Peter Barker 6e44ea13d4 Tools: autotest: do not arm vehicle before flaps test 2018-09-07 23:18:43 +10:00
Pierre Kancir d8c53bbd9c Tools: remove dependency on mavproxy for cmd_long based functions 2018-09-07 11:20:03 +10:00
Pierre Kancir 87a7fd0fbb Tools: remove dependency on mavproxy for arming/disarm 2018-09-07 11:20:03 +10:00
Pierre Kancir e278a09668 Tools: don't use strict comparison for param fetch all to cope with TYPE one's 2018-09-06 15:30:06 +10:00
Peter Barker 5d317a8ef7 Tools: autotest: clear Rover waypoints before toggling them in 2018-09-06 15:29:28 +10:00
Peter Barker f1a0ebfd10 Tools: autotest: reduce verbosity of wait-for-heading 2018-09-04 10:32:26 +10:00
Peter Barker 5c7e21d38f Tools: autotest: add test for clearing waypoints 2018-09-04 10:32:26 +10:00