Commit Graph

444 Commits

Author SHA1 Message Date
Samuel Tabor
913e5a23fe autotest: Add method to get default params for model. 2020-04-22 10:01:09 +10:00
Samuel Tabor
e30f0a9173 autotest: Move soaring test into plane. 2020-04-19 11:09:16 +10:00
Peter Barker
efb5ad2f1c autotest: correct checking of downloaded file
First time we've tried to round-trip a mission file with comments it it

New frames used by new mission files need stuff to be ignored
2020-04-15 16:24:40 +10:00
Peter Barker
10e8f3f3d7 autotest: canonicalise on defaults_filepath rather than defaults_file
This naming better represents the fact this isn't just a filename.
2020-04-14 15:09:17 +10:00
Samuel Tabor
c4e255fa5f autotest: Fix key error 2020-04-14 15:09:17 +10:00
Peter Barker
691ae58a79 Tools: rename APMrover2 to Rover 2020-04-14 09:50:34 +09:00
Peter Barker
9511fa59ec autotest: permit specification of frame as part of customing cmdline 2020-04-12 20:34:26 +10:00
Peter Barker
e0380fc9be autotest: improve debug information for missing fields 2020-04-12 08:36:48 +10:00
Pierre Kancir
5b26df5780 Tools: put Mission files into right directories 2020-04-09 09:01:03 +10:00
Peter Barker
2d171d0cb4 autotest: add sanity check for duplicate labels in LogWrite calls 2020-04-08 11:17:41 +10:00
Samuel Tabor
a4c5e12fac Tools: Make soaring test a subclass of plane test. 2020-04-08 09:11:54 +10:00
Peter Barker
52bb7760bc autotest: add debug for COMMAND_LONG commands 2020-04-06 10:07:26 +10:00
Peter Barker
53ced35f9d autotest: correct bytes decoding for Python3 in Logger documentation 2020-03-29 14:44:36 +11:00
Peter Barker
b8dba9886f autotest: Python3 fixes for LTM tests 2020-03-29 10:00:08 +11:00
Pierre Kancir
2d65cbd884 Tools: Common : create generic wait_and_maintain function, upgrade all wait functions to use it 2020-03-27 22:13:52 +11:00
Peter Barker
6206cbd1fa autotest: add sanity checking for undocumented/overdocumented logger messages 2020-03-22 18:35:14 +11:00
Peter Barker
e671a0912e autotest: logger_metadata: understand , in @LoggerMessage
This means multiple messages use exactly the same meaning in the fields

Also retain ordering of fields
2020-03-21 09:34:43 +11:00
Peter Barker
28c3ba32ae autotest: add test for AP_Logger documentation generation 2020-03-20 13:05:46 +11:00
Peter Barker
741d3e1435 autotest: make verify_parameter_values more verbose 2020-03-20 13:05:15 +11:00
Peter Barker
403950f61f autotest: add autotests for CPU failsafe 2020-03-20 12:19:21 +11:00
Peter Barker
92d2186b95 autotest: don't use self.mav.motors_disarmed_wait as it blocks forever 2020-03-17 16:31:29 +11:00
Peter Barker
7038d522b8 autotest: run GetCapabilities test on all vehicles 2020-03-03 09:44:39 +11:00
Peter Barker
cb8d623624 autotest: add test for fixed yaw calibration 2020-02-29 16:25:30 +11:00
Peter Barker
82f53abee2 autotest: restore fly.ArduCopter as running all tests
the test list for ArduCopter is made up of those from tests1 and tests2
2020-02-22 16:51:39 +11:00
Pierre Kancir
e1d8148cc0 autotest: Python correctness fixes
Tools: common: correct copy shadowing in set_rc_from_map

Tools: common: comment out unused code

Tools: common: remove iteritem usage for py3

Tools: common: remove duplicate key in FRSkySPort id description for GPS

Tools: rover: correct type shadowing

Tools: rover: make expected_distance_epsilon float

Tools: rover: comment out unused code

Tools: rover: correct variable shadowing on my_message_hook

Tools: copter: correct variable shadowing

Tools: common: use Bool for port.setblocking

Tools: common: fix variable shadowing
2020-02-22 10:37:29 +11:00
Peter Barker
b2d05c9a85 autotest: make download_parameters more robust 2020-02-19 15:09:16 +11:00
Peter Barker
e3e152ae3e autotest: make all-parameter-documentation-working a full autotest 2020-02-19 15:09:16 +11:00
Peter Barker
a86dc33235 autotest: improve debugging of original location discrepancy 2020-02-18 12:29:00 +11:00
Peter Barker
14ad9a58bd autotest: don't blat main test exception with still-armed exception 2020-02-14 16:36:12 +11:00
Peter Barker
fa33719da6 autotest: improve distance-from-home debug 2020-02-14 16:36:12 +11:00
Peter Barker
6843d0e628 autotest: improve debug on parameter download failure 2020-02-13 21:31:20 +11:00
Peter Barker
be7ae6fbc9 autotest: add --validate-parameters autotest option
After each reboot, the complete list of parameters is downloaded and
checked against parameter documentation generated from the source code.
2020-02-13 21:31:20 +11:00
Yaapu
b0e5bfc32d autotest:FRSkySPort: added support for VARIO 0x30 and GPS 0x800 sensor types
This adds support for the VARIO sensor 0x30 and GPS sensor 0x800 to the autotest suite
2020-02-09 20:52:58 +11:00
Peter Barker
fd8088f1e5 autotest: add Copter tests for altitude change on arm 2020-02-08 11:06:03 +11:00
Peter Barker
ac904085d6 autotest: add statistics on time taken to arm 2020-02-08 11:06:03 +11:00
Peter Barker
b0aceaea70 autotest: add tests for LTM telemetry output 2020-02-08 10:38:34 +11:00
Peter Barker
62f289b8e6 autotest: drain_mav_unparsed gets a quiet option 2020-02-08 10:38:34 +11:00
Peter Barker
b75dd36f71 autotest: create Telem baseclass for telem clients 2020-02-08 10:38:34 +11:00
Peter Barker
212bc6538b autotest: improve output on wait_altitude 2020-02-07 15:02:35 +11:00
Peter Barker
441f43103a autotest: add send_debug_trap to send a mavlink trap to the autopilot 2020-01-29 10:27:01 +11:00
Peter Barker
53ce463a90 autotest: add test for statustext coming through via frsky passthrough 2020-01-28 15:16:58 +11:00
Peter Barker
e7ca2057ce autotest: improve output from wait_altitude 2020-01-25 14:26:13 +11:00
Peter Barker
375f642759 autotest: fix race condition in test for AFS on Plane
Only showed up when running under Valgrind, this was a simple race condition.
2020-01-19 09:03:54 +11:00
Peter Barker
91b01a3eb2 autotest: fix integer vs float issues for Python3 2020-01-18 12:52:31 +11:00
Peter Barker
e568f74580 autotest: correct string-vs-float issue in dataflashovermavlink test 2020-01-18 09:09:18 +11:00
Peter Barker
3d0ede499b autotest: disable parameters test on Tracker until reboot works 2020-01-16 21:19:01 +11:00
Peter Barker
f42c42df02 autotest: Python3 fixes for Frsky tests 2020-01-15 22:00:51 +11:00
Peter Barker
9192cb7b41 autotest: add tests for parameter download 2020-01-15 13:54:23 +11:00
Andy Piper
d6248ce57a Tools: correct math in frsky passthrough test 2020-01-15 13:53:52 +11:00
Peter Barker
56fb9f8198 autotest: add test for existence of arming log messages 2020-01-14 11:39:36 +11:00
Peter Barker
ba13f0bb29 autotest: add test for Frsky SPort 2020-01-13 16:03:12 +11:00
Peter Barker
280a44fc73 autotest: make nmea-output test more reliable 2020-01-13 16:01:23 +11:00
Peter Barker
cefd991fb0 autotest: add test for frsky passthrough 2020-01-11 22:43:36 +11:00
Peter Barker
1cfb4e4a49 autotest: test FRSky serial output by taking output via TCP 2020-01-09 12:24:11 +11:00
Peter Barker
a919e8fd45 autotest: adjust NMEAOutput test to take into account NMEA GPS update lag 2020-01-05 10:49:17 +11:00
Peter Barker
e080493a7c autotest: add test for accelerometer pose calibration 2020-01-01 13:06:28 +11:00
Peter Barker
19c02471cf Tools: autotest: add test for NMEA output 2019-12-23 11:19:59 +11:00
Andy Piper
39e948a40a Tools: add motor vibration test and support for post-test fft
perform FFT analysis on vibration output
2019-12-17 10:07:06 +11:00
Peter Barker
516219533d autotest: prompt MAVProxy to do streamrate stuff after restarting SITL 2019-12-11 19:49:20 +11:00
Peter Barker
91c6a8c1d8 autotest: fix set_streamrate with rate of -1 2019-12-11 19:49:20 +11:00
Peter Barker
5b45931728 autotest: test buttons on Plane and Copter as well as Rover 2019-12-10 09:29:52 +09:00
Andrew Tridgell
d7018a2ba0 Tools: switch to https URL for firmware 2019-12-08 07:44:14 +11:00
Peter Barker
96b9c8f59a autotest: wait a long time for RC to restart after restarting SITL binary
May help fix the "no RC" failures we're seeing in CI
2019-12-05 22:41:30 +11:00
Peter Barker
5e4162b997 autotest: unload MAVProxy module log after use 2019-12-04 16:08:15 +11:00
Peter Barker
fecca9a559 autotest: add tests for serial RangeFinder drivers 2019-12-03 09:07:09 +11:00
Peter Barker
ece59f8233 autotest: replace wait_seconds with delay_sim_time
These did exactly the same thing
2019-11-08 19:49:46 +11:00
Mark Whitehorn
6b9c997a97 Tools: rename SensorConfigErrorLoop test to ConfigErrorLoop 2019-11-08 10:14:34 +11:00
Peter Barker
7dda87fd44 autotest: assert ArduPilot announces compass cal capability 2019-11-05 11:26:23 +11:00
Peter Barker
7842d07b12 autotest: add test for scripting 2019-10-24 13:50:51 +11:00
Peter Barker
8785ff7a14 autotest: make polyfence avoidance test more reliable
Amusingly, at faster speedups the car made a decision to turn North
rather than South which it does when at lower speedups.

Gave it no choice in the matter.
2019-10-15 23:14:31 +11:00
Peter Barker
d2cf0939a5 autotest: drain mav before attempting disarm
If the queue of messages for us to parse is very long then we can time
out before managing to parse them all and find the disarm!
2019-10-15 15:26:10 +09:00
Peter Barker
03c68f991c autotest: raise exception if no simulated time available
Sucking the mavlink message queue dry unexpectedly is worse than any
tests being broken and failing with a clear error.
2019-10-15 15:26:10 +09:00
Peter Barker
6e88982b39 autotest: fix mission-load dedupe issue
There are other ways we can receive Flight Plan received now, and
MAVProxy's statustext dedupe stuff was biting us
2019-10-15 14:03:28 +11:00
Andrew Tridgell
3f9999d932 autotest: fixed MISSION_ITEM_INT receive to be reliable
use a condition in recv_match() to ensure we don't mix up msgs from
other protocols
2019-10-09 19:56:51 +11:00
Peter Barker
23983d03b5 Tools: autotest: correct get_distance_int 2019-10-05 06:53:52 +10:00
Peter Barker
be8632668b autotest: make dataflash-over-mavlink test more accomodating
Saw <100kB/s on autotest server, so can't look for minimum 100kB/s.

Also fixed disarmed-at-end-of-test
2019-10-04 10:38:32 +10:00
Peter Barker
c5f52a8355 Tools: autotest: tests for new fence code
Tools: autotest: move clear_mission up, use it before running each test

Also have it understand MAV_MISSION_TYPE_ALL

Tools: autotest: add tests for polyfence

Tools: autotest: add tests for multiple inclusion polyfences

Tools: autotest: ensure we can't arm inside a circle exclusion zone

Tools: autotest: add test for arming outside an inclusion zone

Tools: autotest: add tests for upload timeout

Tools: autotest: add tests for not arming due to polygon zones

Tools: autotest: add test for fence point reboot survivability

Tools: autotest: add test for moving fence point

Tools: autotest: add some tests via MAVProxy

Tools: autotest: add test for avoiding polygonal exclusion zones

Tools: autotest: add test for object avoidance

Currently disabled as it doesn't pass where it seemingly should.

Tools: autotest: skip MAVProxy tests on older MAVProxy versions

Tools: autotest: adjust fence loading for lack of string back from MAVProxy

Tools: autotest: create a do_RTL function

Tools: autotest: cope with loading QGC-style fence files

Tools: autotest: add test for object-avoidance in guided mode

Tools: autotest: add OA test for auto mode

Tools: autotest: add test for bendy ruler in guided mode

Tools: autotest: adjust for new MAVProxy fence module not emitting old strings

Tools: autotest: add tests for prearming due to bad parameter values
2019-09-28 07:58:48 +09:00
Peter Barker
2e2bbf57bf Tools: autotest: add disarm_wait function 2019-09-26 15:19:10 +10:00
Andy Piper
5f34ec6578 Tools: support lldb debugging for sim_vehicle and autotest 2019-09-26 09:02:11 +10:00
Peter Barker
b97b41a6e8 Tools: autotest: allow tracker to be armed between tests 2019-09-25 14:57:02 +10:00
Peter Barker
4c40640238 Tools: autotest: tidy handling of armed-at-end-of-test handling 2019-09-25 14:57:02 +10:00
Peter Barker
f27b8a6c02 Tools: autotest: test for vehicle armed after test passes
postcondition of any test is that it leaves the vehicle disarmed
2019-09-24 20:00:07 +10:00
Peter Barker
642935fd43 Tools: random Python cleanups based on lgtm analysis 2019-09-21 22:26:03 +10:00
Peter Barker
f3eaf9ee6e Tools: autotest: more coverage out of the dataflash-over-mavlink tests 2019-09-19 08:46:55 +10:00
Peter Barker
1f25b6e406 Tools: autotest: add test for SITL implementation of Block backend 2019-09-18 17:42:18 +10:00
Ebin
38c9763d48 Autotest: GPS disable test skipped when AHRS_EKF_TYPE is 10 2019-09-18 07:07:08 +10:00
Peter Barker
bba019abc2 Tools: autotest: add basic tests for AP_AdvancedFailsafe 2019-09-17 09:13:43 +10:00
Peter Barker
36ba3a6e4c Tools: autotest: add test for follow mode 2019-09-16 12:00:11 +10:00
Peter Barker
4a35e8ee74 Tools: autotest: skip MIS_TOTAL parameter test on Tracker
This is CMD_TOTAL not MIS_TOTAL, and doesn't have facility for flags.
2019-09-14 09:26:11 +10:00
Peter Barker
da2e00dd6f Tools: autotest: fix race conditions in arm_vehicle and disarm_vehicle 2019-09-09 11:06:07 +10:00
Peter Barker
ba3f95ad20 Tools: autotest: add timeout parameter to detect_and_handle_reboot 2019-09-07 17:19:22 +10:00
Peter Barker
108f37c67c Tools: autotest: ensure we can set parameters in groups with internal flag set 2019-08-30 06:57:30 +10:00
Peter Barker
cce85cb418 Tools: autotest: add test for inability to set MIS_TOTAL 2019-08-22 09:23:56 +10:00
Peter Barker
a8a5ccf51b Tools: autotest: test that long fs triggers even if short fs disabled 2019-08-15 12:07:30 +10:00
Peter Barker
b61bfd663f Tools: autotest: wait for EKF to be happy after returning its GPS 2019-08-12 13:12:11 +10:00
Peter Barker
bf0a947317 Tools: autotest: improve test diagnostics 2019-08-08 08:35:52 +10:00
Peter Barker
4b331419e3 Tools: autotest: improve mission download diagnostics 2019-08-07 14:15:47 +10:00
Peter Barker
9aa5cedd2a Tools: autotest: increase timeout on mission_item_int
We may spend so much time parsing messages this deadline passes
2019-08-07 12:29:14 +10:00
Peter Barker
05a48928f8 Tools: autotest: assume Tracker has AP_Stats 2019-08-07 07:57:46 +09:00
Peter Barker
f896af6800 Tools: autotest: increase timeout waiting for MISSION_COUNT 2019-08-06 18:15:26 +10:00
Peter Barker
acf6cb8d75 Tools: autotest: rename clear_mission to clear_mission_using_mavproxy 2019-08-06 17:05:57 +10:00
Peter Barker
12b9928a56 Tools: autotest: break out a load_fence function 2019-08-05 16:37:08 +10:00
Peter Barker
1fbd41e6f3 Tools: autotest: add test for Rover SmartRTL 2019-07-23 19:00:38 +10:00
Pierre Kancir
666e7b88d7 Tools: common: dynamicly load and unload log module as needed 2019-07-16 18:58:54 +10:00
Pierre Kancir
b655197c95 Tools: common: unload dataflash_logger module after use 2019-07-16 18:58:54 +10:00
Pierre Kancir
98d897e790 Tools: common: implement do_set_relay and do_set_relay_mavproxy 2019-07-16 18:58:54 +10:00
Peter Barker
bd50f288a1 Tools: autotest: get mavproxy to heartbeat at speedup rate
This should resolve a race condition we have with guided position modes.

MAVProxy's heartbeat rate defaults to 1Hz.

When GCS failsafe is active on Copter because we're in GUIDED (or
GUIDED_NOGPS mode) we require a heartbeat every 5 seconds.  At speedup
8, we can only expect a heartbeat every 8 seconds of sim time.

We also only check for this heartbeat every 3 seconds - leading to this
awesome race condition.
2019-07-12 12:48:05 +10:00
Peter Barker
87e43d6e44 Tools: autotest: add option to disable breakpoints at sim startup 2019-07-12 12:48:05 +10:00
Pierre Kancir
12cb09a3f4 Tools: factorize sitl rangefinder setup 2019-07-11 11:52:44 +10:00
Pierre Kancir
daaf769055 Tools: add arm/disarm testing on all modes 2019-07-11 11:42:45 +10:00
Pierre Kancir
9850d1afec Tools: update with flake8
W605 invalid escape sequence '\s'
F402 import 'time' from line 10 shadowed by loop variable
E101 indentation contains mixed spaces and tabs
E703 statement ends with a semicolon
2019-07-09 12:46:39 +10:00
Peter Barker
899db3d3ac Tools: autotest: add test for sensor config error loop
Tools: autotest: exempt failing vehicles from SensorConfigError test
2019-07-09 10:01:23 +10:00
Peter Barker
6332d2e729 Tools: autotest: fix race condition with getting parameters 2019-07-08 16:51:25 +10:00
SergeyBokhantsev
c9447776b2 Tools: autotest: correct debounce tests under Rover
Channel 8 is the mode channel under Rover
2019-07-04 11:35:05 +10:00
Peter Barker
98cb68157f Tools: autotest: add a test for Copter surface tracking 2019-06-21 13:50:55 +10:00
Peter Barker
5992cc8782 Tools: autotest: clear mission between tests 2019-06-20 11:51:13 +10:00
Peter Barker
d8278335a1 Tools: autotest: move upload_using_mission_protocol up to common.py 2019-06-07 16:29:37 +10:00
Peter Barker
c8a4af76fe Tools: autotest: add tests for Plane fence 2019-06-07 16:29:37 +10:00
Peter Barker
6047ef105e Tools: autotest: correct text MAVProxy-dedupe check in mission load
This failed to protect against multiple rapid calls to load_mission
2019-06-06 10:33:28 +10:00
Peter Barker
e9552ec4e1 Tools: autotest: more efficient set_rc_from_map 2019-06-02 10:02:24 +10:00
Peter Barker
3ed55ea3c5 Tools: autotest: add drain_mav_unparsed and use it 2019-05-28 20:41:56 +10:00
Peter Barker
8d90b09829 Tools: autotest: add tests for upload/download rally using mission protocol
Tools: autotest: add tests for mission clearing

Tools: autotest: add tests for out-of-range mission counts

Tools: autotest: add test for Plane DO_CHANGE_SPEED
2019-05-22 08:53:45 +10:00
Francisco Ferreira
4f153f06b3
Tools: autotest: increase timeout for arming param check 2019-05-15 22:44:22 +01:00
Francisco Ferreira
e95d603a73
Tools: autotest: parse all heartbeats when looking for mode change 2019-05-15 22:44:22 +01:00
Peter Barker
d76894d883 Tools: autotest: drain mav before getting message rates, improve debug 2019-05-09 19:53:53 +10:00
Peter Barker
a2105e1f81 Tools: autotest: correct statustext sending under Python3 2019-05-02 13:15:37 +10:00
Peter Barker
18391d8a9a Tools: autotest: produce stacktraces under Python3 2019-05-02 13:15:37 +10:00
Peter Barker
4a237af093 Tools: autotest: ensure reboot if dataflash-over-mavlink test fails
Will stop cascading failures from occuring
2019-04-30 19:19:58 +10:00
Peter Barker
0cd5d66e3a Tools: autotest: increase epsilon
our round-trips etc cost precision
2019-04-23 10:06:17 +10:00
Peter Barker
2cb69366c8 Tools: autotest: facilitate changing mode by number 2019-04-19 07:51:49 +09:00
Peter Barker
5e69758661 Tools: autotest: factor out a start_mavproxy method 2019-04-16 21:10:22 +10:00
Peter Barker
b2acd15a55 Tools: autotest: encode string to bytes before passing to statustext_send 2019-04-15 18:40:01 +10:00
Peter Barker
b7eca63073 Tools: autotest: send statustext with test name to autopilot
This gets logged into the dataflash so you can quickly find relevant
logs
2019-04-14 07:56:39 +10:00
Peter Barker
696de42eea Tools: autotest: check we're seeing PL messages in the log during
precland
2019-04-04 11:54:58 +11:00
Peter Barker
4eaee039f0 Tools: autotest: avoid touch RC*_OPTION on sub 2019-03-30 12:01:49 +11:00
Peter Barker
6f52fa5622 Tools: autotest: do not set ARMING_RUDDER on sub and tracker 2019-03-29 19:07:18 +11:00
Peter Barker
ffccd6f263 Tools: autotest: stop using mav.location() for Tracker test
Turns out that since we don't stream vfr_hud mav.location won't ever
work
2019-03-29 07:40:45 +11:00
Peter Barker
9a16b40a73 Tools: autotest: rename get_rudder_channel to get_stick_arming_channel
... as some of these aren't actually rudder inputs...
2019-03-27 11:29:53 +11:00
Peter Barker
265d8d62cd Tools: autotest: add timeout to wait_ekf_flags waiting for EKF_STATUS_REPORT 2019-03-26 20:55:32 +11:00
Peter Barker
6fe7db2f43 Tools: autotest: add test for REQUEST_MESSAGE 2019-03-26 16:20:50 +11:00
Peter Barker
c6b8335392 Tools: autotest: improve debug for lack of mode map 2019-03-25 16:57:41 +11:00
Peter Barker
16476332b2 Tools: autotest: fix no-gps switch-to-location test 2019-03-22 08:19:42 +11:00
Peter Barker
1e2cf4bb60 Tools: autotest: fix sethome test under Python3 2019-03-22 08:19:11 +11:00
Peter Barker
935840ebb0 Tools: autotest: add test for setting home to current location 2019-03-19 19:56:13 +11:00
Peter Barker
6bf600c587 Tools: autotest: cope with being unable to reboot while armed 2019-03-19 10:53:37 +11:00
Peter Barker
873096f791 Tools: autotest: add test for Rover offboard-in-auto function 2019-03-15 14:51:35 +09:00
Peter Barker
9ca2c9d692 Tools: autotest: python3 fixes
Tools: autotest: use inbuilt zip on Python3
2019-03-13 20:26:24 +11:00
Peter Barker
841c222a12 Tools: autotest: add check that GPS is good before arming 2019-03-13 17:13:10 +11:00
Peter Barker
0aeb6c0e26 Tools: autotest: ensure initial home position is similar to sitl start pos 2019-03-13 13:20:29 +11:00
Peter Barker
d53f787a14 Tools: factor init up into parent class
Tools: autotest: use speedup 8 for all suites

for reliability
2019-03-13 08:20:20 +11:00