ardupilot/libraries/AP_Filesystem
Peter Barker 6fd8eea917 AP_Filesystem: correct run-length encoding in param download
If a parameter's name was a prefix of the previous name we would
suffer an integer-wrap problem and incorrectly encode the parameter name
2022-06-17 14:07:00 +10:00
..
examples/File_IO AP_Filesystem: add simple File I/O example 2020-09-24 13:00:08 +10:00
AP_Filesystem.cpp AP_Filesystem: tweak fgets() 2022-02-01 17:35:26 +11:00
AP_Filesystem.h AP_Filesystem: avoid ff.h in header 2022-02-22 12:13:19 +11:00
AP_Filesystem_Available.h AP_Filesystem: Split the available define to it's own header 2019-11-02 22:52:06 +11:00
AP_Filesystem_ESP32.cpp AP_Filesystem: add ESP32 support 2021-11-01 17:40:31 +11:00
AP_Filesystem_ESP32.h AP_Filesystem: add ESP32 support 2021-11-01 17:40:31 +11:00
AP_Filesystem_FATFS.cpp AP_Filesystem: avoid ff.h in header 2022-02-22 12:13:19 +11:00
AP_Filesystem_FATFS.h AP_Filesystem: avoid ff.h in header 2022-02-22 12:13:19 +11:00
AP_Filesystem_Mission.cpp AP_Filesystem: add support for AP_Logger into AP_Periph 2021-06-08 09:57:55 +10:00
AP_Filesystem_Mission.h AP_Filesystem: review fixes 2021-04-21 07:12:55 +10:00
AP_Filesystem_Param.cpp AP_Filesystem: correct run-length encoding in param download 2022-06-17 14:07:00 +10:00
AP_Filesystem_Param.h AP_Filesystem: allow for parameter upload via ftp 2021-04-21 07:12:55 +10:00
AP_Filesystem_ROMFS.cpp AP_Filesystem: added load_file() API 2020-11-18 09:11:36 +11:00
AP_Filesystem_ROMFS.h AP_Filesystem: added load_file() API 2020-11-18 09:11:36 +11:00
AP_Filesystem_Sys.cpp AP_Filesystem: add support for @SYS/timers.txt. 2022-02-16 15:28:04 +11:00
AP_Filesystem_Sys.h AP_Filesystem: use ExpandingString class 2021-01-05 10:52:00 +11:00
AP_Filesystem_backend.cpp AP_Filesystem: removed the 3s grace period for file ops when armed 2021-06-15 16:42:02 +10:00
AP_Filesystem_backend.h AP_Filesystem: support formatting of SDcard on ChibiOS 2021-12-28 16:04:57 +11:00
AP_Filesystem_posix.cpp AP_Filesystem: disallow file operations from main thread while armed 2021-06-09 15:08:28 +10:00
AP_Filesystem_posix.h AP_Filesystem: fixed SITL build 2020-04-29 07:36:55 +10:00
README.md AP_Filesystem: document extra restrictions in param.pck 2020-04-30 21:15:28 +10:00
posix_compat.cpp AP_Filesystem: correct file open flags for append 2021-08-11 18:43:53 +10:00
posix_compat.h AP_Filesystem: fix build on macOS 2021-04-21 11:33:52 +10:00

README.md

AP_Filesystem: The ArduPilot virtual filesystem layer

AP_Filesystem is a filesystem abstraction for ArduPilot that gives ArduPilot access to both local filesystems on the flight controller and a set of virtual filesystem abstractions.

This document is primarily intended to document the VFS interfaces available to ground station authors via the MAVLink FTP transport.

ArduPilot implements the FILE_TRANSFER_PROTOCOL MAVLink message to allow for remote file operations. This protocol allows a GCS to transfer files to and from a flight controller. It also allows the GCS to access some special purpose VFS interfaces for efficient access to flight controller data using a file API.

The VFS interfaces that don't represent local filesystem objects on the flight controller are prefixed with an '@' symbol. Currently there are two interfaces, the @PARAM interface and the @SYS interface.

FTP Protocol Extension

To facilitate more efficient file transfer over commonly used SiK radios I have added an extension to the ftp burst protocol where the 'size' field in the burst read request sets the block size of the burst replies. This helps as SiK radios do badly with very large packets. I have found that the best results with SiK radios is achieved with a burst read size of 110. If the size field is set to zero then the default of the max size (239) is used.

The @PARAM VFS

The @PARAM VFS allows a GCS to very efficiently download full or partial parameter list from the flight controller. Currently the @PARAM filesystem offers only a single file, called @PARAM/param.pck, which is a packed representation of the full parameter list. Downloading the full parameter list via this interface is a lot faster than using the traditional mavlink parameter messages.

The @PARAM/param.pck file has a special restriction that all reads from the file on a single file handle must be of the same size. This allows the server to ensure that filling in of lost transfers cannot cause a parameter value to be split across a network block, which prevents corruption. Attempts to vary the read size after the first read will return a failed read.

The file format of the @PARAM/param.pck file is as follows

File header

There is a 6 byte header, consisting of 3 uint16_t values

  uint16_t magic # 0x671b
  uint16_t num_params
  uint16_t total_params

The magic value is used to give the version of the packing format. It should have a value of 0x671b. The num_params is how many parameters will be sent (may be less than total if client requests a subset, see query strings below). The total_params is the total number of parameters the flight controller has.

The header is little-endian.

Parameter Block

After the header comes a series of variable length parameter blocks, one per parameter. The format is:

    uint8_t type:4;         // AP_Param type NONE=0, INT8=1, INT16=2, INT32=3, FLOAT=4
    uint8_t flags:4;        // for future use
    uint8_t common_len:4;   // number of name bytes in common with previous entry, 0..15
    uint8_t name_len:4;     // non-common length of param name -1 (0..15)
    uint8_t name[name_len]; // name
    uint8_t data[];         // value, length given by variable type

There may be any number of leading zero pad bytes before the start of the parameter block. The pad bytes are added to ensure that a parameter value does not cross a MAVLink FTP block boundary. This padding prevents a re-fetch of a missing block from potentially leading to a corrupt value.

The packing format avoids sending common leading characters of parameter names from the previous parameter. It does this by sending a common_len field which says how many characters should be copied from the previous parameter. This is always zero in the first block in the file.

The name_len field is the number of non-common characters, minus one.

Query Strings

The file name @PARAM/param.pck can optionally be extended with query string elements to change the result. For example:

  • @PARAM/param.pck?start=50&count=10

that means to download 10 parameters starting with parameter number 50.

Parameter Client Examples

The script Tools/scripts/param_unpack.py can be used to unpack a param.pck file. Additionally the MAVProxy mavproxy_param.py module implements parameter download via ftp.

The @SYS VFS

The @SYS VFS gives access to flight controller internals. For now the only file that is accessible is @SYS/threads.txt which gives information on the remaining stack space for all threads. This file is only accessible for ChibiOS builds.