Releases: fiboa/cli
Releases · fiboa/cli
v0.20.2
v0.20.1
v0.20.0
v0.10.0
Added
- Converter for Austrian crop fields
- Converters for Spain: Aragon, Andalusia, Balearic Islands, Basque Country, Catalonia, Cantabria, Castilla y León, Castilla-La Mancha, Canary Islands, Extremadura, Galicia, Madrid, Navarra, Valencia
- Use ruff format + linting for a uniform code style
Changed
- Refactored converters to use a class-based approach
- Start to use
https://fiboa.org/code/prefixed codes for our own code lists - Use only unix line-endings in source files
- Use set instead of list for Converter.extensions
- Converted datasets are hilbert-curve sorted
v0.9.0
Added
- Command
fiboa improvewith helpers to- change the CRS
- change the GeoParquet version and compression
- fill missing perimeter/area values
- fix invalid geometries
- rename columns
- Converter for Lithuania (EuroCrops)
- Converter for Slovenia
- Converter for Slovakia
- Converter for Switzerland
- Converter for Czech
- Converter for US Department of Agriculture Crop Sequence Boundaries
- Converter for California (US) Statewide Crop Mapping
- Converter for Latvia (from original source)
- Converter for Japan, currently based on supplied (non-fiboa) parquet files
fiboa convert: New parameter--original-geometries/-ogto keep the original geometries
Changed
fiboa convert:- Writes custom schemas to collection metadata
- Geometries are made valid using GeoPanda's
make_validmethod by default - MultiPolygons are converted to Polygons by default
fiboa validateuses custom schemas for validationfiboa mergekeeps custom schemas when needed- Extended converter for Croatia; with crop_code and crop_name
- Many converters implement the admin extension
Removed
fiboa convert: Removed the explicit parameterexplode_multipolygonfrom the converter
Fixed
- Fix converter for Estland to use the id
ec_eeinstead ofec_es - Assure tests don't download external sources
v0.8.0
Added
- Merge command:
fiboa merge - Converter for Croatia
- Converter for Germany, Mecklenburg-Western Pomerania
- Converter for Germany, Saarland
- Converter for Germany, Saxony
- Converter for Estonia (EuroCrops)
- Converter for Sweden
- Converter for Luxembourg
- Converter for Ireland
- Converter for Lacuna Labels (A region-wide, multi-year set of crop field boundary labels for Africa)
Changed
fiboa convert: Default compression changed fromzstdtobrotli- The default row group size of exported parquet files was changed from ~1.000.000 to 25.000
Fixed
- Datatype conversion from pandas to pyarrow fixed
v0.7.0
Added
- Converter for Luís Eduardo Magalhães (LEM) and other municipalities in the west of Bahia state, Brazil (
br_ba_lem) - Converter for Denmark (
dk) - Additional converters for EuroCrops datasets:
ec_be_vlg,ec_nl_crop - New parameter
--geoparquet1to generate GeoParquet 1.0 without bbox column instead of GeoParquet 1.1 with bbox column
Changed
- CLI creates GeoParquet 1.1 with bbox column by default
- The function signature in the
convertfunction of the converters has changed to a simpler more future-proof variant. - The EuroCrops converters extend the original converters
Fixed
fiboa convert: Create output folder if it doesn't exist- Strip whitespaces/newlines from created STAC collections
fiboa create-geojson: Don't write FeatureCollections to folder if a filename is given
v0.6.0
Added
- Added a
SHORT_NAMEvariable to the converter template - Added a
FILE_MIGRATIONvariable to the converter template for per-file migrations - Added a
LAYER_FILTERvariable to the converter template for loading specific layers from a file - Added
-iparameter to specify input files for converters fiboa convertersoutput can be customized with options-p,-sand-v.fiboa convertreads JSON file with custom logic, which allows to access nested objects through dot notation- Converter for Slovenia via EuroCrops (
ec_lv) - Converter for Planet's Automated Field Boundary (
planet_afb) - Converter for Portugal (
pt) - Converter for DigiFarm (
digifarm) - Converter for AI4SmallFarms in Cambodia and Vietnam (
ai4sf) - Further tests
Changed
- The
BBOXis optional in the converter template as it will be computed automatically from the data. - The
PROVIDER_NAMEandPROVIDER_URLvariables in the converter template were replaced byPROVIDERS fiboa convertersis more readable by default- Upgraded to geopandas 1.0.0, which migrates from fiona to pyogrio for data loading
- The EuroCrops converters (prefix:
ec_) use the HCAT fiboa extension
Fixed
- Fixed schema issue for the
tk10column inde_bbconverter - jsonschema library doesn't warn against external references any longer
v0.5.0
Added
- Basic support for
patternPropertiesin GeoParquet creation - The converter template accepts multiple input URLs
- Added parameter to explode multipolygons to polygons (
explode_multipolygon, default:False) - Converter for Belgium, Flanders (
be_vlg) - Converter for Belgium, Wallonia (
be_wa) - Converter for Finland (
fi) - Converter for France (
fr) - Converter for The Netherlands (
nlandnl_crops) - Converter for Slovenia via EuroCrops (
ec_si)
Changed
- The
--cacheoption for theconvertcommand asks for a folder instead of a file - The
cache_fileparameter in converters has been renamed tocache(requires changes in the converter templates) - The converter template allows for more detailed source information
- The
URIconstant in the template was renamed toSOURCES(requires changes in the converter templates)
Fixed
- Extensions were not correctly displayed in
describeandvalidatecommand - Fixed regular expressions for email and uuid in data validation
v0.4.0
Added
- Converter for EuroCrops France dataset
fiboa create-geojson: Show conversion progressfiboa jsonschemaandfiboa validate: SupportgeometryTypesforgeometrydata type in GeoJSONfiboa validate:- Basic validation for objects, geometries and bounding boxes in GeoParquet files
Fixed
fiboa validate-schema: The-moption is applied correctly if$schemais present in schemafiboa validateandfiboa validate-schema: Don't stop validation after the first file.fiboa validate:- Is more robust against invalid collections and doesn't abort if not needed
- Check NULL values correctly in case of arrays
- Throw an error if no files were provided
fiboa create-geojson:- Handles GeoParquet bbox correctly
- Converts numpy arrays
- Doesn't export empty collections
- Fix recursive import