deepcrayon
/
gbif-cruft
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Activity

TODO notes

main
Jeff Moe 2023-10-07 13:35:08 -06:00
parent bc590a65bf
commit d492d4ef46
1 changed files with 6 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

8
README.md
View File

@ -69,10 +69,14 @@ black gbif-cruft*
# TODO
Perhaps:
* rclone GBIF snapshot, approximately 250 gigs of parquet files.
* Read parquet files with local tools.
* rclone GBIF snapshot, approximately 210 gigs of parquet files.
* Read parquet files with local tools. Perhaps pyarrow, pqv, dask,
* Parquet with GraphQL? graphique.
* Perhaps import parquet files into sota db.
* Test on ppc64le.
* Type hinted Python dataclass for GBIF API.
* Mypyc or similar.
* sota media storage.
# Upstream