wut-ia Internet Archive download stub

master
Jeff Moe 2022-06-10 19:41:20 -06:00
parent 4d175ce254
commit 1517670e7c
3 changed files with 24 additions and 0 deletions

View File

@ -87,6 +87,7 @@ The following scripts are in the repo.
* `wut-dl-sort-txmode-all` --- Populate `data/` dir with waterfalls from `download/` using all encodings.
* `wut-files` --- Tells you about what files you have in `downloads/` and `data/`.
* `wut-files-data` --- Tells you about what files you have in `data/`.
* `wut-ia` --- Download SatNOGS data from the Internet Archive at `archive.org`.
* `wut-img-ck.py` --- Validate image files are not corrupt with PIL.
* `wut-ml` --- Main machine learning Python script using Tensorflow and Keras.
* `wut-ml-auto` --- Machine learning Python script using Tensorflow and Keras, auto.
@ -234,6 +235,20 @@ Files in the `preprocess/` directory have been preprocessed to be used
further in the pipeline. This contains `.wav` files that have been
decoded from `.ogg` files.
## Internet Archive Downloads
The Internet Archive has a mirror of data from the SatNOGS network.
It is better to download from there to save on Libre Space Foundation
resources.
* https://archive.org/details/satnogs
To download, perhaps do something like the following.
Get an account at archive.org, then run this to set up your account locally:
```
ia configure
```
# Caveats
This is the first artificial intelligence script I've done,

View File

@ -1,4 +1,5 @@
black[jupyter]
internetarchive
ipywidgets
jupyterlab
matplotlib

8
wut-ia 100755
View File

@ -0,0 +1,8 @@
#!/usr/bin/env python3
#
# wut-ia --- Download SatNOGS data from the Internet Archive at archive.org.
#
# https://archive.org/details/satnogs
import internetarchive