Commit Graph

274 Commits (spacecruft)

Author SHA1 Message Date
Chris Lewicki b7056d9329 Implements parallel processing of satobs, where multiple-threads are available
About 2x faster on a 2-core system, and 3-4x faster on an 8-core system
A balance between regular user feedback and maximum usage of CPUs results
in less-than-fastest possible performance.

For fastest performance, increase chunk size to a value larger than cpu_count.
(Perhaps make this a parameter?)

process.py
 - Implements a multiprocess worker pool of size os.cpu_count()
 - Batches processes in size os.cpu_count()
 - Creates pixel_catalog file using source FITS filename, instead of "test.cat"  - Forces single-threaded astropy IERS table update, if needed
 - Receives all file and screen output from children, so that it can be output
   in the order of the files processed
 - Changes display order of FITS file being processed (first) followed by
   SATIDs within
 - Adds temporary notice of empty input queue
 - Adds description of screen color codes

astrometry.py
 - Adds fall-back method of shutil.copyfile if PermissionError from copy2

extract.py
 - Removes terminal output, and instead returns results to calling processes
 - Tightens up file/io loops

satellite.py
 - Saves hough3dlines output to unique tmp file instead of /tmp/hough.dat
 - Removes temp file after processing
 - Adds FIXME note to review for unnecessary code

stars.py
 - Generates star catalog directly to destination file
 - Updates sextractor call to reference destination instead of tmp file
2019-12-12 14:54:46 -08:00
Cees Bassa f0578de10c
Merge pull request #55 from kerel-fs/pr/update_tle_status_messages
update_tle: Add status messages on stdout
2019-12-07 14:27:29 +01:00
Fabian P. Schmidt 0652202775 update_tle: Add status messages on stdout
This helps to understand the "long" (~ several seconds) pauses during
execution caused by HTTP requests.
2019-12-04 17:06:00 +01:00
Cees Bassa 29e844340b
Update configuration.ini-dist 2019-11-30 19:58:09 +01:00
Cees Bassa 31018e8fcb Select on angular velocity (minimum and maximum). Fixes #50 2019-11-30 16:50:20 +01:00
Cees Bassa 6eae028f5c Fix bug for nan in rms calculation 2019-11-13 17:37:07 +01:00
Cees Bassa 55a9ec9bde
Merge pull request #49 from cbassa/sidereal_tracking
Propagate sidereal tracking through FITS files
2019-11-10 13:25:22 +01:00
Cees Bassa b48b02b8ee Propagate sidereal tracking through FITS files 2019-11-10 13:24:37 +01:00
Cees Bassa 4ef6db28c9 Rename observer elevation to height 2019-11-10 12:52:00 +01:00
Cees Bassa e64d3e71e5
Merge pull request #47 from interplanetarychris/feature/tracking_mount
Feature/tracking mount
2019-11-10 12:48:24 +01:00
Cees Bassa 18d5759ef4
Merge branch 'master' into feature/tracking_mount 2019-11-10 12:48:16 +01:00
Cees Bassa 58f41d2599
Merge pull request #46 from interplanetarychris/fix/copyfile
Fix/copyfile in extract.py
2019-11-10 12:47:04 +01:00
Cees Bassa 0977b71d6a
Merge pull request #45 from interplanetarychris/config/no-sex
Implements option to use only astrometry.net
2019-11-10 12:46:32 +01:00
Cees Bassa 648c54b0a1 Update processing description 2019-11-10 12:42:55 +01:00
Cees Bassa 2f0c091eeb
Merge pull request #44 from interplanetarychris/master
Add missing houghrmin and nhoughmin parms to configuration.ini
2019-11-10 12:40:20 +01:00
Cees Bassa 5402524bc1
Merge branch 'master' into master 2019-11-10 12:40:09 +01:00
Cees Bassa 01067b81a1
Merge pull request #48 from cbassa/slow_cpu_bug_fixes
Fix operation if not in testing mode
2019-11-10 12:36:15 +01:00
Cees Bassa 965438089b Fix operation if not in testing mode 2019-11-10 12:33:42 +01:00
Cees Bassa 89471ac54c
Merge pull request #43 from interplanetarychris/fix/slow_cpu
Fix/slow cpu + error handling
2019-11-10 12:27:52 +01:00
interplanetarychris 2cf9682be5 Cfg option to use tracking mount 2019-11-09 23:16:50 -08:00
interplanetarychris b5cba659e4 Fallback to copyfile if copy2 has permission errs 2019-11-09 22:43:06 -08:00
interplanetarychris f71e889a6b Implements option to use only astrometry.net 2019-11-09 22:18:34 -08:00
interplanetarychris 8b641a9e93
Update requirements.txt 2019-11-09 20:51:09 -08:00
interplanetarychris b611d4bbf1 Add missing houghrmin and nhoughmin cfg parms 2019-11-09 20:38:15 -08:00
interplanetarychris 62a3f7b0d0 Implement queue to accomodate slow CPUs
Also:
* Introduces more error handling and caught exceptions
* Allow user to specify a test duration with -t <duration>
* Provide information when multiple ZWOASI cameras are present
* Document image variables in compress()
2019-11-09 20:17:40 -08:00
interplanetarychris e6dd22d0f0 Comment regarding ppgplot compilation 2019-11-08 11:10:17 -08:00
interplanetarychris 0e21bc4336
Update requirements.txt
git+https://github.com/haavee/ppgplot.git@master
Has problems finding arrayobject.h, but works with a manual build
2019-11-07 20:31:28 -08:00
Cees Bassa 09bde99af3
Merge pull request #41 from ckuethe/config_update
Add new parameters to the sample configuration after 54b3baf
2019-09-21 21:04:07 +02:00
Chris Kuethe 0e34c4e361 Add new parameters to the sample configuration after 54b3baf 2019-09-21 11:51:57 -07:00
Cees Bassa 995f7d5f09 Finetuned parameters 2019-09-21 14:49:19 +02:00
Cees Bassa 54b3baf681 Move processing parameters to config file (fixes #32) 2019-09-21 14:26:50 +02:00
Cees Bassa f2bda3ab25 Updated config 2019-09-21 11:41:23 +02:00
Cees Bassa 2ae0cb47e1 Move hardware binning to config file (fixes #29 and #30) 2019-09-21 11:40:27 +02:00
Cees Bassa 0964f9aa15
Merge pull request #39 from ckuethe/whitespace
whitespace cleanup
2019-09-21 11:30:45 +02:00
Cees Bassa 6035634552
Merge pull request #38 from ckuethe/zwo_sdk
specify the ZWO SDK in the config file
2019-09-21 11:30:33 +02:00
Cees Bassa 26c8cc4be1
Merge pull request #37 from ckuethe/use_python3
use python3 for consistency, and because python2 is deprecated
2019-09-21 11:30:13 +02:00
Chris Kuethe f7325b14b5 whitespace cleanup 2019-09-20 10:25:41 -07:00
Chris Kuethe db6a3c3bf9 specify the ZWO SDK in the config file
It was not obvious that I had to use an environment variable
2019-09-20 10:16:51 -07:00
Chris Kuethe 1e19d54e69 use python3 for consitency, and because python2 is deprecated 2019-09-20 10:10:55 -07:00
Cees Bassa a6344f628a Minor changes 2019-08-11 18:55:05 +02:00
Cees Bassa 326e822f17
Merge pull request #35 from ppapadeas/tyc2
Tyc2
2019-08-11 18:35:08 +02:00
Pierros Papadeas 1c467d2f7b Move cal files too
Signed-off-by: Pierros Papadeas <pierros@papadeas.gr>
2019-08-09 20:33:47 +03:00
Pierros Papadeas a313c5c08a Flake8 fixes
Signed-off-by: Pierros Papadeas <pierros@papadeas.gr>
2019-08-09 20:04:33 +03:00
Pierros Papadeas 66398416a6 Add tyc2.fits catalogue
Signed-off-by: Pierros Papadeas <pierros@papadeas.gr>
2019-08-09 20:03:12 +03:00
Cees Bassa d8a1896f40
Merge pull request #34 from cbassa/acquire_overhaul
Allow changing of output path during realtime operations
2019-08-07 14:57:15 +02:00
Cees Bassa 849d5bff58 Allow changing of output path during realtime operations 2019-08-07 14:56:38 +02:00
Cees Bassa 3df9e6d53e
Merge pull request #33 from ppapadeas/documentation-fixes-3
Fixed configuration and README
2019-08-07 13:15:21 +02:00
Pierros Papadeas d753ce4695 Fixed configuration and README
Signed-off-by: Pierros Papadeas <pierros@papadeas.gr>
2019-08-03 17:37:29 +03:00
Cees Bassa 569b840dc0 Store calibration file and reinstate test for astrometry 2019-08-02 22:15:24 +02:00
Cees Bassa cbfa0c5ee3 Merge branch 'master' of https://github.com/cbassa/stvid 2019-08-02 21:53:58 +02:00