1
0
Fork 0
Commit Graph

569 Commits (4c6ea303b2458d21f4a1f676199263ff2f28885d)

Author SHA1 Message Date
Vasilis Tsiligiannis 4c6ea303b2 Utilize Docker cache to speed up building
Signed-off-by: Vasilis Tsiligiannis <acinonyx@openwrt.gr>
2019-02-13 12:32:31 +02:00
Ansgar Schmidt 81549264cf Adding UTC in header, fixing #267
Signed-off-by: Ansgar Schmidt <ansgar.schmidt@gmx.net>
2019-02-12 11:27:25 +01:00
Vasilis Tsiligiannis 58b0cc9bfd Fix invalid quoting in InfluxDB query
Signed-off-by: Vasilis Tsiligiannis <acinonyx@openwrt.gr>
2019-01-24 21:33:44 +02:00
Alfredos-Panagiotis Damkalis b24d292fc8 Add Blank=True for decayed date in satellite model 2019-01-21 15:34:02 +02:00
Pierros Papadeas 6d5e1db09c
Add decayed field in Satellite model 2019-01-19 19:27:48 +02:00
Vasilis Tsiligiannis a6b79bace0 Fix InfluxDB query to drop whole measurements
Signed-off-by: Vasilis Tsiligiannis <acinonyx@openwrt.gr>
2019-01-16 15:04:59 +02:00
Corey Shields a05a614dd9 hack our way around the django cache
Signed-off-by: Corey Shields <cshields@gmail.com>

In django cache we are storing a full queryset of the satellites with their data count and last payload time. By trying to filter on this (sat_cache = sats_cache.filter(norad_cat_id=norad)) we cause django to re-evaluate the queries for that specific satellite. For CAS-4a this results in 2 queries that exceed 5 mins each.

This does not impact the /stats/ page as it iterates through the whole list of satellites in cache. This change mimics that behavior to find the satellite cache we care about in the template.  Its a huge hack but its the only way we can show a count and bring the page view back for !237 quickly...  This needs refactoring, big time..

I also pulled an unused has_telemetry_data which caused a db count

This leaves behind a query to pull the last payload to show who submitted the last payload, as without this query there is no connection between the cached satellite info and the actual observer (because the /stats/ page was not meant to make that connection). If this query continues to be prohibitive we may just need to remove the "last frame submitted by.." blob.
2019-01-12 14:00:59 -05:00
Corey Shields 9ea72f808a stop triggering a cache update on page load 2019-01-11 23:52:49 -05:00
Corey Shields 3adf7a2f35 fix satellite slow queries
In this change we continue using the cache for the frame count, but instead of using the cache for the latest frame as discussed in IRC we grab the latest frame based on the ID.  In my test environment this was a reasonable query time.

I'd rather we try this route before resorting to the cache for latest frame as it will be a better user experience.

Signed-off-by: Corey Shields <cshields@gmail.com>
2019-01-11 21:28:52 -05:00
Vasilis Tsiligiannis 940fc5e923 gitlab-ci: Use separate jobs for triggering 'master' and 'dev' downstream pipelines
Signed-off-by: Vasilis Tsiligiannis <acinonyx@openwrt.gr>
2019-01-12 03:44:07 +02:00
Vasilis Tsiligiannis e27e892fba Replace recursive 'dict' extraction with 'satnogs-decoders' docstring fields
This commit replaces the recursive 'dict' extraction functions with
'get_fields()' method which returns specific fields from Kaitai Struct
docstrings. The InfluxDB schema is also optimized to write multiple
fields per data point with the unique NORAD id used as the measurement
name.

Signed-off-by: Vasilis Tsiligiannis <acinonyx@openwrt.gr>
2019-01-09 20:51:26 +02:00
Vasilis Tsiligiannis 7f16a16ee2 Add telemetry fixtures
Signed-off-by: Vasilis Tsiligiannis <acinonyx@openwrt.gr>
2019-01-09 17:51:26 +02:00
Vasilis Tsiligiannis 5780fb8ebb Update fixtures
Signed-off-by: Vasilis Tsiligiannis <acinonyx@openwrt.gr>
2019-01-09 17:49:43 +02:00
Pierros Papadeas a8f5e53647 Add UI for transmitter UUID 2019-01-07 18:21:39 +00:00
Vasilis Tsiligiannis 63e1eb71b5 Update requirements file
Signed-off-by: Vasilis Tsiligiannis <acinonyx@openwrt.gr>
2019-01-07 19:57:21 +02:00
Vasilis Tsiligiannis fe6edd4f6a gitlab-ci: Do not call 'tox' twice
Signed-off-by: Vasilis Tsiligiannis <acinonyx@openwrt.gr>
2019-01-07 19:51:44 +02:00
Pierros Papadeas 6a1f145c07 Add more fields and filters on satellite admin view 2019-01-07 16:28:33 +00:00
Vasilis Tsiligiannis fa88e3bf51 flake8: Ignore versioneer and all migrations
Signed-off-by: Vasilis Tsiligiannis <acinonyx@openwrt.gr>
2019-01-07 18:14:10 +02:00
Vasilis Tsiligiannis e4cadb93d5 Update documentation to mention refreshing of 'requirements-dev.txt' file
Signed-off-by: Vasilis Tsiligiannis <acinonyx@openwrt.gr>
2019-01-07 18:13:42 +02:00
Vasilis Tsiligiannis 436d4bfd12 flake8: Test 'auth0login' module as well
Signed-off-by: Vasilis Tsiligiannis <acinonyx@openwrt.gr>
2019-01-07 18:02:49 +02:00
Vasilis Tsiligiannis 6cfabf9829 Always use latest stable version of 'satnogsdecoders'
Signed-off-by: Vasilis Tsiligiannis <acinonyx@openwrt.gr>
2019-01-07 17:15:28 +02:00
Vasilis Tsiligiannis 86df51b031 Remove unused import, fix line break before operator
Signed-off-by: Vasilis Tsiligiannis <acinonyx@openwrt.gr>
2019-01-07 17:15:28 +02:00
Vasilis Tsiligiannis f689d86e50 tox: Add dependency checking environment, do not install dependencies
Signed-off-by: Vasilis Tsiligiannis <acinonyx@openwrt.gr>
2019-01-07 16:39:00 +02:00
Vasilis Tsiligiannis 877f983075 Update development requirements, refresh requirement files
Signed-off-by: Vasilis Tsiligiannis <acinonyx@openwrt.gr>
2019-01-07 16:39:00 +02:00
Vasilis Tsiligiannis 6887da3789 gitlab-ci: Run unit tests with 'tox'
Signed-off-by: Vasilis Tsiligiannis <acinonyx@openwrt.gr>
2019-01-07 16:39:00 +02:00
Vasilis Tsiligiannis 95e22aab4d refresh-requirements.sh: Add support for refreshing development requirements
Signed-off-by: Vasilis Tsiligiannis <acinonyx@openwrt.gr>
2019-01-07 16:39:00 +02:00
Vasilis Tsiligiannis 479e3a2267 Move 'pytest' config in 'setup.cfg', add 'pytest' tox environment
Signed-off-by: Vasilis Tsiligiannis <acinonyx@openwrt.gr>
2019-01-07 16:39:00 +02:00
Vasilis Tsiligiannis ef76c1eb5a Add 'dev' extras
Signed-off-by: Vasilis Tsiligiannis <acinonyx@openwrt.gr>
2019-01-07 16:39:00 +02:00
Vasilis Tsiligiannis def0457c61 flake8: Move exclusion of versioneer to 'setup.cfg', ignore W504
Signed-off-by: Vasilis Tsiligiannis <acinonyx@openwrt.gr>
2019-01-07 16:38:59 +02:00
Pierros Papadeas c2efc8cee2
Use case for home page statistics 2019-01-07 14:23:12 +02:00
Corey Shields f8496b5899 use cached payload count in satellite view 2019-01-06 15:40:54 -05:00
Pierros Papadeas afd69f13ac
Remove unused view counts from Satellite view 2019-01-06 10:38:50 +02:00
Vasilis Tsiligiannis f645afcfd0 gitlab-ci: Use 'tox' to run 'flake8'
Signed-off-by: Vasilis Tsiligiannis <acinonyx@openwrt.gr>
2019-01-03 01:21:45 +02:00
Vasilis Tsiligiannis 0ab0749b53 Add 'tox' configuration
Signed-off-by: Vasilis Tsiligiannis <acinonyx@openwrt.gr>
2019-01-03 01:20:37 +02:00
Vasilis Tsiligiannis 0b27cfb3a7 gitlab-ci: Add build stage
Signed-off-by: Vasilis Tsiligiannis <acinonyx@openwrt.gr>
2019-01-03 01:14:56 +02:00
Vasilis Tsiligiannis 6cc933806d Separate static code analysis and unit testing of Javascript/CSS and Python, drop custom linting image
Signed-off-by: Vasilis Tsiligiannis <acinonyx@openwrt.gr>
2019-01-03 01:06:28 +02:00
Vasilis Tsiligiannis 3d0e247c31 Update Redis and MariaDB Docker containers
Signed-off-by: Vasilis Tsiligiannis <acinonyx@openwrt.gr>
2019-01-03 00:11:31 +02:00
Vasilis Tsiligiannis 453c7a77a6 Fix invalid template error due to missing application
Signed-off-by: Vasilis Tsiligiannis <acinonyx@openwrt.gr>
2019-01-03 00:05:20 +02:00
Vasilis Tsiligiannis 2bbb276be9 Install 'redis-py' version which is supported by 'django-redis-cache'
Signed-off-by: Vasilis Tsiligiannis <acinonyx@openwrt.gr>
2019-01-03 00:05:20 +02:00
Vasilis Tsiligiannis 98daf161a6 Remove unused dependencies, refresh requirements file
Signed-off-by: Vasilis Tsiligiannis <acinonyx@openwrt.gr>
2019-01-03 00:05:20 +02:00
Vasilis Tsiligiannis 489d7f9042 Refresh requirements file
Signed-off-by: Vasilis Tsiligiannis <acinonyx@openwrt.gr>
2019-01-03 00:05:20 +02:00
Vasilis Tsiligiannis b0299e39eb Add utility for refreshing requirements file
Signed-off-by: Vasilis Tsiligiannis <acinonyx@openwrt.gr>
2019-01-03 00:05:20 +02:00
Vasilis Tsiligiannis 1fe6579bda Do not leave old versions of packages installed
Signed-off-by: Vasilis Tsiligiannis <acinonyx@openwrt.gr>
2019-01-03 00:05:20 +02:00
Corey Shields ba4cdd7d60 Catch TLE ValueError
Catch and handle ValueError when loading new TLE (in the case of a syntax error in the TLE)

resolves https://gitlab.com/librespacefoundation/satnogs/satnogs-db/issues/257

Signed-off-by: Corey Shields <cshields@gmail.com>

Kudos to kerel for the idea
2019-01-02 11:24:33 -05:00
Fabian P. Schmidt bfef1527de api/views: Use queryset exists syntax instead of exception handling 2019-01-01 22:03:55 +01:00
Alfredos-Panagiotis Damkalis b0308ea8f1 Fix division by zero in trasmitters percentage 2018-12-30 22:24:47 +02:00
Vasilis Tsiligiannis 93baff1e1e Add missing 'sgp4' requirement
Signed-off-by: Vasilis Tsiligiannis <acinonyx@openwrt.gr>
2018-12-30 14:07:28 +02:00
Vasilis Tsiligiannis 0afdb0c19e Move 'sentry-sdk' under logging section in setup configuration
Signed-off-by: Vasilis Tsiligiannis <acinonyx@openwrt.gr>
2018-12-30 14:07:28 +02:00
Corey Shields f0e8de3cc8 Support influxdb ssl connections
Adds a setting, INFLUX_SSL which when set to True will use SSL in the connection to influxdb.

Signed-off-by: Corey Shields <cshields@gmail.com>
2018-12-29 20:03:58 -05:00
Vasilis Tsiligiannis c8b7613c8b Remove deprecated CI staging deployment
Signed-off-by: Vasilis Tsiligiannis <acinonyx@openwrt.gr>
2018-12-27 14:04:45 +02:00