Commit Graph

459 Commits (bcd8f2f3231d37c698a53203ff7a2bc6dfeaf9b8)

Author SHA1 Message Date
Thibault Duplessis fbb42b106c logging/monitoring tweaks 2020-01-01 10:29:47 -05:00
Thibault Duplessis 8d5cc675c7 automated reopening of accounts 2019-12-30 16:28:52 -05:00
Thibault Duplessis 7abe9d597f improve relay sync 2019-12-28 19:19:54 -06:00
Thibault Duplessis c06a6f1a7e improve relay monitoring and give them much more time to sync 2019-12-28 18:34:17 -06:00
Thibault Duplessis 1872b65448 fix mod zone segment monitoring 2019-12-28 18:33:59 -06:00
Thibault Duplessis a521c300fc monitor and log mod zones segments 2019-12-26 13:02:35 -06:00
Thibault Duplessis 210c9855f3 improve monitoring 2019-12-25 11:04:37 -05:00
Thibault Duplessis 302ef57af1 simplify lobby pool monitoring 2019-12-25 09:30:41 -05:00
Thibault Duplessis b368daeff7 remove PeriodicRefreshCache - closes #5817 2019-12-24 18:26:53 -05:00
Thibault Duplessis effe244b0d refactor mongo caches - closes #5813 2019-12-24 17:56:36 -05:00
Thibault Duplessis 032c3bcd32 preemptively find crosstable duplicates - fixes #5810 maybe 2019-12-23 21:23:19 -05:00
Thibault Duplessis bd59727897 tweak eval cache monitoring 2019-12-23 10:48:26 -05:00
Thibault Duplessis 987d5e2bca monitor duplicate crosstables 2019-12-23 01:23:31 -05:00
Thibault Duplessis baf54ba971 remove unused monitoring 2019-12-23 01:10:48 -05:00
Thibault Duplessis 958684faa7 experimental stream, dedup and parallelize crosstable creation 2019-12-22 19:52:13 -05:00
Thibault Duplessis a610196293 improve and monitor the perf stat indexer 2019-12-22 11:39:04 -05:00
Thibault Duplessis f8f6d3578a monitor WorkQueue 2019-12-22 11:20:41 -05:00
Thibault Duplessis 0940a1a76e fix eval cache monitoring 2019-12-22 07:55:46 -05:00
Thibault Duplessis 1d2b4906d3 tournament pairing: fetch players instead of users 2019-12-22 01:49:10 -05:00
Thibault Duplessis 44a04ed0fb even more tournament pairing segment monitoring 2019-12-22 00:55:30 -05:00
Thibault Duplessis ae9a645328 remove superfluous monitoring 2019-12-21 20:31:49 -06:00
Thibault Duplessis eb40df4d39 monitor http image serving 2019-12-21 20:02:32 -06:00
Thibault Duplessis 6513f02a7e monitor user profile segments 2019-12-21 17:26:42 -06:00
Thibault Duplessis cb3cc3fe34 monitor lobby segments 2019-12-21 15:55:45 -06:00
Thibault Duplessis 249e8f5ca5 more tournament pairing creation latency monitoring 2019-12-21 11:24:33 -06:00
Thibault Duplessis b6c9f93692 destroy kamon stub on stop to prevent memory leaks on reload 2019-12-20 10:53:29 -06:00
Thibault Duplessis 3e6c1608a2 monitor comm mod segments latency 2019-12-20 10:50:00 -06:00
Thibault Duplessis 81e63d0428 start kamon with real backend on prod 2019-12-19 23:11:32 -06:00
Thibault Duplessis 79cd805111 work around kamon leak with a stub 2019-12-19 21:07:28 -06:00
Thibault Duplessis 983c8b81fd silence warnings on kamon stub 2019-12-19 10:54:37 -06:00
Thibault Duplessis 8b4ccfdc52 kamon stub 2019-12-18 21:13:29 -06:00
Thibault Duplessis b11e0d30f9 game proxy optimizations 2019-12-17 14:57:10 -06:00
Thibault Duplessis 7263518680 tournament standing max parallelism with queue
to avoid overloading mongodb in crowded tournaments
especially when thousands of players are idling
on their tournament page
2019-12-15 21:04:58 -06:00
Thibault Duplessis 5346f50d4e more tournament monitoring and resilience 2019-12-15 17:51:21 -06:00
Thibault Duplessis 6cfa509806 monitor relation actor 2019-12-15 10:07:13 -06:00
Thibault Duplessis 5808b76f2c improve monitoring 2019-12-14 21:09:55 -06:00
Thibault Duplessis cd65584d02 improve monitoring 2019-12-14 19:45:22 -06:00
Thibault Duplessis a9babeef3c change caffeine monitoring 2019-12-14 11:28:08 -06:00
Thibault Duplessis b9f3d316f0 simplify Syncache and make it threadsafe - closes #5735 2019-12-14 10:36:45 -06:00
Thibault Duplessis e5880aba38 better handle blocking IO and monitor it by name 2019-12-13 22:08:50 -06:00
Thibault Duplessis 089b807c03 explicit reflective calls, upgrade scalalib and scalachess 2019-12-13 12:45:21 -06:00
Thibault Duplessis ff1cc70bef reformat with scalafmt 2019-12-13 08:37:32 -06:00
Thibault Duplessis 22a93fe940 monitor chat fetch 2019-12-12 10:29:31 -06:00
Thibault Duplessis 91041958c7 monitor tournament waiting players 2019-12-11 19:32:30 -06:00
Thibault Duplessis 93253cf262 tweak tournament monitoring 2019-12-11 17:54:55 -06:00
Thibault Duplessis 9de73bab36 tweak monitoring 2019-12-11 13:38:37 -06:00
Thibault Duplessis 4ba2dfba17 better monitor games 2019-12-11 12:18:12 -06:00
Thibault Duplessis 7e9f862a59 merge monitoring tags tpe/api into client 2019-12-11 09:53:27 -06:00
Thibault Duplessis 232c426fae monitoring tweaks 2019-12-10 21:19:06 -06:00
Thibault Duplessis 5a519466fd improve monitoring 2019-12-10 19:28:43 -06:00
Thibault Duplessis 3cf6d739a6 complete monitoring rewrite 2019-12-10 15:01:18 -06:00
Thibault Duplessis 9f2f28331a more monitoring migration 2019-12-09 18:58:09 -06:00
Thibault Duplessis c2f2fd2de4 replace all Duct-based future sequencers with WorkQueue 2019-12-09 17:24:43 -06:00
Thibault Duplessis b37e2d3b2a fix insights indexer stream 2019-12-08 21:10:08 -06:00
Thibault Duplessis d3d73b1a06 all fatal warnings - WIP 2019-12-08 02:02:12 -06:00
Thibault Duplessis 476387f386 improve monitoring 2019-12-08 00:36:14 -06:00
Thibault Duplessis f65b72007b fix kamon keys 2019-12-07 10:48:51 -06:00
Thibault Duplessis 2fcfb935fe migration WIP 2019-12-05 23:35:55 -06:00
Thibault Duplessis 8fe32191e5 configure kamon 2019-12-05 21:01:24 -06:00
Thibault Duplessis e550e2bfea enable warnings 2019-12-04 01:11:24 -06:00
Thibault Duplessis 3d52e6bbf8 migrate round module 2019-12-02 10:41:05 -06:00
Thibault Duplessis b23e862015 migration WIP 2019-11-30 20:29:40 -06:00
Thibault Duplessis c1a47f057d WIP 2019-11-28 18:50:19 -06:00
Thibault Duplessis 8c144fa059 lila3 WIP 2019-11-28 12:20:59 -06:00
Thibault Duplessis 1e3e8db9eb firebase google token: add timeout and monitoring 2019-11-27 19:48:27 -06:00
Thibault Duplessis 428853d65d remove more direct socket stuff
and also limited tournaments and the titled users API
2019-11-25 18:03:11 -06:00
Thibault Duplessis ec0aad51ae full remote sockets WIP 2019-11-25 15:36:39 -06:00
Thibault Duplessis 4e94b55945 move monitoring to lila-ws 2019-11-17 00:04:37 -06:00
Thibault Duplessis 87457aa2aa remove superfluous monitoring 2019-11-12 21:31:44 -06:00
Thibault Duplessis 28968393d2 count actual round ducts 2019-11-12 18:08:45 -06:00
Thibault Duplessis 582188fa61 fix monitoring 2019-11-12 16:10:40 -06:00
Thibault Duplessis 283c3bb648 implement magic link login - closes #5635 2019-11-10 13:19:34 -06:00
Thibault Duplessis 044f5ad628 monitor chat messages 2019-11-10 12:15:22 -06:00
Thibault Duplessis 48df3e92e1 reduce remote socket monitoring 2019-10-22 22:59:16 +02:00
Thibault Duplessis 8384eb7372 delete remaining fishnet move code 2019-10-22 13:05:33 +02:00
Thibault Duplessis dff12fe97d tournament remote socket 2019-10-21 00:32:49 +02:00
Thibault Duplessis 9b484fe56c remove site socket... and the entire site module 2019-09-15 20:32:16 +02:00
Thibault Duplessis 39d8882e23 remove unused monitoring 2019-09-04 21:39:57 +02:00
Thibault Duplessis a69515f4b3 more lobby remote socket 2019-09-04 11:23:04 +02:00
Thibault Duplessis 79cf53d719 Merge branch 'master' into lobbyRemoteSocket
* master: (405 commits)
  remove CSP live setting
  remove service worker live setting
  tweak slack icon
  tweak logging order
  New Crowdin translations (#5468)
  tweak socket handler
  remove team tournament points
  upgrade dependencies
  remove team best members list
  i18n: ...ize -> ...ise
  i18n: tournament 404 tweak (#5473)
  i18n: tweak coordinates (#5473)
  i18n: misc source tweaks (#5473)
  i18n: source is british (#5473)
  i18n: tweak site description (#5473)
  log all signups in slack
  add cli example
  cosmetic
  signup agreement
  fix identification of lichess comments - for #5470
  ...
2019-09-02 19:28:05 +02:00
Thibault Duplessis 81d2d864b8 fishnet http monitoring 2019-08-13 17:40:56 +02:00
Thibault Duplessis 37d41aaf76 better fight disposable email 2019-08-09 16:02:29 +02:00
Thibault Duplessis e46a089982 implement printban 2019-08-09 11:23:31 +02:00
Thibault Duplessis e513ee3836 monitor palantir channels 2019-08-08 17:16:45 +02:00
Thibault Duplessis 3adb6465ec lobby remote socket WIP 2019-07-18 11:11:52 +02:00
Thibault Duplessis 1560e4b3e5 simul remote socket WIP 2019-07-15 11:57:45 +02:00
Thibault Duplessis cfb2e79779 don't rename monitoring key 2019-07-13 20:07:57 +02:00
Thibault Duplessis 12e6292a7e consistent naming for sri 2019-07-13 20:02:50 +02:00
Thibault Duplessis 1dff821fcb expire eval cache upgrade subscribers 2019-07-12 07:05:42 -04:00
Thibault Duplessis 10938e9a5e monitor remote socket paths 2019-07-10 10:03:04 -04:00
Thibault Duplessis 06f0ad994c better monitor redis publish 2019-07-09 23:03:36 -04:00
Thibault Duplessis 2806d29ecc connect to redis with lettuce/epoll 2019-07-09 18:54:00 -04:00
Thibault Duplessis c86889cf71 clean up remote socket for deploy 2019-07-08 23:23:35 -04:00
Thibault Duplessis 5100a087df struggling with redis WIP
need:
- fast
- non-blocking or
  - quick blocking
  - blocking thread pool
- connection pool
- reconnect
- not netty4
2019-07-08 12:47:00 -04:00
Thibault Duplessis b9306ffe6d remote socket monitoring and robustness 2019-07-06 18:55:54 -04:00
Thibault Duplessis 76501bc11a monitor redis pool and messages 2019-07-06 11:57:17 -04:00
Niklas Fiekas 89abc75e71 also remove version check on server 2019-06-29 20:09:56 -04:00
Thibault Duplessis 944d0eb920 Revert "also remove version check on server"
This reverts commit dbef4b657e.

So the client can be reverted without a restart
2019-06-29 20:09:56 -04:00
Niklas Fiekas e72918229b also remove version check on server 2019-06-29 20:09:56 -04:00
Isaac Levy e40447270c Remove newEvent counters
These counters are not needed anymore and are
invoked in a critical performance pathway. They
were added in #5153.
2019-06-24 11:21:54 -04:00
Isaac Levy 866d624c96 Add inc counters for RoundSocket
And remove the double histogram call for getEventsDelta
2019-05-29 16:55:15 -04:00
Isaac Levy bf2f337507 Add histogram for RoundSocket::addEvents
Track this function and event size distribution.
2019-05-29 10:25:33 -04:00
Thibault Duplessis 3bfb7ff50b possibly fix weird disconnections in games
sometimes there can be 2 socket instances, one of which is dead.
Make it instruct its client to resync and connect to the live one.
2019-05-21 18:49:44 +02:00
Thibault Duplessis 0617a76e23 monitor regulator extra points (as micropoints) 2019-04-20 14:14:46 +07:00
Thibault Duplessis 7772ecfb51 monitor rating distribution 2019-04-20 14:06:10 +07:00
Thibault Duplessis 791d140e4c refactor embeds, use no ctx, manual csp nonce 2019-04-15 17:07:12 +07:00
Thibault Duplessis 0e29bac7b1 tweak email monitoring 2019-01-20 13:49:26 +08:00
Thibault Duplessis 69f722b198 better monitor email sent/retried/failed 2019-01-10 11:33:31 +08:00
Thibault Duplessis 89f5c336f6 better validate email domains using dns-api.org 2018-12-29 17:45:25 +08:00
Thibault Duplessis 80865c3026 invert dns check monitoring 2018-12-26 11:00:11 +08:00
Thibault Duplessis 38b18a4d6b monitor DNS checks 2018-12-25 15:12:03 +08:00
Thibault Duplessis 9556222c89 more round version check logging/monitoring 2018-12-19 11:29:08 +08:00
Thibault Duplessis a12abe8cca implement version checks on round socket 2018-12-18 11:48:08 +08:00
Thibault Duplessis 72ab7d41ee fix tournament API hit monitoring 2018-12-17 13:01:29 +08:00
Thibault Duplessis e7d59f2aa9 monitor tournament API partial hits 2018-12-17 08:57:26 +08:00
Thibault Duplessis 3f1c6be196 monitor timeline API 2018-12-16 22:39:09 +08:00
Thibault Duplessis 472674bfea monitor /account/info 2018-12-16 11:16:20 +08:00
Thibault Duplessis c413abf15a monitor round history 2018-12-13 23:26:07 +08:00
Thibault Duplessis 30e109ec2e so apparently that never happens on prod 2018-12-10 11:29:14 +07:00
Thibault Duplessis 59a5a8c10f somehow a failed Syncache loader got stuck
Always provide a default, and monitor the syncache chm
to make sure its values are always cleared up
2018-12-10 10:59:34 +07:00
Thibault Duplessis 1b3c39aa62 fix dark homepage style 2018-12-09 20:20:08 +07:00
Thibault Duplessis 89c1c9f01f rewrite Lobby as LobbyTrouper 2018-12-09 08:59:46 +07:00
Thibault Duplessis 6c74305195 more socket trouper tweaks 2018-12-08 08:54:44 +07:00
Thibault Duplessis 09eafcf67f tweak, broom, and monitor lobby socket trouper 2018-12-08 08:42:39 +07:00
Thibault Duplessis dd87232cce refactor caffeine cache statse monitoring 2018-12-07 10:16:02 +07:00
Thibault Duplessis abe75e94b5 add monitoring and remove old tournament socket code 2018-12-06 15:33:30 +07:00
Thibault Duplessis 6beeb02f7d monitor tournament show API hit 2018-12-03 10:29:39 +07:00
Thibault Duplessis 6fbc8a8674 fix cloud eval upgrade monitoring 2018-11-30 12:06:20 +07:00
Thibault Duplessis 72ae435cdc cloud eval live upgrade monitoring 2018-11-27 18:30:18 +07:00
Thibault Duplessis 044c14c0f4 count open site websockets 2018-11-27 11:11:49 +07:00
Thibault Duplessis 0062be13fc go through Duct Map when checking game expiration
Scheduling within the RoundDuct results in bugs
if no move is played within 40s and the Round duct
is evicted. Then the scheduled callback runs on
the defunct Round which has a stale game cache.
Result: https://lichess.org/forum/lichess-feedback/server-aborts-game-bug
2018-09-15 00:10:35 +02:00
Thibault Duplessis 85e4acd8dd monitor game id collisions 2018-08-25 18:02:16 +02:00
Thibault Duplessis f5e3df8120 stop monitoring round queue
since duct
2018-08-24 15:53:34 +02:00
Thibault Duplessis f541859e2b new irwin API WIP 2018-08-22 13:17:22 +02:00
Isaac Levy d5952be49a Revert "Revert "Merge pull request #4420 from isaacl/stringOpts""
This reverts commit ae1afb645d.
2018-06-28 00:06:25 -04:00
Thibault Duplessis ae1afb645d Revert "Merge pull request #4420 from isaacl/stringOpts"
This reverts commit 8dcddaa104, reversing
changes made to 37e803307f.
2018-06-27 06:36:03 +02:00
Isaac Levy c5f7db1790 Various regex opts
- Prefer unanchored matching over `.*<pattern>.*`
- Prefer possessive matching when possible, which
is faster is nearly every circumstance and universal use
minimizes bad regex behavior
- guard <string>.replace, which is slow in jdk below 9.
  even at jdk 9, indexOf is faster than replace for misses,
  but the performacne isn't much different.
2018-06-25 00:43:16 -04:00
Thibault Duplessis ebb1ee24f2 delete RoundApiBalancer 2018-05-09 21:43:37 +02:00
Thibault Duplessis 3f41ad5a83 monitor fishnet requests separately 2018-05-08 21:26:57 +02:00
Thibault Duplessis 39e20f299a mobile API request 2018-05-08 00:39:26 +02:00
Thibault Duplessis 67db8bdf36 remove deprecated API
use https://lichess.org/api#operation/gamesExportUsername instead
2018-05-08 00:33:15 +02:00
Thibault Duplessis 0dafca559b better stream team members 2018-05-08 00:29:14 +02:00
Thibault Duplessis e60496e000 monitor ws, xhr, bot and page requests 2018-05-07 16:03:26 +02:00
Thibault Duplessis eb39c5420f bot monitoring 2018-04-23 05:25:21 +02:00
Thibault Duplessis d3c53f371c remove superfluous monitoring 2018-04-08 17:38:15 +02:00
Thibault Duplessis a359f334cc monitor loading of clock history 2018-04-05 17:43:18 +02:00
Thibault Duplessis bfba707a6d fetch light games for tournaments 2018-04-05 17:18:40 +02:00
Thibault Duplessis 3569141f04 Revert "monitor API hits"
This reverts commit 7a96231400.
2018-04-04 06:06:50 +02:00
Thibault Duplessis 7a96231400 monitor API hits 2018-04-04 05:39:29 +02:00
Thibault Duplessis 061455e56a monitor oauth usage 2018-04-03 17:08:37 +02:00