Post

redsolver
@redsolver.dev

90% of SkyFeed feed requests are now served in 24 milliseconds or less, with only about 1% of requests taking 4 seconds or more. And after adding protection against recursive "feed bombs" today (feeds using themselves as an input), over 99.9% of requests now return with a HTTP 200 OK status code!

9 reposts99 likes

redsolver
@redsolver.dev

Hi, this was likely caused by this bug and should be fixed now:

redsolver@redsolver.dev

My shiny new database server ran out of file descriptors because I only set higher limits for users when setting it up, but the DB runs as a systemd service (which has different limits). As a result, some SkyFeed feeds were stuck on old state for up to 6 hours. Sorry about that, should be fixed now!

Steve Haroz
@steveharoz.com

One of mine is pretty complex with more than 10 blocks, and it still only take about 2 seconds. What are people doing that takes more than 4 seconds? Having a regex block for each keyword?

redsolver
@redsolver.dev

Usually a combination of maximum input (7 days), ridiculously complex regular expressions and inefficient block order (like sorting before filtering or doing the "inverted" RegEx pass before the normal one, effectively needing to process all posts twice). The worst one atm is ~22 seconds :D