Post

Hi! SkyFeed is struggling and I need to find a solution. If you don't know SkyFeed, it's a service I built 2 years ago, enabling anyone to build and publish feeds using a visual block-based editor. SkyFeed is still hosting the most feeds on Bluesky, but that comes at a cost [1/X]

236 reposts489 likes

If possible, maybe you could start a Ko-fi account as a tip jar and accept one-off donations that way? I know that myself and others use Ko-fi for this purpose, and I (along with many others) would gladly help you out in a small way to help SkyFeed keep going!

I'm currently writing a comprehensive guide on how to use SkyFeed for a general non-coding audience, and the first thing I looked for on your profile was a way to support your development financially. I think having a Ko-fi link on your main profile would be a highly visible way to do that!

Did you find a solution? If not we should commune, as I do theme change analytics and am implementing a BSky radar. Naturally therefore a big SkyFeed fan, and eager to see it prosper!

Let's get straight to the point: Renting servers for hosting all 75k+ SkyFeed feeds for millions of users daily costs me ~1094 EUR/month SkyFeed is 100% free, so the only income is my GitHub Sponsors (github.com/redsolver) with ~191 EUR/month The math does not quite work out here.

The most expensive part is compute, I have a lot of dedicated Hetzner servers for running the queries. Storage is also pretty expensive, but that's part of the dedicated servers (nvmes), so not really an extra cost. Bandwidth is 2 TB per month max, I'm only serving compressed JSON (a lot of it)

The easiest way to get that cost down would be to explore cheaper dedicated server providers advertising on webhostingtalk, but that would realistically be at most a 30% savings. Assuming you’re at 80%+ utilization.

Donations mostly covered costs at the end of 2024, but expenses skyrocketed as I scaled everything to keep up with Bluesky growing quickly. While fighting the fires popping up in the infrastructure, I couldn't really focus on releasing new features, fix bugs or implement long-promised improvements

It felt wrong to ask for money before delivering the level of service I expect. But being a solo developer and SkyFeed not my main job made that near-impossible. I also realized that the current architecture struggled to keep up, let alone enable new resource-intensive features I promised long ago.

The first component I started to rewrite was the indexer, but I quickly realized the storage and query layers also needed a ground-up rebuild. This took far longer than expected and was the main reason for not improving the SkyFeed app or adding support for new features like video

The most effective optimization is really the new architecture, because the old one was built in the early days of Bluesky and never designed for massive scale. So while tuning individual feeds and optimizing some knobs did help and reduce resource usage, they were mostly band-aids.

The new one is pretty different, so optimal deployment strategies and hosting are still something I need to test under production load.

feeds are the main way I read this website, so I'd be interested in a pro subscription, and personalized feeds would add a lot of value hopefully jetstream helps reduce some of the costs once the new architecture is ready

Mine is still offline.Tell me something. When I post and people comment...I can't go back to the original statement I made. How can I see what they are commenting about unless I can see the statement I posted? Is there a trick or something that brings me back to the original post? It's frustrating