Post

Hi! SkyFeed is struggling and I need to find a solution. If you don't know SkyFeed, it's a service I built 2 years ago, enabling anyone to build and publish feeds using a visual block-based editor. SkyFeed is still hosting the most feeds on Bluesky, but that comes at a cost [1/X]

Let's get straight to the point: Renting servers for hosting all 75k+ SkyFeed feeds for millions of users daily costs me ~1094 EUR/month SkyFeed is 100% free, so the only income is my GitHub Sponsors (github.com/redsolver) with ~191 EUR/month The math does not quite work out here.

Donations mostly covered costs at the end of 2024, but expenses skyrocketed as I scaled everything to keep up with Bluesky growing quickly. While fighting the fires popping up in the infrastructure, I couldn't really focus on releasing new features, fix bugs or implement long-promised improvements

It felt wrong to ask for money before delivering the level of service I expect. But being a solo developer and SkyFeed not my main job made that near-impossible. I also realized that the current architecture struggled to keep up, let alone enable new resource-intensive features I promised long ago.

The first component I started to rewrite was the indexer, but I quickly realized the storage and query layers also needed a ground-up rebuild. This took far longer than expected and was the main reason for not improving the SkyFeed app or adding support for new features like video

The good news: After 4 iterations, the new fully Rust-based architecture is almost ready. The historical backfill is running, and experiments with the new query engine have been very promising. I am confident that the new engine will deliver and am excited about the amazing new feeds it will enable!

1 repost91 likes

ok so the old infra was: indexer(dart) -> SurrealDB -> query-engine (rust) the indexer could not keep up with the firehose, but while re-writing it I noticed that surrealdb could not handle full bsky backfill. So now I also created a custom DB layer, and all components use the same data structures.

However, even the new engine doesn't change the fact that SkyFeed needs revenue. First of all, I am committed to *never* adding ads, because they go against the spirit of algorithmic choice. Also, the entire backend will continue to be fully open-source and all existing features will remain free.

So the only solution that feels fair to me is adding an optional SkyFeed Pro subscription which would support the project and add new resource-intensive features for advanced feed builders, like unlimited history or personalized feeds. I'm still open to suggestions, so please tell me what you think!

i would love to pay for pro, i'm not interested in more frequent caching but a deeper history (doesn't need to be unlimited, maybe a few weeks rather than the current three-ish days) would definitely solve my challenges.

If you want to get real fancy with it, maybe some sort of price per feed that roughly corresponds to the cost of that specific feed, so pro users could pay extra to turn the feed realtime or have a higher cap on number of results or whatever per feed features you come up with

I would pay for pro at least for one important feed for climate science on bsky. Please also add a functionality that will have a first post always on the top that would note the users that it is an Pro feed and would collect more donations for you

For now, the plan would be to launch with just one feature: Currently, feeds are cached for up to 5 minutes, depending on server load. If you pay, all feeds you publish would update in real-time and feeds used by paid users would also update more frequently, keeping their contents fresh for everyone

My current timeline is getting this ready in 1-2 months, alongside the migration of most existing feeds to the new architecture To stay up-to-date you can follow me and the @skyfeed.app account I'm curious what you think, so please feel to reply here with ideas and feedback or drop me a message :)

I think it needs to be a bit more aggressive here. Personally I find blueskyfeedcreators pricing e.g. pretty reasonable, as they restrict the search terms and captures posts per day. I guess that should lower the server load as well.

I currently give you money on GitHub, and would be more than happy to pay you for pro. You provide an excellent service and I greatly appreciate not having to host infrastructure for my feeds.

Did you have a rough idea of what you think you'd want to charge for SkyFeed Pro? Given the value we're getting out of it, we would give it serious consideration.