Post

aly
@aly.codes

By 2022 Google Translate had been using transformer models for several years. By 2014 Facebook was using deep convolutional neural nets (DeepFave) for face detection. Literally the things you think were “before LLMs” are either basically indistinguishable from LLMs or their direct predecessors.

This post is unavailable.
aly
@aly.codes

Generalized computer vision is much newer and more generally useful than being able to pattern match facial measurements by dotting eyes and noses.

0 reposts28 likes

aly
@aly.codes

Seriously guys, Google’s Attention Is All You Need paper is almost 10 years old. The life you imagine from a decade ago is just a collection of extremely rudimentary systems of the same or similar form.

aly
@aly.codes

*DeepFace (if the folks at Apple could fix iOS 27 autocorrect before release, perhaps with Better Autocorrect, I would appreciate it)