MTEB@mteb.orgThe best embedding score available at the end of 2023 needed a 304M-parameter model. Today the same score comes from an 11M one — 28x fewer active parameters.5/8/26, 9:43 am·2 reposts·15 likes
regularfry.bsky.social@regularfry.bsky.social5 AugThe ~100M beating 2024's ~10B is no slouch either, if I'm reading the chart right1
%20--%3E%3Cmetadata%20xmlns%3Ardf%3D%22http%3A%2F%2Fwww.w3.org%2F1999%2F02%2F22-rdf-syntax-ns%23%22%20xmlns%3Axsi%3D%22http%3A%2F%2Fwww.w3.org%2F2001%2FXMLSchema-instance%22%20xmlns%3Adc%3D%22http%3A%2F%2Fpurl.org%2Fdc%2Felements%2F1.1%2F%22%20xmlns%3Adcterms%3D%22http%3A%2F%2Fpurl.org%2Fdc%2Fterms%2F%22%3E%3Crdf%3ARDF%3E%3Crdf%3ADescription%3E%3Cdc%3Atitle%3EShadows%3C%2Fdc%3Atitle%3E%3Cdc%3Acreator%3EDiceBear%3C%2Fdc%3Acreator%3E%3Cdc%3Asource%20xsi%3Atype%3D%22dcterms%3AURI%22%3Ehttps%3A%2F%2Fwww.dicebear.com%3C%2Fdc%3Asource%3E%3Cdcterms%3Alicense%20xsi%3Atype%3D%22dcterms%3AURI%22%3Ehttps%3A%2F%2Fcreativecommons.org%2Fpublicdomain%2Fzero%2F1.0%2F%3C%2Fdcterms%3Alicense%3E%3Cdc%3Arights%3E%E2%80%9CShadows%E2%80%9D%20(https%3A%2F%2Fwww.dicebear.com)%20by%20%E2%80%9CDiceBear%E2%80%9D%2C%20licensed%20under%20%E2%80%9CCC0%201.0%E2%80%9D%20(https%3A%2F%2Fcreativecommons.org%2Fpublicdomain%2Fzero%2F1.0%2F)%3C%2Fdc%3Arights%3E%3C%2Frdf%3ADescription%3E%3C%2Frdf%3ARDF%3E%3C%2Fmetadata%3E%3Cdefs%3E%3Cg%20id%3D%22shoulders-wide-843c077d%22%3E%3Cpath%20d%3D%22M0%2050C0%2017%2017.55%203%2039%203s39%2014%2039%2047Z%22%20fill%3D%22%23345945%22%2F%3E%3C%2Fg%3E%3Cg%20id%3D%22tops-curls-843c077d%22%3E%3Cg%3E%3Ccircle%20cx%3D%2210.52%22%20cy%3D%2225.5%22%20r%3D%227%22%20fill%3D%22%23345945%22%2F%3E%3Ccircle%20cx%3D%2218.5%22%20cy%3D%2216.95%22%20r%3D%227.5%22%20fill%3D%22%23345945%22%2F%3E%3Ccircle%20cx%3D%2228.95%22%20cy%3D%2215.05%22%20r%3D%227.5%22%20fill%3D%22%23345945%22%2F%3E%3Ccircle%20cx%3D%2239.4%22%20cy%3D%2217.9%22%20r%3D%227.5%22%20fill%3D%22%23345945%22%2F%3E%3Ccircle%20cx%3D%2246.05%22%20cy%3D%2226.45%22%20r%3D%227%22%20fill%3D%22%23345945%22%2F%3E%3C%2Fg%3E%3C%2Fg%3E%3Cg%20id%3D%22heads-taper-843c077d%22%3E%3Cuse%20transform%3D%22translate(3%203)%20rotate(-3%2C%2028%2C%2025)%22%20href%3D%22%23tops-curls-843c077d%22%2F%3E%3Cpath%20d%3D%22M31%2019c12%200%2019%207%2019%2016%200%2012-9%2022-19%2022S12%2047%2012%2035c0-9%207-16%2019-16%22%20fill%3D%22%23345945%22%2F%3E%3C%2Fg%3E%3CclipPath%20id%3D%22clip-843c077d%22%3E%3Crect%20width%3D%22100%22%20height%3D%22100%22%20rx%3D%220%22%20ry%3D%220%22%2F%3E%3C%2FclipPath%3E%3C%2Fdefs%3E%3Cg%20clip-path%3D%22url(%23clip-843c077d)%22%3E%3Crect%20width%3D%22100%22%20height%3D%22100%22%20fill%3D%22%23deedc2%22%2F%3E%3Cuse%20transform%3D%22translate(11%2051)%22%20href%3D%22%23shoulders-wide-843c077d%22%2F%3E%3Cuse%20transform%3D%22translate(19%201)%22%20href%3D%22%23heads-taper-843c077d%22%2F%3E%3C%2Fg%3E%3C%2Fsvg%3E)
%20--%3E%3Cmetadata%20xmlns%3Ardf%3D%22http%3A%2F%2Fwww.w3.org%2F1999%2F02%2F22-rdf-syntax-ns%23%22%20xmlns%3Axsi%3D%22http%3A%2F%2Fwww.w3.org%2F2001%2FXMLSchema-instance%22%20xmlns%3Adc%3D%22http%3A%2F%2Fpurl.org%2Fdc%2Felements%2F1.1%2F%22%20xmlns%3Adcterms%3D%22http%3A%2F%2Fpurl.org%2Fdc%2Fterms%2F%22%3E%3Crdf%3ARDF%3E%3Crdf%3ADescription%3E%3Cdc%3Atitle%3EShadows%3C%2Fdc%3Atitle%3E%3Cdc%3Acreator%3EDiceBear%3C%2Fdc%3Acreator%3E%3Cdc%3Asource%20xsi%3Atype%3D%22dcterms%3AURI%22%3Ehttps%3A%2F%2Fwww.dicebear.com%3C%2Fdc%3Asource%3E%3Cdcterms%3Alicense%20xsi%3Atype%3D%22dcterms%3AURI%22%3Ehttps%3A%2F%2Fcreativecommons.org%2Fpublicdomain%2Fzero%2F1.0%2F%3C%2Fdcterms%3Alicense%3E%3Cdc%3Arights%3E%E2%80%9CShadows%E2%80%9D%20(https%3A%2F%2Fwww.dicebear.com)%20by%20%E2%80%9CDiceBear%E2%80%9D%2C%20licensed%20under%20%E2%80%9CCC0%201.0%E2%80%9D%20(https%3A%2F%2Fcreativecommons.org%2Fpublicdomain%2Fzero%2F1.0%2F)%3C%2Fdc%3Arights%3E%3C%2Frdf%3ADescription%3E%3C%2Frdf%3ARDF%3E%3C%2Fmetadata%3E%3Cdefs%3E%3Cg%20id%3D%22shoulders-square-5c8ab4bc%22%3E%3Cpath%20d%3D%22M4%2050V17C4%209%2010%203%2018%203h42c8%200%2014%206%2014%2014v33Z%22%20fill%3D%22%235e3b87%22%2F%3E%3C%2Fg%3E%3Cg%20id%3D%22heads-taper-5c8ab4bc%22%3E%3Cpath%20d%3D%22M31%2019c12%200%2019%207%2019%2016%200%2012-9%2022-19%2022S12%2047%2012%2035c0-9%207-16%2019-16%22%20fill%3D%22%235e3b87%22%2F%3E%3C%2Fg%3E%3CclipPath%20id%3D%22clip-5c8ab4bc%22%3E%3Crect%20width%3D%22100%22%20height%3D%22100%22%20rx%3D%220%22%20ry%3D%220%22%2F%3E%3C%2FclipPath%3E%3C%2Fdefs%3E%3Cg%20clip-path%3D%22url(%23clip-5c8ab4bc)%22%3E%3Crect%20width%3D%22100%22%20height%3D%22100%22%20fill%3D%22%23d6eddf%22%2F%3E%3Cuse%20transform%3D%22translate(11%2051)%22%20href%3D%22%23shoulders-square-5c8ab4bc%22%2F%3E%3Cuse%20transform%3D%22translate(19%201)%22%20href%3D%22%23heads-taper-5c8ab4bc%22%2F%3E%3C%2Fg%3E%3C%2Fsvg%3E)
%20--%3E%3Cmetadata%20xmlns%3Ardf%3D%22http%3A%2F%2Fwww.w3.org%2F1999%2F02%2F22-rdf-syntax-ns%23%22%20xmlns%3Axsi%3D%22http%3A%2F%2Fwww.w3.org%2F2001%2FXMLSchema-instance%22%20xmlns%3Adc%3D%22http%3A%2F%2Fpurl.org%2Fdc%2Felements%2F1.1%2F%22%20xmlns%3Adcterms%3D%22http%3A%2F%2Fpurl.org%2Fdc%2Fterms%2F%22%3E%3Crdf%3ARDF%3E%3Crdf%3ADescription%3E%3Cdc%3Atitle%3EShadows%3C%2Fdc%3Atitle%3E%3Cdc%3Acreator%3EDiceBear%3C%2Fdc%3Acreator%3E%3Cdc%3Asource%20xsi%3Atype%3D%22dcterms%3AURI%22%3Ehttps%3A%2F%2Fwww.dicebear.com%3C%2Fdc%3Asource%3E%3Cdcterms%3Alicense%20xsi%3Atype%3D%22dcterms%3AURI%22%3Ehttps%3A%2F%2Fcreativecommons.org%2Fpublicdomain%2Fzero%2F1.0%2F%3C%2Fdcterms%3Alicense%3E%3Cdc%3Arights%3E%E2%80%9CShadows%E2%80%9D%20(https%3A%2F%2Fwww.dicebear.com)%20by%20%E2%80%9CDiceBear%E2%80%9D%2C%20licensed%20under%20%E2%80%9CCC0%201.0%E2%80%9D%20(https%3A%2F%2Fcreativecommons.org%2Fpublicdomain%2Fzero%2F1.0%2F)%3C%2Fdc%3Arights%3E%3C%2Frdf%3ADescription%3E%3C%2Frdf%3ARDF%3E%3C%2Fmetadata%3E%3Cdefs%3E%3Cg%20id%3D%22shoulders-wide-273344f8%22%3E%3Cpath%20d%3D%22M0%2050C0%2017%2017.55%203%2039%203s39%2014%2039%2047Z%22%20fill%3D%22%23335565%22%2F%3E%3C%2Fg%3E%3Cg%20id%3D%22heads-wide-273344f8%22%3E%3Cellipse%20cx%3D%2231%22%20cy%3D%2238%22%20rx%3D%2221%22%20ry%3D%2218%22%20fill%3D%22%23335565%22%2F%3E%3C%2Fg%3E%3CclipPath%20id%3D%22clip-273344f8%22%3E%3Crect%20width%3D%22100%22%20height%3D%22100%22%20rx%3D%220%22%20ry%3D%220%22%2F%3E%3C%2FclipPath%3E%3C%2Fdefs%3E%3Cg%20clip-path%3D%22url(%23clip-273344f8)%22%3E%3Crect%20width%3D%22100%22%20height%3D%22100%22%20fill%3D%22%23dfe8ed%22%2F%3E%3Cuse%20transform%3D%22translate(11%2051)%22%20href%3D%22%23shoulders-wide-273344f8%22%2F%3E%3Cuse%20transform%3D%22translate(19%201)%22%20href%3D%22%23heads-wide-273344f8%22%2F%3E%3C%2Fg%3E%3C%2Fsvg%3E)