@pcbwayofficial.bsky.social is a great service. that fact that i can click around in @kicad.org, just press a button and have this turn up in the mail is just magic.
Mat Kelcey
awesome talk! some great discussion on what it means to do research with an LLM www.youtube.com/watch?v=svl_...
Mat Kelcey reposted
running a cycle accurate fpga emulation of the amiga paula audio chip in eurorack. ( with some extensions for sampling and different modulation ) #eurorack #tiliqua www.youtube.com/watch?v=SPUj... www.matpalm.com/blog/paula_t...
Mat Kelcey reposted
At Imagine Innovators, we just announced our Developer Plan, offering expanded access to Edge Impulse’s powerful tools, completely free! Get GPU training, longer runtimes, more projects, and production-ready licensing, all at zero cost. Details: www.edgeimpulse.com/blog/introdu...
Mat Kelcey reposted
It's about time I updated my recommended #FPGA links. Send me a suggestion this #FPGAFriday. 😊 projectf.io/recommended-...
Mat Kelcey reposted
Mat Kelcey reposted
Great interview with @jascha.sohldickstein.com about diffusion models! This is the first in a series: similar interviews with Yang Song and yours truly will follow soon. (One of these is not like the others -- both of them basically invented the field, and I occasionally write a blog post 🥲)
Mat Kelcey reposted
keep coming back to "Scalable MatMul-free Language Modeling" arxiv.org/abs/2406.02528 full of fun ideas! am slowly mapping my FPGA audio rate cached casual dilated convolutions network to operate using their mat mul free GLU version of self attention. slowly getting there!
ooffff! the "DeepSeek-V3 Technical Report" is info dense! arxiv.org/abs/2412.19437
still my fav "at doom's gate" cover! ( i'm probably 1K of those 2M views ) www.youtube.com/watch?v=TZG1...
this looks like it's going to be a good read! www.amazon.com/AI-Robotics-...
first logic gate waveshaper results tonight! this is network represented purely by combinational logic ( see arxiv.org/abs/2210.08277 ) i.e. just look up tables; no mults or adds. trained in jax ( 3 nested levels of vmap! ) & inference in amaranth. inference speed should be ~10s nanoseconds.
( the next generation of this matpalm.com/blog/wavenet... intending to run on matpalm.com/blog/wavenet... )
this board looks really fun! "a small, low cost board with the Raspberry Pi Pico processor (RP2040) and a Lattice Semiconductor iCE40UP5K FPGA" pico-ice.tinyvision.ai
"Newton Losses: Using Curvature Information for Learning with Differentiable Algorithms". interesting approach using 2nd order info to avoid the exploding/vanishing gradients that come from non differentiable relaxations.. www.youtube.com/watch?v=7aFP...
this is super cool!! i'll definitely be porting my fpga wavenet ( matpalm.com/blog/wavenet... ) in the new year
Excited to share our #NeurIPS 2024 Oral, Convolutional Differentiable Logic Gate Networks, leading to a range of inference efficiency records, including inference in only 4 nanoseconds 🏎️. We reduce model sizes by factors of 29x-61x over the SOTA. Paper: arxiv.org/abs/2411.04732
still the best tech speech ever. "whatever path you're on, i advocate for long, hard work." so, so true. knowledge & skills do not just pop into our heads, we have to push and shove and jam it in ourselves. www.youtube.com/watch?v=YOZn...
Mat Kelcey reposted
Today STMicroelectronics @ST_World announced the incredible new STM32N6, a powerhouse microcontroller with built-in neural processing that achieves 600x performance over current high-end STM32 MCUs — and offers native Edge Impulse support. Press release: www.businesswire.com/news/home/20...
love the arpeggiator on the oxi one, so playable and fun! #improv #eurorack #techno www.youtube.com/watch?v=mbpF...
my 2025 goal is to play a hardware only improv techno set in a full club have played a few times in smaller settings around friends but hearing one of my tracks recently on a proper club PA has really inspired me! dithernet.bandcamp.com/album/chapte...
i love seeing people ( myself included ) rediscover old things. the recent flood of interest in AI which, for a lot of people, is 100% LLMs, is the best case i've seen of it! it really helps me solidify my only internal concepts to see someone else explain a decades old idea through new terminology.
sadly none of it "just works" with a keras3 jax model ( exported as stateless_function ) #sigh no doubt i've just "simply" got my `jax_module.methods[constants.DEFAULT_METHOD_KEY]` wrong or some other magic arg combo, but not sure i can be bothered today...
(this week) jax to tflite is done with orbax ( nightly build only) ai.google.dev/edge/litert/... ( and that's orbax-export, not orbax-checkpoint, since it's been split ) not sure what'll be next week, we'll see! #canYouKeepUp