[P] Visualizing LM's Architecture and data flow with Q subspace projection
![[P] Visualizing LM's Architecture and data flow with Q subspace projection](/_next/image?url=https%3A%2F%2Fpreview.redd.it%2F7x4m36sy7mqg1.png%3Fwidth%3D140%26height%3D133%26auto%3Dwebp%26s%3Dbf27ffc3dbeba2a9f1cf3fd170806470d9001ba1&w=3840&q=75)
![[P] Visualizing LM's Architecture and data flow with Q subspace projection](https://preview.redd.it/7x4m36sy7mqg1.png?width=140&height=133&auto=webp&s=bf27ffc3dbeba2a9f1cf3fd170806470d9001ba1 "[P] Visualizing LM's Architecture and data flow with Q subspace projection") | Hey guys, I did something hella entertaining. With some black magic and vodoo I was able to extract pretty cool images that are like an MRI from the model. I'm not stating anything, I have some hypothesis about it... It is mostly because it is just so pretty and mind bogging. I stumbled up a way to visualize LM's structure of structure structures in a 3D volume. Here is the Gist Link with a speed run of the idea. Some images: y3i12/Prisma (my research model) At the present moment I'm looking for a place where I can upload the interactive HTML. If you know of something, let me know that I'll link them. It is very much a lot mesmerizing to keep looking at them at different angles. The mediator surface that comes out of this is also pretty interesting: I wonder if this one of many possible interpretations of "loss landscape". [link] [comments] |
Want to read more?
Check out the full article on the original site