Neuromancer

[Work in progress] Real-time 3D visualilzer for convolutional neural networks

Tech Used

I run a neural network in a seperate webworker using ONNX Web Runtime.
Before painting each frame, extract values from the network and render them into 3d with Threlte.

This dual-thread architecture is also reflected in the arrangement of src/ directory:

./src
├── onnx
├── ui
├── bridge.ts
└── main.ts

[!NOTE]
Work in progress- More models and features are on the way 🫡

  git clone https://github.com/rudrowo/neuromancer &&\
  cd neuromancer &&\
  bun install &&\
  bun run dev

WebAssembly is awesome: In 2025 your browser is pretty much a mini virtual machine lol. No need to spin-up a costly server- just run a neural network in your client's browser.
Concurrency is awesome when done right: I learned about co-ordinating between webworkers to offload expensive neural net computations and deliver a responsive user interface. Still nowhere near as good as Go's concurrency though 🥱.
Power of declarative code:
- I used Threlte (awesome library btw!) to write declarative 3d components as if they were regular DOM nodes!.
- It is always more intuitive to define what you want rather than writing the steps to get there 🗿.
Vite deepdive: Vite is a super awesome bundler that comes with a ton of quality of life features for great developer experience. I learned about things such as:
- Importing files as webworkers!.
- Code-splitting with dynamic import- great for reducing initial load times.
- You can even write custom middleware for the vite development server!! I used this feature to ship .wasm files during development.
3D raycasting for interactivity: Did you know 3d graphics emulate mouse interaction by casting a ray and calculating whether it intersects with objects? Well now you do.
Svelte 5 is awesome- chef's kiss:
- Signal-driven reactivity is a godsend!
- Sevelte 5 offers a much better DX than react- where you have to spend half your time just fighting the framework 🤷. No more useFootgun() hooks to ruin my day 💀.