1-Bit Bonsai Image 4B Image Generation for Local Devices
prismml.com - 93 poäng - 21 kommentarer - 8146 sekunder sedan
Kommentarer (10)
- lumost - 3195 sekunder sedanI actually can’t wait for the future where I upgrade hardware in order to upgrade my ai as an alternative to an expensive subscription.
There are many problems I want to work on which require billions of tokens. These are completely inaccessible without corporate project sponsorship at the moment. An asic generation machine which can pump out a few 10s of thousands of tokens per second at opus4.6 quality is more than sufficient.
- sorenjan - 6155 sekunder sedanThey call it a diffusion model, but it's based on Flux.2 which is a rectified flow model.
- a1o - 2539 sekunder sedanAnyone could pickup the minimal hardware requirements for this? Like both RAM and Storage?
- sudb - 890 sekunder sedanVery interested to see where this kind of work goes for on-device video generation!
- wiradikusuma - 2428 sekunder sedanIs there a benchmark of local image generation models? Local = can run on a 16 GB MacBook or 8 GB+ NVIDIA card.
- potatoman22 - 1314 sekunder sedanI wonder why they didn't use a Bonsai model as the text encoder
- MitPitt - 6105 sekunder sedanLately I've noticed posts with barely 10 points getting to HN frontpage. Was it always like this?
- janniks - 1474 sekunder sedanI was expecting to see images of Bonsai trees when I clicked this
- SilentM68 - 2518 sekunder sedanQuestion,
Is it compatible with Ollama, ComfyUI or are those providers unneeded, compatible with low-end hardware?
Also, where does "./setup.sh/ drop the components in Linux?
Thank you, Sol
- yieldcrv - 5310 sekunder sedanimpressive, combines a couple techniques that I always wanted the frontier models to have
having trouble loading the webgl browser demo on my phone but no biggy
Nördnytt! 🤓