this is cool thanks for making it!

cool! what stack are you using for the multiplayer?

can't we just freaking share things?

ai models are a crystallization of human effort (available for free on huggingface)..

why not use it?

AI is like the UBI of intelligence, stop leaving free money on the table by refusing to use it locally ( you can run it on a laptop CPU)

this is really cool congrats!

good, the point is that now you have free mental bandwidth to use on building something that truly interests you using AI to help actualize your goal. build something cool for your kiddos idk?

at this point I trust software companies less and less..

being able to build the stack and create bespoke solutions with llms's is incredible..

idk why people get mad about vibe-coding. if ur little brother can make a Spotify clone with Claude in a day, shouldn't that mean that you as a dev should be able to create something 100x better that makes Spotify obsolete?

good ideas / feasible novel architecture design will be the only thing valuable..

I run the latest 20b-30b models on a MacBook Air... running inference with an MoE (25 tps) for like 2 hours is like 10% battery.. (look me up on huggingface to download my models)

also you gotta realize frontier models have massive "system prompts" that clog up the context window with garbage.

being able to write your own system prompts gives you a MASSIVE edge..

ai is exciting because it shows us what really matters...

can you add in the other quants like IQ3_M?

also my personal simple rule of thumb for local ai sizing is:

max model size (GB) = ram (GB) / 1.65

pretty cool! needs the search function to work tho to be useful

It kinda stays true to the Windows File Explorer as its search was always mostly useless