Do we have a spot to discuss AI or should we?

[Grimlakin]

I've been tinkering with running my own local AI and have succeeded but looking for a place to have discussions on it.... and why I now want 64 gb of ram. lol

 

[Grimlakin]

The ai engine I'm running on a Linux vm via docker is a memory and cpu hog. I'm debating going to 64 gig of ram to run the larger vm. And it makes me strongly consider a 16 core for my next cpu as opposed to 12 core.

 

[David_Schroth]

General Computer?

We have so many.. wastelands of forum sections that don't see much traffic. Still debating cutting it down to... 3-4....

 

[Grimlakin]

Yea ok that makes sense.

 

[Peter_Brosdahl]

The ai engine I'm running on a Linux vm via docker is a memory and cpu hog. I'm debating going to 64 gig of ram to run the larger vm. And it makes me strongly consider a 16 core for my next cpu as opposed to 12 core.

I can barely wrap my head around the costs but sounds like you might want to go all-in with a Gen5 build and 128 GB.

 

[Grimlakin]

I can barely wrap my head around the costs but sounds like you might want to go all-in with a Gen5 build and 128 GB.

Honestly if I'm goong to go in that deep I'll petition work to buy me an hedt setup with 256 gig or better and a business class gpu that does ai acceleration. We finally released a policy and are looking at blocking things like chat gpt internally to stop idiot devs from feeding it up protected code in the form of questions.