A 4060ti has been out long enough that you’re fine with basically any main stream distro.

I think even the 50 series is fine now with most mainstream distros as well.

I still prefer arch based distros now for Nvidia cards and honestly, Fedora is great!

It was really simple to do in Proxmox.

You will find no name brand HBAs in IT mode on eBay for half the price of Intel, Supermicro, Dell, Etc branded ones. Do not buy the no names. I spent a week flashing and reflashing some cheap one, cycling through cables, etc. Nothing.

My supermicro branded one worked absolutely no issue. And I think it was like $40

It probably took a total of 30 minutes to pass it through and build the VM and everything. It took a couple days to rebuild my data from my previous truenas server but I had 10 TB of data on 4 drives.

The only issues I’ve had have been my own reading comprehension in setting up truenas accounts.

Are you using truenas as the entire homelab?

I also love messing with stuff until it breaks and I learn something, but I’ve decided I just want my files to be accessible.

So I actually have truenas virtualized with a passed through HBA so I can run proxmox to host all my breakable VMs while leaving truenas alone.

Considering Randy REALLY wants you to pay $130 USD for this game, I’m not shocked his performance advice was “be less poor”

I learned something interesting from my AI researcher friend.

ChatGPT is actually pretty good at giving mundane medical advice.

Like “I’m pretty sure I have the flu, what should I do?” Kinda advice

His group was generating a bunch of these sorta low stakes urgent care/free clinic type questions and in nearly every scenario, ChatGPT 4 gave good advice that surveyed medical professionals agreed they would have given.

There were some issues though.

For instance it responded to

“Help my toddler has the flu. How do I keep it from spreading to the rest of my family?”

And it said

“You should completely isolate the child. Absolutely no contact with him.”

Which you obviously can’t do, but it is technically a correct answer.

Better still, it was also good at knowing its limits and anything that needed more than OTC and bedrest was seemingly recognized and it would suggest going to an urgent care or ER

So they switched to Claude and Deepseek because they wanted to research how to mitigate failures and GPT wasn’t failing often enough.

Dell Optiplex 3050

Lenovo m720

HP whatever with a 7th gen Intel

All can be had for $50 ish

I’m mad you started your citation at 0.

I’m telling Chicago style!

A Microsoft glazing botnet leveraging copilot and all of r/linuxsucks training data to shitpost on Lemmy made by a developer who took a Janatorial job at Microsoft to “get his foot in the door” during an internal hackathon he was accidentally invited to.

From what I understand its not as fast as a consumer Nvdia card but but close.

And you can have much more “Vram” because they do unified memory. I think the max is 75% of total system memory goes to the GPU. So a top spec Mac mini M4 Pro with 48GB of Ram would have 32gb dedicated to GPU/NPU tasks for $2000

Compare that to JUST a 5090 32GB for $2000 MSRP and its pretty compelling.

$200 and its the 64GB model with 2x 4090’s amounts of Vram.

Its certainly better than the AMD AI experience and its the best price for getting into AI stuff so says nerds with more money and experience than me.

From what I understand its not as fast as a consumer Nvdia card but but close.

And you can have much more “Vram” because they do unified memory. I think the max is 75% of total system memory goes to the GPU. So a top spec Mac mini M4 Pro with 48GB of Ram would have 32gb dedicated to GPU/NPU tasks for $2000

Compare that to JUST a 5090 32GB for $2000 MSRP and its pretty compelling.

$200 and its the 64GB model with 2x 4090’s amounts of Vram.

Its certainly better than the AMD AI experience and its the best price for getting into AI stuff so says nerds with more money and experience than me.

Funny domain names for hosting code is why godaddy exists.

I’m excited to submit my future CS assignments with

Ihatecode.com

Honestly if you’re not gaming or playing with new hardware, there is absolutely no point.

I’ve considered swapping this computer over to Fedora for a hot minute, but it really is a gaming PC and I should stop trying to break it.

True, but I have an addiction and that’s buying stuff to cope with all the drawbacks of late stage capitalism.

I am but a consumer who must be given reasons to consume.

The Lenovo Thinkcentre M715q were $400 total after upgrades. I fortunately had 3 32 GB kits of ram from my work’s e-waste bin but if I had to add those it would probably be $550 ish The rack was $120 from 52pi I bought 2 extra 10in shelves for $25 each the Pi cluster rack was also $50 (shit I thought it was $20. Not worth) Patch Panel was $20 There’s a UPS that was $80 And the switch was $80

So in total I spent $800 on this set up

To fully replicate from scratch you would need to spend $160 on raspberry pis and probably $20 on cables

So $1000 theoratically

The PIs were honestly because I had them.

I think I’d rather use them for something else like robotics or a Birdnet pi.

But the pi rack was like $20 and hilarious.

The objectively correct answer for more compute is more mini PCs though. And I’m really thinking about the Mac Mini option for AI.

Ollama and all that runs on it its just the firewall rules and opening it up to my network that’s the issue.

I cannot get ufw, iptables, or anything like that running on it. So I usually just ssh into the PC and do a CLI only interaction. Which is mostly fine.

I want to use OpenWebUI so I can feed it notes and books as context, but I need the API which isn’t open on my network.

I was thinking about that now that I have Mac Minis on the mind. I might even just set a mac mini on top next to the modem.

Ollama + Gemma/Deepseek is a great start. I have only ran AI on my AMD 6600XT and that wasn’t great and everything that I know is that AMD is fine for gaming AI tasks these days and not really LLM or Gen AI tasks.

A RTX 3060 12gb is the easiest and best self hosted option in my opinion. New for >$300 and used even less. However, I was running with a Geforce 1660 ti for a while and thats >$100

A mac is a very funny and objectively correct option

I think I’m going to have a harder time fitting a threadripper in my 10 inch rack than I am getting any GPU in there.