That’s cool! I’m really interested to know how many tokens per second you can get with a really good U.2. My gut is that it won’t actually be better than the 24VRAM+96RAM cache setup this user already tested with though.
That’s cool! I’m really interested to know how many tokens per second you can get with a really good U.2. My gut is that it won’t actually be better than the 24VRAM+96RAM cache setup this user already tested with though.
How much do you need? Show your maths. I looked it up online for my post, and the website said 1747GB, which is completely in-line with other models.
Can you link that post?
Running R1 locally isn’t realistic. But you can rent a server and run it privately on someone else’s computer. It costs about 10 per hour to run. You can run it on CPU for a little less. You need about 2TB of RAM.
If you want to run it at home, even quantized in 4 bit, you need 20 4090s. And since you can only have 4 per computer for normal desktop mainboards, that’s 5 whole extra computers too, and you need to figure out networking between them. A more realistic setup is probably running it on CPU, with some layers offloaded to 4 GPUs. In that case you’ll need 4 4090s and 512GB of system RAM. Absolutely not cheap or what most people have, but technically still within the top top top end of what you might have on your home computer. And remember this is still the dumb 4 bit configuration.
Edit: I double-checked and 512GB of RAM is unrealistic. In fact anything higher than 192 is unrealistic. (High-end) AM5 mainboards support up to 256GB, but 64GB RAM sticks are much more expensive than 48GB ones. Most people will probably opt for 48GB or lower sticks. You need a Threadripper to be able to use 512GB. Very unlikely for your home computer, but maybe it makes sense with something else you do professionally. In which case you might also have 8 RAM slots. And such a person might then think it’s reasonable to spend 3000 Euro on RAM. If you spent 15K Euro on your home computer, you might be able to run a reduced version of R1 very slowly.
I’m really underwhelmed by 32B Qwen DeepSeek R1. Both in its reasoning and knowledge. Still haven’t needed to or tested it at maths, so maybe that’s where it really shines.
1.5b will run fast on just CPU I think.
The user’s library of apps are Windows apps. And Windows does support Linux programs. There are versions of Windows that don’t technically have it enabled by default, but it’s easy to install support. It has a built in command “wsl --install”, and a button in the store and start-menu. And for most users who get a pre-configured image from IT or their laptop manufacturer it’s pre-installed.
I really don’t get this community’s insistence on getting people to use Linux no matter how much destruction they bring. Steam games on Linux are not what anyone has in mind when they say Linux doesn’t have games. Because Linux isn’t binary compatibility, it’s libre software.
In my circles, if someone says “Linux such and such”, we assume they might be referring to their FreeBSD computer as well. Here it seems Linux is more likely to refer to Android. Emulating a sketchy Windows game doesn’t make Linux the better platform for games. The Windows games are always going to be best on Windows, and now your Linux computer has malware on it.
Add “having laws” to the list of things that are scary when socialist countries do it.
The law (…) will compel tech companies (…to) remove content the government regards as “illegal” within 24 hours.
Almost as scummy as the concept of a YouTuber using affiliate links.
What’s well intentioned about not letting me use Cheat Engine on my own game. I’m not interacting with anyone else, I can’t ruin the game’s economy, or make people’s PvP experience worse. The worst thing I could do is make my own experience worse. They’re even including macro’s in that – A wide-spread accessibility feature.
I already bought the game, what incentive is there to make sure I can’t enjoy it?
Probably thinking of Empress. The most recent Denuvo game to be cracked was Dead Island 2, which is a year and a half ago. And if we don’t count Empress or MKDEV*, (because it’s reasonable to assume they aren’t going to want to crack this), then it’s eFootball in 2020: 4 years ago.
*MKDEV used to only crack Football Manager, as to allow modding. Football Manager now allows a method for MKDEV’s mod to run without removing Denuvo.
It’s not zero, each fiefdom has very little power to keep users. As it is right now, a user unhappy with their instance culture or laws can move to another instance. Comparing it to moving in real life, in real life you have a lifetime worth of things that tie you to your fiefdom. Comparing it to well established and centralised social media, then those fiefdoms still have a lot of power over you.
Your social network can’t come with you, they’re SSO providers, they’re tracking and human-verification providers, they have high quality exclusive content, they’re sometimes the only channel for interacting with some third parties you have to interact with (Government, utility company, etc).
But the people above you didn’t suggest zero, they suggested the officially reported numbers. Earlier it sounded like you were going to make an argument as to why Chinese numbers are more likely to be under-reported than USA numbers.
A capitalist is someone who owns capital, not someone who supports capitalism. A liberal is someone who supports capitalism. I don’t think Linus is a liberal, given that he’s the Linux guy. But he’s obviously a capitalist, and that’s okay, that’s something you should strive towards if you live under capitalism, even if ideologically you oppose capitalism.
thought-terminating cliché
There’s no argument, it’s the definition of the word. Why do you assume there should be argument around the normal usage of a word?
War crime speedrunners doing something shouldn’t make you think it isn’t illegal. Booby-traps are illegal. https://www.icrc.org/sites/default/files/external/doc/en/assets/files/other/icrc_002_0811.pdf
Yes.
You could watch two YouTube films at once. (No but seriously 2Mb/s is too low even for just YouTube. YouTube recommends 20Mb/s. And that’s probably assuming 30hz. So you probably actually want at double or more. https://support.google.com/youtube/answer/78358)