

61·
10 months agoJust saw it too :D
Just saw it too :D
Why would you ever need such a feature? Closed.
you want a frontend, not the “service” itself.
Under “service” i usually understand the main logic part of something. In this case the LLM-processing itself.
Thats probably where the confusion is coming from here.
Please include the actual calculations for energy-prices as many, you may not know, live in different locations and pay different prices compared to you.
Dont. They are notoriously bad at such things. Lack of Hardware acceleration mainly. These old Chips and problems with single-board-complications are just not worth it at such high prices.
An Intel N100 MiniPC will have much more compute with less complications.