Lokální AI kóduje: Když vývojáři utíkají z cloudu

Vývojáři si začínají uvědomovat, jak moc je cloudové AI drahé. Mnoho firem platí tisíce měsíčně za tokeny, zatímco open-source modely už dokážou běžet na běžném hardwaru. Tento rozdíl v ceně a dostupnosti nutí lidi přemýšlet – potřebujeme ještě platit za AI v cloudu?

Kde se zlomila ekonomika

Ceny prémiových AI služeb už pro řadu týmů nedávají smysl. Co začalo jako užitečný pomocník, se proměnilo v pravidelnou a často bolestivou položku v rozpočtu. Každodenní používání API při práci celého týmu rychle vyčerpává finanční prostředky.

Open-source komunita ale nezahálela.

Open-source modely už stačí

Nové open-source modely se dokážou obejít s 16 GB VRAM. To je velká změba – před necelými dvěma lety byla lokální verze slušného modelu záležitostí pro výzkumné týmy s specializovaným hardwarem.

Tyto modely sice nejsem dosahují frontiérních úrovních, but but they nicht they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they they