Join the discussion
Write your take first — we'll ask for email only when you're ready to publish.
- Hacker News
- It may be true for text outputs, but it's absolutely untrue for other modalities: image, speech, voice, and embedding. Heck, embedding models haven't even been updated in years.by OutOfHere
- Absolute BS, my experience is people are using this "intelligence" to do more dumb shit. I'm not seeing intelligence, I'm seeing unqualified people wielding power tools but they don't know any basic carpentry skills.by bamboozled
- Cost per token goes down yes. But are you using more tokens per task/ prompt/ project?
- Well, since llms need matterial for self-education, someone still had to be inteligent enough. Or llms will freeze their “intelect” at some point.
- Yes, the price of inference is falling rapidly.
What about the cost? Inference looks like a viable business model for those operators that have access to SOTA model and serving infrastructure, but the investment required to have it is enormous, and appears to be never-ending, because if an operator stops investing aggressively, its model and serving infrastructure quickly become non-competitive, and customers will quickly leave for alternatives.
by cs702 - I love marginal revolution. But I'm not fond of the unit stated. I dont believe we're buying intelligence. I'm sure marketing will run with it though.
- Price of human intelligence is also falling rapidly. I suspect looking pretty is going to go up in value more rapidly.by silverFork
- The actual report is by Epoch AI, which is financed by totally independent funds like (Eric) Schmidt Sciences.
Professor Tabarrok uncritically praises the report, which might lead to the conclusion that either human intelligence or moral standards are "falling rapidly".
by 129348681