Join the discussion
Write your take first — we'll ask for email only when you're ready to publish.
- Hacker News
- why wouldn't they benchmark the accuracy against jev too?
- I just don’t understand the use of a decoder model to make a classifier. Jev model will give you probability scores for each of the classes/selections you ask for. The probability is actual statistical probability that a selection is right.
Using a decoder model for this comes down to picking the most probable class based on the probability what the next token assigned to a class is. They are all probabilities but semantically mean totally different things. Am I right?
by mrbonner - The article talks about using the decision model in code, but could it be used to help indecisive people with everyday life, decision decisions? I know a few and they could really use help.by fredsmith219
- Looks like yet another non-price-competitive Jev competitor.
Microsoft only compares the price of theirs to GPT Sol(!), not GPT Terra, or GPT Luna (which is what OpenAI's Jev wannabe is based on), and certainly not Jev (4/10 the cost of Luna).
I can't remember when a new product created So many competitors so quickly. What is very clear is that everyone is saying "Doh!", slapping themselves on the forehead, and scrambling to get a slice of this obvious-in-retrospect massive pie.
What no-one appears to have done yet is to come close to Jev on pricing!
- Will they use it to decide how to name Office, ehm Office 365, ehm Microsoft 365, ehm Microsoft 365 Copilot next?
- In my minimal suite it was cheaper (by 0.72x) but higher latency (283ms vs 369ms p50) than Jev. Results were very comparable across all scenarios I measure, first of these that I have tested that actually justifies its existence as a commercial release.
Qwen tunes are nice and all but either price or performance makes each example I have tested not viable unless you are able to cheaply self-host and fine-tune further.
by Topfi - Microsoft is doing things differently with AI. It feels to me they are moving into local inference heavily and see a future where Windows has native AI APIs that run locally or optionally in the cloud/edge.
- This is based on one of the smaller Qwen models, just like Cloudflare's Clef, Strands decider, and a plethora of others released in the last couple of weeks.
Kind of funny how much hype they can all get out of this, but Qwen really is the little engine that could. Great to see open weights (if not open source) driving the whole ecosystem like this though.
by nejch