Birbla

Join the discussion

Write your take first — we'll ask for email only when you're ready to publish.

Sign in
  • Hacker News
  • Here is GLM 5.2 (https://codeinput.com/s/HAO0qTxw2ia) which is still inferior to Opus. I can't find Qwen 3.8 which now is my daily driver replacing GLM. This SVG test matches my experience when working with the different models. The other models can get the details right but their output is structured in a way that makes little or no sense.

    I also did a timeline from 4.7 to 5.2: https://codeinput.com/s/7oK2IIA7qRO The improvements in models looks much less impressive with this test.

    by csomar
  • This is a strong benchmark! None of these could be remotely mistaken for human art. Opus 5 comes closest.
    by getnormality
  • My personal human benchmark: "Jump on one leg, while reciting the national anthem of Latvia, translated to Spanish, backwards, while drawing a frog with a brush held by toes of the other leg, on the ceiling". So far they're not doing very good but I'm sure they'll improve over time.
    by throwuxiytayq
  • How about a wall and the national anthem of Sweden? I don't know Latvian or stretch that much any more. I'm actually half tempted to try that...
    by a96
  • The secret to great interview questions and challenge tests is keeping them secret. Posting them on HN and getting them onto the front page puts them in jeopardy.
    by riazrizvi
  • https://jumpshare.com/s/rcdD4i6MRY3AijzQG7W9 GPT 5.6 absolutely smashed it
    by bigglywiggler
  • Opus 5 clearly frogmaxxed.

    gemini-3.6-flash runs 2 and 3 responded best to the royal portrait context.

    by wren6991
  • > frogmaxxed

    raninemandibularprognathism-maxxed?

    by andybak
  • Arguably, a royal portrait is a misinterpretation of the prompt, since it's just asking for a specific facial feature. But I guess you could look at it as a bit of artistic license.
    by fasterik
  • Hopsburg Jaw
    by evan_
  • I so desperately want to upvote this. Driveby puns don't get nearly enough recognition
    by 4sak3n
  • My personal benchmark is a directory containing a bunch of research papers on the physics of popping popcorn kernels, and a prompt about creating high fidelity, photo realistic 3D models of all the different kinds of popped kernels. Fable (surprisingly? unsurprisingly?) refused to do it last time I tried, and the results from other models are, well, fine, but there's still plenty of headroom on this particular one.
    by abound
  • LLMs don’t work particularly well in 3d applications in my experience. Every new model release I’ll ask one for help with my path tracer and results are horrid.
    by uncivilized
  • Curious that none of the attempts draw the frog from side profile. If i have to draw this i would immediately know that drawing a recognisable frog is the easy part of job. Expressing a particular jaw shape and melding it on the frog is the hard part. And jaw shapes are more prominent from the side.

    Even absence of thinking this through you would think that some frogs will be from the front, some from the side. Just by chance. And yet all appears to go for the harder pose.

    by krisoft
  • See https://news.ycombinator.com/item?id=49150393
    by Rygian
  • When I asked ChatGPT, it gave me a side profile, first as a PNG which was good and then I asked again for an SVG and it obliged, doing a version of what it produced but it was bad.

    SVG: https://jostylr.com/imgs/frog_habsburg_jaw.svg

    PNG: https://jostylr.com/imgs/frog_habsburg.png

    Then I tried Codex with Sol 5.6 High and got a face forward one.

    SVG: https://jostylr.com/imgs/frog-habsburg.svg

    by jostylr
  • Hi all, the site is getting hugged to death, thank you, was not expecting this kind of warm response. I will be working to make this more reliable, in the meantime, sign up for my newsletter: https://www.jaymollica.com/blog/

    also my favorite SVG was def the google/gemini-3.6-flash

    edit: ok better now I think

    by thebigship
  • > also my favorite SVG was def the google/gemini-3.6-flash

    That looks like something from Machinarium or Robots :)

    by troupo
  • I thought this was great, and hilarious. Kudos to Opus 5, I thought it was the only one that came close to passing. Interestingly, I thought many of the failures drew the frog face OK, and they had some type of big blob for the jaw, so they knew "Hapsburg jaw" meant a protruding jaw, but it wasn't really connected to the frog face in any way that made sense.

    Small side note, the first gemini-2.5-pro one totally reminded me of some sad faced meme or Pepe the frog from somewhere. Anyone know what I'm referring to, tried to find it.

    by hn_throwaway_99
  • Perhaps you're thinking of Salad Fingers?
    by viciousvoxel
  • Fable 5 on Max knocks it out of the park:

    https://imgur.com/a/usR8K7G

    Definitely has some creative flourishes.

    (I made no extra prompting. Just the above text. Single shot.)

    by jnwatson
  • Uh, it failed the test by assuming it was royalty.
    by inigyou
  • It makes the frog a king which is not in the prompt, so there is a bit of confusion.
    by nathanappere
  • I'm out of credits or I would've tried fable. I knew it would do well
    by xeromal
  • rex paludis is a nice touch.
    by zombot