I got the impression that 03-mini or 03-mini-high were meant for coding? GPT 4.1...

conradev · 2025-07-02T15:53:02 1751471582

It’s good at a lot of things:

  GPT‑4.1 scores 54.6% on SWE-bench Verified, improving by 21.4%abs over GPT‑4o and 26.6%abs over GPT‑4.5—making it a leading model for coding.

coliveira · 2025-07-02T22:27:02 1751495222

They are trained on these "benchmarks", that's why they score better.

elzbardico · 2025-07-02T23:02:01 1751497321

If they were trained on those benchmarks they would score 100%

coliveira · 2025-07-02T23:15:34 1751498134

They show how bad they are, they cannot score 100% on benchmarks they were trained on.