Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Any details on how these tests were created? I.e. which kind of program was used for generation.


I think the ARC-AGI tasks was manually drawn with an early version of fchollet's editor.

Recently Michael Hodel has reverse engineered 400 of the tasks, so more tasks can be generated. Interestingly it can generate python programs that solves the tasks too.

https://github.com/michaelhodel/re-arc


No, his re-arc code does not enable generating more tasks, it merely allows to generate more examples for the already existing training tasks. Also, it can't generate task-solving programs either, it's author merely also provided a solution program for each generator program to verify the validity of the generated examples.


This is exactly what my first step was going to be. Thanks for the link! Saves a lot of time for someone to have already done it.


What do you mean it can 'generate python programs that solve the tasks'? I can't find any mention of that. I only see hand-coded solutions.


I have never tried running these verifiers, so I'm not sure they work. https://github.com/michaelhodel/re-arc/blob/main/verifiers.p...




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: