I think failure is defined by expectations.

If you failed to succeed in the expected amount of time/effort, it's a failure. Maybe you add some tolerance of going past the estimate before classifying as a failure, but it's still rooted in the expectation.

For example, if it took you ten years to pass kindergarten, you've failed.