examples

Case set 03f5149718d0 — latest run per system

One column per CAS: the best of its routines (wrong if any is wrong, else solved if any solved it, else declined correctly if any did); +N shows the routines, older older versions. Click a category to see its cases.

always-none, sympy-ask, sympy-refine, sympy-simplify, wolfram-fullsimplify, wolfram-refine, wolfram-simplify: old report format (graded with a combined score): its nulls are shown as no verdict, because an old report cannot tell a correct decline on a contingent case from no verdict

Each cell shows what the system said, coloured by outcome: true ✓ solved, true ✗ wrong, no verdict: the system ran but did not commit to true or false (null); no verdict ✓ (grey ✓, on a contingent case) declined correctly: Correct: neither true nor false holds here. Not counted as solved, since a system that never answers would get this too.

Case set d7af4def9aaa — latest run per system

One column per CAS: the best of its routines (wrong if any is wrong, else solved if any solved it, else declined correctly if any did); +N shows the routines, older older versions. Click a category to see its cases.

always-none, sympy-ask, sympy-refine, sympy-simplify, wolfram-fullsimplify, wolfram-refine, wolfram-simplify: old report format (graded with a combined score): its nulls are shown as no verdict, because an old report cannot tell a correct decline on a contingent case from no verdict

Each cell shows what the system said, coloured by outcome: true ✓ solved, true ✗ wrong, no verdict: the system ran but did not commit to true or false (null); no verdict ✓ (grey ✓, on a contingent case) declined correctly: Correct: neither true nor false holds here. Not counted as solved, since a system that never answers would get this too.