Overview / P1

P1 · refund-policy Q&A

20 runs declaring these stages, oldest first as this console received them.

Compare two runs · Drift across its runs

  1. load_docs0
  2. split1
  3. embed0
  4. retrieve0
  5. answer0

Under each stage: how many of this pipeline's 2 stored comparisons first differ there, as each one's stored report reads. 1 found no difference.

Show: All · Records agree · Need attention

20 of 20 runs shown.

Each mark is one run's "Records agree", as its own page reads it:

  • Records agree
  • Contradicts its record
  • Couldn't check
  • Not checked
  • No verdict recorded
  1. 1 p1-01-baseline-set1

    Records agree

    Baseline of a stored comparison

  2. 2 p1-02-baseline-set2

    Records agree

    Baseline of a stored comparison

  3. 3 p1-03-baseline-set3

    Records agree

    Not compared

  4. 4 p1-04-baseline-set4

    Records agree

    Not compared

  5. 5 p1-05-baseline-set5

    Records agree

    Not compared

  6. 6 p1-06-baseline-set6

    Records agree

    Not compared

  7. 7 p1-07-candidate-set1

    Records agree

    Not compared

  8. 8 p1-08-candidate-set2

    Records agree

    First difference · stage 2 · split

  9. 9 p1-09-candidate-set3

    Records agree

    Not compared

  10. 10 p1-10-candidate-set4

    Records agree

    Not compared

  11. 11 p1-11-candidate-set5

    Records agree

    Not compared

  12. 12 p1-12-candidate-set6

    Records agree

    Not compared

  13. 13 p1-13-baseline-set1-again

    Records agree

    Same

  14. 14 p1-14-candidate-set3-byte-changed

    Contradicts its record

    Not compared

  15. 15 p1-15-candidate-set4-file-deleted

    Contradicts its record

    Not compared

  16. 16 p1-16-candidate-set5-no-artifacts

    Not checked (held without its output files required)

    Not compared

  17. 17 p1-17-baseline-set2-unsigned

    Records agree

    Not compared

  18. 18 p1-18-baseline-set3-unsigned

    Records agree

    Not compared

  19. 19 p1-19-baseline-set4-untrusted-key

    Records agree

    Not compared

  20. 20 p1-20-candidate-set6-answer-failed

    Records agree

    Not compared