standards of evidence

#concept

Every field has some accepted ____ — a set of methods that are agreed upon for proving a point ? standard of evidence Standards of evidence:

• Medicine: Double-blind randomized controlled trial
• Philosophy: Rhetoric
• Math: Formal proof
• Applied Physics: Measurement

In computing, because areas use different methods, the standard of evidence differs based on the area.

Your goal: convince an expert in your area. So, use the methods appropriate to your area

References §

1. https://web.stanford.edu/class/cs197/lectures/06-evaluation.pdf

Notes §

Each claim structure implies an evaluation design

• x > y: given a representative task or set of tasks, test whether x in fact outperforms y at the problem
• ∃ x: demonstrate that your approach achieves x
• bounding x: demonstrate bounds inside or outside of which approach x fails

DV, IV, task, threats