Problems with measuring performance

  1. Accurate, reproducible performance measurement is hard
  2. Think carefully about your experiment:
  3. What is it, precisely, that you want to measure
  4. How representative is your test to the situation that you are trying to measure?