Skip to content
Benchmarks

Benchmark versions and updates ​

In short

Your scores are calculated once, when the analysis runs, and never change. The comparison values next to them come from a fixed benchmark generation, so they do not change either. Benchmark updates are released as new generations, used by new analyses only.

Your scores are fixed ​

Your scores are calculated once, when the analysis runs, and they are stored. They are never recalculated afterwards. An analysis you ran months ago shows exactly the scores it showed on day one.

Comparison values are fixed too ​

The comparison values shown next to your scores (the group averages behind the markers and the "+N / −N" chips) come from the benchmark generation the analysis was run against. That generation is fixed: it is not refreshed and does not grow with new analyses. So an older analysis shows the same comparison values it showed on day one.

Benchmark generations ​

Benchmark updates are released as new generations. New analyses use the current generation. Older analyses keep being shown against the generation they were analysed with, so they are never silently moved to a different reference.

Scores from analyses run on different generations were positioned against different libraries. Comparing them directly is not recommended, because the models may also have changed in between. To compare an older creative with a new one, re-analyse it: upload the same image or video as a new analysis.

AI insights ​

The written AI insights quote the same comparison values as the screen, because both come from the analysis's own benchmark generation.

Foresight by Emotiva