next up previous
Next: Discussion Up: Experiments Previous: Experimental Complexity

Evaluation

To evaluate the approach we used two methods. The first one is to run the tex2html_wrap_inline610 test to assess the correlation between our experiments and the theoretical terms. Then we ran more experiments (a different set of experiments) to see whether we can estimate the outcomes of these new experiments with our old formulas (and hence with the old constants).

The tex2html_wrap_inline610 test, for all of the three measurements (setup, querying, selection), showed that the estimated values and the actual values obtained from the experiments were highly correlated.

We ran 1000 extra experiments and obtained the same times with the similar methods used in the previous set of experiments (the starfield display was always active in this set of experiments). We had a random combination of the following values for our experiments: point size varied between tex2html_wrap_inline480 to tex2html_wrap_inline618 , jump size varied from 1 to 50, screen size varied from tex2html_wrap_inline624 to tex2html_wrap_inline478 (with range sliders of size 250 pixels a user interface with a starfield of tex2html_wrap_inline478 pixels nearly fills the screen), and the slider sizes varied from 150 to 250. The only values that were fixed during these new set of experiments (i.e., same values with the previous set of experiments) were the dataset sizes and the attribute counts (as it is practically impossible to generate all the possible (random) datasets (either in terms of time or space) on the fly for these new set of experiments). The differences between the estimates and the actual times were obtained. The average deviation observed for setup time was 9.50 percent; for selection, 3.97 percent; for querying, 16.63 percent.



Egemen Tanin
Fri May 9 11:28:05 EDT 1997