causality

Report for CaMML Team

 Profile of features selected

Figure 1: Profile of features selected. (Click to enlarge). Legend: dcause=direct cause, deffect=direct effects, ocauses=other causes (indirect), oeffects=other effects (indirect), spouses=parent of a direct effect, orelatives=other relatives, unrelated=completely irrelevant

 Tscore performance of all entries

Figure 2: Tscore of all entries made as a function of entry order. (Click to enlarge). The dashed lines indicate the 25 and 50 percentiles.

 Fscore performance of all entries

Figure 3: Fscore of all entries made as a function of entry order. (Click to enlarge). The dashed lines indicate the 25 and 50 percentiles.

Performances:

Fnum=number of features (*=sorted list, **=table of results. Fnum given for best Tscore if table of results submitted), Fscore=MB AUC, Tscore=AUC of test predictions; Top Ts=best score among all valid last entries made by participants. Max Ts=best score reachable, including reference entries using the knowledge of true causal relationships not available to participants.
* Entry Method Fnum Fscore Tscore (Ts) Top Ts Max Ts <Tscore> Rank
REGED0 1228 reged camml 73/999 ** 0.8216 0.12080.0042 1.0000 1.0000
REGED1 1228 reged camml 1/999 ** 0.8102 0.30200.0058 0.9980 0.9980 0.2993 16
REGED2 1228 reged camml 53/999 ** 1.0000 0.47500.0057 0.8600 0.9534
SIDO0 1226 sido camml 1/4932 ** 0.5039 0.50000.0000 0.9443 0.9467
SIDO1 1226 sido camml 8/4932 ** 0.4965 0.50070.0002 0.7532 0.7893 0.5202 15
SIDO2 1226 sido camml 16/4932 ** 0.4965 0.55990.0035 0.6684 0.7674
CINA0 1165 cina camml 1/132 ** 0.5652 0.10410.0035 0.9788 0.9788
CINA1 1165 cina camml 2/132 ** 0.4667 0.49550.0047 0.8977 0.8977 0.4256 15
CINA2 1165 cina camml 12/132 ** 0.4667 0.67720.0034 0.8157 0.8910

Return to Causation and Predition Challenge Analysis