Report for CaMML Team

Figure 1: Profile of features selected. (Click to enlarge). Legend: dcause=direct cause, deffect=direct effects, ocauses=other causes (indirect), oeffects=other effects (indirect), spouses=parent of a direct effect, orelatives=other relatives, unrelated=completely irrelevant

Figure 2: Tscore of all entries made as a function of entry order. (Click to enlarge). The dashed lines indicate the 25 and 50 percentiles.

Figure 3: Fscore of all entries made as a function of entry order. (Click to enlarge). The dashed lines indicate the 25 and 50 percentiles.

Performances:

Fnum=number of features (*=sorted list, **=table of results. Fnum given for best Tscore if table of results submitted), Fscore=MB AUC, Tscore=AUC of test predictions; Top Ts=best score among all valid last entries made by participants. Max Ts=best score reachable, including reference entries using the knowledge of true causal relationships not available to participants.

*	Entry	Method	Fnum	Fscore	Tscore (Ts)	Top Ts	Max Ts	<Tscore>	Rank
REGED0	1228	reged camml	73/999 **	0.8216	0.1208±0.0042	1.0000	1.0000
REGED1	1228	reged camml	1/999 **	0.8102	0.3020±0.0058	0.9980	0.9980	0.2993	16
REGED2	1228	reged camml	53/999 **	1.0000	0.4750±0.0057	0.8600	0.9534
SIDO0	1226	sido camml	1/4932 **	0.5039	0.5000±0.0000	0.9443	0.9467
SIDO1	1226	sido camml	8/4932 **	0.4965	0.5007±0.0002	0.7532	0.7893	0.5202	15
SIDO2	1226	sido camml	16/4932 **	0.4965	0.5599±0.0035	0.6684	0.7674
CINA0	1165	cina camml	1/132 **	0.5652	0.1041±0.0035	0.9788	0.9788
CINA1	1165	cina camml	2/132 **	0.4667	0.4955±0.0047	0.8977	0.8977	0.4256	15
CINA2	1165	cina camml	12/132 **	0.4667	0.6772±0.0034	0.8157	0.8910

Return to Causation and Predition Challenge Analysis