Share
341 Posts.
lightbulb Created with Sketch. 911
clock Created with Sketch.
21/12/17
21:53
Share
Originally posted by investorgadget
↑
Thanks for the clarification. From my understanding leave-one-out cross validation both trains the algorithm and tests it at the same time. This method calculates the "apparent error", or how we expect it to be in real world. But of course your right, what the FDA/TGA/CE want is the "true error"- which is calculated by double blinding. When sample sizes are small, the apparent error could be quite different to the true error - which is what concerns FDA etc and you are probably right as to say they are not clinically valid tests. However with sample sizes as large as the Australian data, the apparent error should very closely reflect the true error and in fact this particular type of testing is slightly pessimistic - meaning the true error is going to be better (given its a large enough sample).
Happy to hear other opinions on this.
Expand
Good points. The promising results from the Australian studies were achieved on 611 subjects (adult study) and 1,127 subjects (Pediatric study). Bodes well for the clinical trial if your theory about apparent and true error holds.