AI models agreed with each other more than with reality in a new test

AI models agreed more closely with one another than with laboratory measurements in a new test of AI predictions. Pooling their rankings improved results on average, but several systems could still share the same mistake. The Science Prediction Universe study , led by UniPat AI and submitted to arXiv on Nov. 11, tested 13 agent configurations spanning 12 models on 100 public tasks and 16 private tasks. Each configuration combined a model, reasoning setting and agent software. The study asked them to rank specified experiments across chemistry, materials science, biology and medicine.
You are reading an excerpt. CryptoSlate wrote and owns the full article.
Continue reading at cryptoslate.com










