AI TRENDS | GPT-4 Vision Scores Below Human Average in Visual Math Reasoning

GPT-4 Vision has achieved a score of 49.9% in visual mathematical reasoning, according to MATHVISTA benchmark results. This performance is notably lower than the human average score of 60.3%. According to NS3.AI, researchers have pointed out that benchmark contamination in training data can complicate the assessment of genuine reasoning progress.