The National University of Singapore (NUS) has launched GameWorld, a new benchmark aimed at standardizing the evaluation of multimodal large language models (MLLMs) as general agents in video games. GameWorld encompasses 34 browser games and 170 tasks, each with verifiable metrics to objectively assess outcomes. This initiative addresses the limitations of inconsistent input interfaces and manual verification in current evaluations. The NUS team tested two agent interfaces: a "computer-use" agent that outputs keyboard and mouse commands, and a general multimodal agent using semantic parsing. In a large-scale evaluation involving 18 model-interface combinations, results indicated that current AI agents still fall short of human-level gaming abilities. The study highlights challenges such as real-time interaction latency and sensitivity to contextual memory. The research paper and project code are available on Hugging Face and GitHub.
NUS Team Unveils GameWorld Benchmark for AI Evaluation in Browser Games
This content is for informational purposes only and does not constitute investment advice.
SuperEx Popular Science Articles Column
This collection features informative articles about SuperEx, aiming to simplify complex cryptocurrency concepts for a wider audience. It covers the basics of trading, blockchain technology, and the features of the SuperEx platform. Through easy-to-understand content, it helps users navigate the world of digital assets with confidence and clarity.
Unstaked related news and market dynamics research
Unstaked (UNSD) is a blockchain platform integrating AI agents for automated community engagement and social media interactions. Its native token supports governance, staking, and ecosystem features. This special feature explores Unstaked’s market updates, token dynamics, and platform development.
XRP News and Research
This series focuses on XRP, covering the latest news, market dynamics, and in-depth research. Featured analysis includes price trends, regulatory developments, and ecosystem growth, providing a clear overview of XRP's position and potential in the cryptocurrency market.
How do beginners trade options?How does option trading work?
This special feature introduces the fundamentals of options trading for beginners, explaining how options work, their main types, and the mechanics behind trading them. It also explores key strategies, potential risks, and practical tips, helping readers build a clear foundation to approach the options market with confidence.
What are the risks of investing in cryptocurrency?
This special feature covers the risks of investing in cryptocurrency, explaining common challenges such as market volatility, security vulnerabilities, regulatory uncertainties, and potential scams. It also provides analysis of risk management strategies and mitigation techniques, helping readers gain a clear understanding of how to navigate the crypto market safely.