RiOSWorld

<p align="center"> <img src="./assets/demo_logo.png" alt="Banner"> </p> <div align="center"> <h1><a href="https://arxiv.org/pdf/2506.00618" target="_blank">[NeurIPS'25] RiOSWorld: Benchmarking the Risk of Multimodal Computer-Use Agents</a></h1> <span style="color:red">📢 <strong><i>We are currently organizing and presenting the code for RiOSWorld. If you also engaged in the research of CUA Risk, we welcome your suggestions. If you have any questions about the code, feel free to create an issue. If you are interested in our work, please star ⭐ our project, Thx 💕.</i></strong></span> </div> <div align="center">

<img src="https://img.shields.io/badge/License-Apache_2.0-green.svg" alt="License"> <img src="https://visitor-badge.laobi.icu/badge?page_id=yjyddq.RiOSWorld" /> <img src="https://img.shields.io/github/stars/yjyddq/RiOSWorld?style=flat-square&logo=github" alt="Stars"> <img src="https://img.shields.io/github/issues/yjyddq/RiOSWorld?color=red" alt="Issues"> <img src="https://img.shields.io/github/issues-closed/yjyddq/RiOSWorld?color=success" alt="Closed Issues">

</div>

<video src="./assets/RiOSWorld_demo.mp4" controls width="500"></video>

📢 Updates

• 2025-11-05: (Important Update) To support further research and help community develops trustworthy computer-use agents, we release the evaluation trajectory data of RiOSWorld on HuggingFace JY-Young/RiOSWorld/trajectory_data.zip. This data is now available for researchers to use and build upon.
• 2025-11-01: We added the guideline of how to set snapshots for Docker Provider, as issued by .