{"id":13656,"date":"2026-10-19T14:50:43","date_gmt":"2026-10-19T18:50:43","guid":{"rendered":"https:\/\/blogs.mathworks.com\/student-lounge\/?p=13656"},"modified":"2026-10-19T14:50:43","modified_gmt":"2026-10-19T18:50:43","slug":"from-simulation-to-reality-how-uos-robotics-won-the-robocup-arm-challenge-2026","status":"publish","type":"post","link":"https:\/\/blogs.mathworks.com\/student-lounge\/2026\/10\/19\/from-simulation-to-reality-how-uos-robotics-won-the-robocup-arm-challenge-2026\/","title":{"rendered":"From Simulation to Reality: How UOS Robotics Won the RoboCup ARM Challenge 2026"},"content":{"rendered":"
\n
UOS Robotics from the University of Seoul returned to the RoboCup ARM Challenge in 2026 after winning titles in 2022 and 2023. With RoboCup 2026 held in Incheon, South Korea, the team took first place in the global simulation round and went on to win the on-site final on home soil. Today’s blog highlights the engineering work behind this success: bringing perception, planning, and control algorithms from a virtual environment to a real Universal Robot.<\/div>\n
\"UOS<\/div>\n
Figure 1. UOS Robotics celebrates its ARM Challenge victory at RoboCup 2026 in Incheon, South Korea.<\/span><\/div>\n

Meet the Team and the RoboCup ARM Challenge<\/h2>\n
The RoboCup Autonomous Robot Manipulation (ARM) Challenge<\/a> brings together student teams and young researchers from around the world to tackle autonomous robotic manipulation. Robots must recognize objects, generate grasp poses, and pick-and-place them as their positions and orientations change\u2014all without human intervention. The 2026 challenge centers on a recycling task involving objects of different shapes and colors, including bottles and cans.<\/div>\n
A successful ARM challenge solution requires perception, planning, and control to work together as one reliable system. The competition serves as a comprehensive test of end-to-end robotics development and system integration, challenging teams to integrate these components and take their solutions from simulation to physical hardware.<\/div>\n
The competition has two rounds. In Round One, the global simulation challenge<\/span>, teams develop and test their perception, planning, and control algorithms in a photorealistic 3D environment provided by MathWorks using Simulink 3D Animation<\/a>. They submit their code and a demonstration video for evaluation. In 2026, 259 teams registered for the simulation round, and 27 teams developed and submitted working solutions. The simulation round provides an excellent opportunity to practice robotic manipulation skills without hardware constraints and allow teams to simulate and test their algorithms before moving to the physical robot.<\/div>\n
The top qualifying teams advance to Round Two, the on-site final<\/span>, where they demonstrate their solutions on a physical UR5e robot from Universal Robots<\/a>. UOS Robotics was one of five teams in the 2026 final, bringing a complete workflow that integrated deep-learning-based perception and grasp generation with robot control using Robotics System Toolbox\u2122 Support Package for Universal Robots Series Manipulators<\/a>.<\/div>\n
\"RoboCup<\/div>\n
Figure 2. <\/span>The reel<\/a> from the RoboCup 2026 ARM Challenge.<\/span><\/div>\n
Let’s take a closer look at how the UOS Robotics team built its simulation solution, adapted it for the physical UR5e, and prepared for the on-site final. Over to the team<\/span>.<\/div>\n
We are UOS Robotics, a team of graduate and undergraduate students from the Robotics Laboratory in the Department of Mechanical and Information Engineering at the University of Seoul, led by Professor Myun Joong Hwang. Our research interests include robot perception, manipulation, motion planning, and control.<\/div>\n
We joined the ARM challenge because it gave us the opportunity to test our research on a complete physical robot system. In the laboratory, perception, grasp generation, and robot control are often tested independently. This competition required all of these components to work together reliably in a limited amount of time and under changing object configurations.<\/div>\n
Senior members of our lab won the championship in both 2022 and 2023. We missed the 2024 and 2025 competitions due to scheduling issues, but we made it a point to return in 2026 because the final was being held in South Korea.<\/div>\n
For us, the challenge was also an opportunity to gain experience building an end-to-end robotic system. Our goal was to develop a UR5e-based autonomous sorting system that could detect objects, generate suitable grasp poses, and place each object into its designated bin. In order to achieve this, we needed to integrate deep-learning models, RGB-D image processing, coordinate transformations, inverse kinematics, and robot communication and gripper control into one single workflow.<\/div>\n

Round One: Building a Winning Simulation Solution<\/h2>\n
Let’s break down the challenge. The task was to sort multiple objects placed randomly in the robot workspace. Their positions and orientations were not known in advance, so the grasping part of the task could not rely on fixed robot trajectories.<\/div>\n
The robot first had to understand the scene from an RGB-D image. It needed to distinguish individual objects even when they were close together or partially occluded. Once an object was detected, the robot had to generate a grasp pose that was not only geometrically feasible but also reachable and stable for the robot.<\/div>\n

Bringing the Components Together<\/h3>\n
We used MATLAB<\/a> as the main integration environment for the complete workflow. The YOLO segmentation model and the conditional flow matching-based grasp-generation model were first trained in PyTorch. Then we exported both models in ONNX format and imported them into MATLAB for inference, using Deep Learning Toolbox\u2122<\/a> and the Deep Learning Toolbox Converter for ONNX Model Format<\/a>.<\/div>\n
MATLAB enabled us to use our trained neural networks while connecting them directly to the remaining robotics pipeline. MATLAB enables us to process the model outputs, calculate robot configurations, and send the resulting commands within one environment.<\/div>\n
\"System<\/div>\n
Figure 3. The team’s overall learning, inference, and control workflow.<\/span><\/div>\n
We divided the problem into three main stages: object perception, grasp generation, and robot execution.<\/div>\n

Stage 1: Finding the Target Object<\/h3>\n
The robot began each cycle by moving to an observation pose. The robot captured an RGB-D image and the YOLO model was used to identify individual objects and generate an instance mask for each detected object. Using the segmentation mask, we cropped a square region centered on the target object from the RGB and depth images. Invalid depth measurements were filtered out before this cropped observation was passed to the grasp-generation model.<\/div>\n
\"Stage<\/div>\n
Figure 4. Object perception identifies the target and produces a segmentation mask.<\/span><\/div>\n

Stage 2: Generating Possible Grasps<\/h3>\n
A single object can have several suitable grasp poses. We used an implementation based on the TorchCFM library<\/a> to generate multiple candidates rather than predict a single deterministic pose. Each grasp pose describes where the gripper should be positioned and how it should be oriented in three-dimensional space. Our simulation configuration generated 64 candidates at each grasp-generation attempt. Producing several options gave the next stage a choice when a candidate was obstructed or could not pass the robot’s inverse-kinematics checks.<\/div>\n
\"Stage<\/div>\n
Figure 5. Conditional flow matching generates candidate gripper poses for the selected object.<\/span><\/div>\n

Stage 3: From Grasp Candidates to Robot Motion<\/h3>\n
Not every generated candidate was suitable for execution. We filtered out candidates that could lead to unintended collisions. The remaining candidates were scored according to geometric criteria, including proximity to the object center and approach direction, and the highest-scoring feasible grasp was selected. In the competition environment, near-vertical, top-down grasps were often more reliable because they reduced the chance of contacting nearby objects.<\/div>\n
\"Three-panel<\/div>\n
Figure 6. Generated grasps are screened and ranked before robot execution.<\/span><\/div>\n
The generated grasp poses were initially expressed in the camera coordinate frame. In simulation, we used the camera pose calculated from the robot model and its mounting offset to transform the grasp poses into the robot base frame. We then used Robotics System Toolbox<\/a> to solve inverse kinematics for both a pre-grasp pose and the grasp pose, selecting the first ranked candidate that passed both checks.<\/div>\n
We sent joint and gripper commands through ROS 2 to the virtual robot in Simulink using ROS Toolbox<\/a>. The virtual robot moved to a pre-grasp position, approached the object along the selected grasp direction, and closed the gripper. It then lifted the object vertically, moved to the destination bin, and opened the gripper. The provided simulation model handled object attachment and release through its gripper-contact logic.<\/div>\n
\"Stage<\/div>\n
Figure 7. Stage 3 in the simulation round.<\/span><\/div>\n

Testing the Complete Simulation Workflow<\/h3>\n
Our staged workflow structure made the system easier to debug. When a failure occurred, we could determine whether it came from segmentation, grasp generation, coordinate transformation, inverse kinematics, robot motion, or gripper operation.<\/div>\n
Simulation allowed us to validate the overall task logic repeatedly before testing it on the physical robot. We could verify the perception-to-grasp pipeline, inspect generated grasp poses, and test the sequence of robot motions without the risk of collisions or hardware damage. This made it possible to iterate more quickly on the overall system structure before the final challenge.<\/div>\n
Watch our simulation-round demonstrations below and download our code for the simulation round here<\/a>.<\/div>\n