{"id":5534,"date":"2021-04-26T00:06:31","date_gmt":"2021-04-25T22:06:31","guid":{"rendered":"https:\/\/blogs.mathworks.com\/student-lounge\/?p=5534"},"modified":"2025-02-20T14:12:11","modified_gmt":"2025-02-20T19:12:11","slug":"building-an-autonomous-vehicle-av-simulation-toolchain-with-simulink-roadrunner-and-nvidia-drive-sim","status":"publish","type":"post","link":"https:\/\/blogs.mathworks.com\/student-lounge\/2021\/04\/26\/building-an-autonomous-vehicle-av-simulation-toolchain-with-simulink-roadrunner-and-nvidia-drive-sim\/","title":{"rendered":"Building an Autonomous Vehicle (AV) Simulation Toolchain with Simulink, RoadRunner and NVIDIA DRIVE Sim"},"content":{"rendered":"

Today’s blog is written by MathWorks Product Marketing team: Avi Nehemiah<\/a>, Peter Fryscak<\/a> and Mike Sasena<\/a>.<\/p>\n

This blog will provide an overview of how three of MathWorks\u2019 platforms\u00a0\u2014\u00a0 MATLAB, Simulink and\u00a0<\/span>RoadRunner<\/span>\u00a0\u2014 integrate with and support workflows for autonomous vehicle (AV) developers using\u00a0<\/span>NVIDIA DRIVE Sim<\/span><\/a>, a platform for scalable, physically accurate, and diverse simulation.\u00a0<\/span>\u00a0<\/span><\/p>\n

\"\"<\/p>\n

This\u00a0<\/span>two-part<\/span>\u00a0blog series covers the two ways MathWorks platforms support AV developers using NVIDIA DRIVE Sim<\/span>\u00a0or deploying algorithms to\u00a0<\/span>NVIDIA hardware.\u00a0<\/span>\u00a0<\/span><\/p>\n

    \n
  1. Part 1 –\u00a0<\/span>Integration with DRIVE Sim for e<\/span>nvironment\u00a0<\/span>m<\/span>odeling<\/span>\u00a0and vehicle dynamics<\/span>:<\/span>\u00a0<\/span>H<\/span>ow MathWorks tools integrate with DRIVE Sim to<\/span>:<\/span>\u00a0<\/span>\n
      \n
    1. D<\/span>esign<\/span>\u00a03D networks and scenes\u00a0<\/span>for simulation using\u00a0<\/span>RoadRunner<\/span><\/a>\u00a0and the\u00a0<\/span>DRIVE\u202fSim\u202fconnector\u202fto\u202f<\/span>RoadRunner<\/span>\u202f<\/span>to export simulation-ready environments\u00a0<\/span>to<\/span>\u202fOmniverse.\u202f<\/span>\u00a0<\/span><\/li>\n
    2. Couple<\/span>\u00a0high-fidelity vehicle dynamics models<\/span>\u00a0<\/span>from\u00a0<\/span>Vehicle Dynamics\u00a0<\/span>Blockset<\/span><\/a>\u00a0in<\/span>\u00a0Simulink<\/span>\u00a0with the DRIVE Sim ego-vehicle.<\/span><\/li>\n<\/ol>\n<\/li>\n
    3. Part 2 –\u00a0\u00a0<\/span>Deploy algorithms to\u00a0<\/span>DRIVE platforms:<\/span>\u00a0 H<\/span>ow to\u00a0<\/span>g<\/span>e<\/span>nerate optimized CUDA code from MATLAB code and Simulink models<\/span>\u00a0using\u00a0<\/span>GPU Coder<\/span><\/a>\u00a0and\u00a0<\/span>Embedded Coder<\/span><\/a>\u00a0for deployment to NVIDIA\u00a0<\/span>DRIVE\u00a0<\/span>hardware.<\/span>\u00a0<\/span>\u00a0<\/span><\/li>\n<\/ol>\n

      Environment Modeling<\/span>\u00a0<\/span><\/h2>\n

      AV developers need to develop realistic 3D environments to simulate and test\u00a0<\/span>their perception, planning, and control algorithms.\u00a0<\/span>One of the primary challenges they face is that real-world roads are complex, and it is extremely time consuming to create simulation-ready 3D scenes.\u00a0<\/span>RoadRunner<\/span>\u00a0is an interactive editor to design 3D scenes for simulating and testing automated driving systems. Developers can customize roadway scenes by creating region-specific road signs and markings, as well as insert signs, signals, guardrails, road damage, foliage, buildings, and other 3D models.<\/span>\u00a0<\/span><\/p>\n


      \n\"\"<\/span><\/p>\n

      Complex real-world road network (left)\u00a0<\/i>and simulation-ready environment in\u00a0<\/i>RoadRunner<\/i>\u00a0(right)<\/i><\/p>\n

      An AV developer can create the 3D environment below in under 30 minutes using the DRIVE Sim connector to\u00a0<\/span>RoadRunner<\/span>\u00a0to export it to\u00a0<\/span>NVIDIA<\/span>\u00a0Omniverse<\/span><\/a>\u00a0for simulation or integration with other 3D production pipelines.\u00a0<\/span>\u00a0<\/span><\/i><\/p>\n

      \"\"<\/span><\/p>\n

      \u00a0<\/span>3D environment to be created in\u00a0<\/span><\/i>RoadRunner<\/span><\/i>\u00a0and exported to Omniverse using DRIVE Sim connector to\u00a0<\/span><\/i>RoadRunner<\/span><\/i>.<\/span><\/i>\u00a0<\/span><\/i>\u00a0<\/span><\/p>\n

      The environment above can be divided into the following components:<\/span>\u00a0<\/span><\/p>\n