Reinforcement-learning robotic sailboats: simulator and preliminary results - INRIA Chile Access content directly
Conference Papers Year : 2023

Reinforcement-learning robotic sailboats: simulator and preliminary results


This work focuses on the main challenges and problems in developing a virtual oceanic environment reproducing real experiments using Unmanned Surface Vehicles (USV) digital twins. We introduce the key features for building virtual worlds, considering using Reinforcement Learning (RL) agents for autonomous navigation and control. With this in mind, the main problems concern the definition of the simulation equations (physics and mathematics), their effective implementation, and how to include strategies for simulated control and perception (sensors) to be used with RL. We present the modeling, implementation steps, and challenges required to create a functional digital twin based on a real robotic sailing vessel. The application is immediate for developing navigation algorithms based on RL to be applied on real boats.
Fichier principal
Vignette du fichier
neurips_wrl2023.pdf (3.18 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-04395990 , version 1 (15-01-2024)



  • HAL Id : hal-04395990 , version 1


Eduardo Charles Vasconcellos, Ronald M Sampaio, André P D Araújo, Esteban Walter Gonzales Clua, Philippe Preux, et al.. Reinforcement-learning robotic sailboats: simulator and preliminary results. NeurIPS 2023 Workshop on Robot Learning Workshop: Pretraining, Fine-Tuning, and Generalization with Large Scale Models, Dec 2023, New Orelans, United States. ⟨hal-04395990⟩
121 View
125 Download


Gmail Mastodon Facebook X LinkedIn More