Towards Automated Deep Learning: Analysis of the AutoDL challenge series 2019 - Laboratoire de recherche en informatique. Équipe: Apprentissage et optimisation Accéder directement au contenu
Communication Dans Un Congrès Année : 2020

Towards Automated Deep Learning: Analysis of the AutoDL challenge series 2019

Zhengying Liu
  • Fonction : Auteur
  • PersonId : 1038060
Zhen Xu
  • Fonction : Auteur
  • PersonId : 1092603
Adrien Pavao
Sebastien Treguer
  • Fonction : Auteur
  • PersonId : 1092606
Wei-Wei Tu
  • Fonction : Auteur
Isabelle Guyon
  • Fonction : Auteur
  • PersonId : 963159

Résumé

We present the design and results of recent competitions in Automated Deep Learning (AutoDL). In the AutoDL challenge series 2019, we organized 5 machine learning challenges: AutoCV, AutoCV2, AutoNLP, AutoSpeech and AutoDL. The first 4 challenges concern each a specific application domain, such as computer vision, natural language processing and speech recognition. At the time of March 2020, the last challenge AutoDL is still ongoing and we only present its design. 1 Some highlights of this work include: (1) a benchmark suite of baseline AutoML solutions, with emphasis on domains for which Deep Learning methods have had prior success (image, video, text, speech, etc); (2) a novel "anytime learning" framework, which opens doors for further theoretical consideration; (3) a repository of around 100 datasets (from all above domains) over half of which are released as public datasets to enable research on meta-learning; (4) analyses revealing that winning solutions generalize to new unseen datasets, validating progress towards universal AutoML 1. Its results will be presented in future work together with detailed introduction of winning solutions of each challenge.
Fichier principal
Vignette du fichier
liu20a.pdf (582.19 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03159795 , version 1 (04-03-2021)

Identifiants

  • HAL Id : hal-03159795 , version 1

Citer

Zhengying Liu, Zhen Xu, Shangeth Rajaa, Meysam Madadi, Julio C S Jacques, et al.. Towards Automated Deep Learning: Analysis of the AutoDL challenge series 2019. NeurIPS 2019 - Thirty-third Conference on Neural Information Processing Systems, Competition and Demonstration Track, Dec 2020, Vancouver / Virtuel, United States. pp.242-252. ⟨hal-03159795⟩
86 Consultations
372 Téléchargements

Partager

Gmail Facebook X LinkedIn More