Séminaires RALI-OLST

L'augmentation de données est morte, longue vie à l'augmentation de données

Frédéric Piedboeuf (fred (point) piedboeuf <at> gmail (point) com)

RALI, DIRO

Wednesday 28 February 2024 at 11:30 AM

Salle C-9019, Pavillon Lionel-Groulx — Diffusion simultanée sur Zoom


Textual data augmentation is a prolific field of study where novel techniques to create artificial data are regularly proposed. For the text classification task, it is accepted that the possible gains depend greatly on the size of the dataset, with larger gains being associated to smaller datasets. In this paper, we challenge those results, showing that data augmentation is simply a way of performing better fine-tuning on the neural networks, and that spending more time fine-tuning before applying data augmentation negates its effect. This is a significant contribution as it answers several questions that were left open in recent years, namely: what DA technique performs best (all of them as long as they generate data close enough to the training set) and why does DA work (facilitate training of network). We furthermore show that zero shot data generation via conversational agents such as ChatGPT or LLama2 can increase the performance, but not as much as collecting and annotating external data.

La présentation sera en français.



Join with Zoom at this url.
Meeting ID: 916 9097 5818, 𝑷𝒂𝒔𝒔𝒄𝒐𝒅𝒆: 343273.
Phone numbers: https://umontreal.zoom.us/u/abitNZzLg.
One tap mobile: +14388097799,,91690975818#,,,,,,0#,,343273#


Follow this link to subscribe to future RALI-OLST announcements.
http://rali.iro.umontreal.ca/rali/?q=fr/node/1631

See all the weekly talks for the year:

1991 1992 1993 1994 1995 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024