Fast-And-Accurate-Text-Classification-Reproduction

• Chosen paper: FAST AND ACCURATE TEXT CLASSIFICATION: SKIMMING, REREADING AND EARLY STOPPING
• Referenced paper: LEARN TO SKIM

Introduction

We implement two baseine models and the proposed model from the chosen paper and two variation models which use the reward definition from the referenced paper LEARN TO SKIM for the use of comparison. IMDB dataset is used.

Models in the paper:

• whole reading model
• early stopping model
• skim, reread and early stopping

Models for comparison:

• early stopping model with different reward
• skim, reread and early stopping with different reward

Requirement

see file requirements.txt

Usage

python [model_name.py] [--parameter value]

--seed  # random seed
--alpha # trade off between efficiency(computation cost measured in FLOPs) and accuracy
--gamma # discount factor

Example:

python whole_reading.py
python whole_reading.py --seed 2019
python skim_reread_es_main.py --alpha 0.2 --gamma 0.95

Notes

We are still testing the whole_reading.py, currently it tends to breakdown with the error:"out of memory". Therefore we have provided a jupyter_notebook version which runs correctly under Google Colab with GPU turned on.