Skip to content

jiachengc/595_Final_Project

Repository files navigation

595_Final_Project

Description

With the development of Deep learning and transformer, Question and Answer(QA) task is one of the research area that have major break- through over the past years. Most popular natu- ral language understanding(NLU) models only perform well on English, however the language model often struggle when the input data are In- dia languages, like Hindi and Tamil. To address this research gap, Google research team intro- duced the chaii dataset which contains thou- sands of Hindi and Tamil questions and corre- sponding answers driven from Wikipedia. In this paper, we explore three different models to benchmark on this task: Hindi and Tamil Ques- tion Answering, and also use the advanced pre- process technique and fusion layer to increase the generalization of models. For evaluation, we can achieved 0.796 (best) Jaccard score on the answer prediction, which is much better than the original baseline result.

alt text

Dependencies needed

We run all of our codes on python3.8 with pytorch 1.9. In addition, you should also install packages such as pandas, numpy, sklearn, transformer, tqdm.

How to run each codes

For all data, we have processed them and save them into a google drive: https://drive.google.com/file/d/1vCLY72Vc0UIWPLHSM6hyghQ6BuQylXKR/view?usp=sharing

For each model training, you can directly run it if you install all required packages. It will require a relatively long time. For different experiments, we just change some parameters inside it. For the inference, you should put all checkpoint files together and change the path in the inference file and then you can run it.

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published