Skip to content

toth235a/gutenberg-text-classification

BranchesTags

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
chunkified
chunkified
 
 
embeddings
embeddings
 
 
rawtext
rawtext
 
 
stripped_filtered
stripped_filtered
 
 
test
test
 
 
valid1
valid1
 
 
valid2
valid2
 
 
valid3
valid3
 
 
valid4
valid4
 
 
.DS_Store
.DS_Store
 
 
00 File overview.ipynb
00 File overview.ipynb
 
 
01 Text selection and download.ipynb
01 Text selection and download.ipynb
 
 
02 Text cleanup and data exploration.ipynb
02 Text cleanup and data exploration.ipynb
 
 
03 Further data exploration and chunking.ipynb
03 Further data exploration and chunking.ipynb
 
 
04 Creation of train and test sets.ipynb
04 Creation of train and test sets.ipynb
 
 
05 Feature extraction.ipynb
05 Feature extraction.ipynb
 
 
06 PCA, Logistic regression and random forest, neural networks, error analysis, conclusions.ipynb
06 PCA, Logistic regression and random forest, neural networks, error analysis, conclusions.ipynb
 
 
README.md
README.md
 
 
adam_toth_epfl_ml2.yml
adam_toth_epfl_ml2.yml
 
 
gutenbergindex.db.zip
gutenbergindex.db.zip
 
 
logreg_model.sav
logreg_model.sav
 
 
no_dupl.csv
no_dupl.csv
 
 
results_df.csv
results_df.csv
 
 
sel_gut_df.csv
sel_gut_df.csv
 
 
too_big.pkl
too_big.pkl
 
 

Repository files navigation

The environment is in the adam_toth_epfl_ml2.yml file (I used python 3.10.9). The french spacy model has to be installed with python -m spacy download fr_core_news_lg. An overview of the files in 00 File overview.ipynb.

About

No description, website, or topics provided.

Resources

Readme
Activity

Stars

0 stars

Watchers

1 watching

Forks

0 forks
Report repository

Releases

No releases published

Packages

No packages published

Languages