1
0
Fork 0
Experimenting with automated classification of text files. The script searches for the most common words in the text and tries to match these words to a category.
Você não pode selecionar mais de 25 tópicos Os tópicos devem começar com uma letra ou um número, podem incluir traços ('-') e podem ter até 35 caracteres.
 
rita 29636e5764 Upload files to '' 4 anos atrás
1600px-Common_words.png Upload files to '' 4 anos atrás
README.md Upload files to '' 4 anos atrás
anarchist_cookbook.txt files 5 anos atrás
categorization.py files 5 anos atrás
example.png files 5 anos atrás
fifty_shades.txt files 5 anos atrás
library_studies.txt files 5 anos atrás
lolita.txt files 5 anos atrás
mein_kampf.txt files 5 anos atrás
own_nothing.txt files 5 anos atrás
prideandprejudice.txt files 5 anos atrás
stopwords.txt files 5 anos atrás

README.md

Categorisation of text files

The actions of categorising and cataloging happen in the most mundane activities, but they are not innocent. They translate values and certain visions of the world.

In the Rietveld Academy Library, we saw how the librarians are challenging the Library of Congress classification. With Dušan we browsed in the Monoskop Index, an interesting combination of a “book index, library catalog, and tag cloud”.

With this script, I was experimenting with an automated classification of text files. The script searches for the three most common words in the text and tries to match these words to a category. For example, if one of the most common words is “books” the category of the text is considered “Library Studies”. The same would happen with the word “archives”, “author”, “bibliographic”, “bibliotheca”, “book”, “bookcase”, etc. The script only has one category right now, but it would be easy to add more. By doing so, I would be making associations that are very personal, sometimes inaccurate, and I would be creating a bias in the catalog.

Stopwords image