• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
  • Skip to footer

Center for Artificial Intelligence and Cybersecurity – AIRI

  • Home
  • About Us
    • Vision, Mission and Goals
    • Center Activities
    • Center Faculty
    • Steering Committee
    • Press
  • Research
    • Scientific Projects
    • Research Papers
  • Laboratories
    • Machine Learning
    • Natural Speech & Language Processing
    • Blockchain Technology
    • Information Processing & Pattern Recognition
    • AI in Medicine
    • Data Mining
    • Computer Vision
    • Complex Networks
    • Human-Computer Interaction
    • Maritime Cybersecurity
    • Autonomous Navigation
    • AI in Mechatronics
    • AI in Education
    • Hybrid Computational Methods
    • Drug Design
    • Legal Aspects of AI
    • Ethically Aligned AI
    • Cultural Complexity
  • Collaboration
    • Industry Collaboration
    • Industry Projects
    • International Collaboration
  • News
  • Contact

The Influence of Feature Representation of Text on the Performance of Document Classification

28.02.2019

In this paper we perform a comparative analysis of three models for a feature representation of text documents in the context of document classification. In particular, we consider the most often used family of bag-of-words models, the recently proposed continuous space models word2vec and doc2vec, and the model based on the representation of text documents as language networks. While the bag-of-word models have been extensively used for the document classification task, the performance of the other two models for the same task have not been well understood. This is especially true for the network-based models that have been rarely considered for the representation of text documents for classification. In this study, we measure the performance of the document classifiers trained using the method of random forests for features generated with the three models and their variants. Multi-objective rankings are proposed as the framework for multi-criteria comparative analysis of the results. Finally, the results of the empirical comparison show that the commonly used bag-of-words model has a performance comparable to the one obtained by the emerging continuous-space model of doc2vec. In particular, the low-dimensional variants of doc2vec generating up to 75 features are among the top-performing document representation models. The results finally point out that doc2vec shows a superior performance in the tasks of classifying large documents.

Authors:
Sanda Martinčić-Ipšić, Tanja Miličić, Ljupčo Todorovski
Journal:
Applied Sciences
Publishing date:
20.02.2019
View original article

Primary Sidebar

Latest Projects

ABsistemDCiCloud

Machine Learning for Knowledge Transfer in Medical Radiology

Estimating River Discharges in Highly Stratified Estuaries

Multilayer Framework for the Information Spreading Characterization in Social Media during the COVID-19 Crisis (InfoCoV)

European Network for assuring food integrity using non-destructive spectral sensors

Latest Research Papers

Neural Natural Language Generation: A Survey on Multilinguality, Multimodality, Controllability and Learning

Entropy-Based Concentration and Instantaneous Frequency of TFDs from Cohen’s, Affine, and Reassigned Classes

Coupled encoding methods for antimicrobial peptide prediction: How sensitive is a highly accurate model?

The Choice of Time–Frequency Representations of Non-Stationary Signals Affects Machine Learning Model Accuracy: A Case Study on Earthquake Detection from LEN-DB Data

Improved Parametrized Multiple Window Spectrogram with Application in Ship Navigation Systems

Latest News

Assoc. prof. Jonatan Lerga received the Croatian Academy of Sciences and Arts award

Dr. Sc. Nikola Lopac successfully defended his doctoral dissertation

Presentation at the conference “Digital Innovation and Technology for People”

Assoc. prof. dr. sc. Jonatan Lerga presented AIRI Center at the IEEE Rijeka : Computer Society Congress 2021

Prof. dr. sc. Ana Mestrovic participated at the Panel on perspectives and real-life applications of AI organized by IEEE Technology and Engineering Management Society

We provide the expertise for solving real world problems using AI

If your company wants to implement artificial intelligence in your products or services, or increase your level of cybersecurity, our multidisciplinary team of scientists is your ideal partner.

Contact us

Footer

Center for Artificial Intelligence and Cybersecurity
  • jlerga@airi.uniri.hr
  • +385 51 406 500

University of Rijeka

University of Rijeka

About the Center

  • About Us
  • News
  • Privacy Policy
  • Contact

Center Activities

  • Laboratories
  • Scientific Projects
  • Industry Projects
  • Research Papers
  • Industry Collaboration
  • International Collaboration

Footer bottom left

© 2020 Center for Artificial Intelligence and Cybersecurity, all rights reserved.

Designed & developed by Nela Dunato Art & Design