• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
  • Skip to footer

Center for Artificial Intelligence and Cybersecurity – AIRI

  • Home
  • About Us
    • Vision, Mission and Goals
    • Center Activities
    • Center Faculty
    • Steering Committee
    • Press
  • Research
    • Scientific Projects
    • Research Papers
  • Laboratories
    • Machine Learning
    • Natural Speech & Language Processing
    • Blockchain Technology
    • Information Processing & Pattern Recognition
    • AI in Medicine
    • Data Mining
    • Computer Vision
    • Complex Networks
    • Human-Computer Interaction
    • Maritime Cybersecurity
    • Autonomous Navigation
    • AI in Mechatronics
    • AI in Education
    • Hybrid Computational Methods
    • Drug Design
    • Legal Aspects of AI
    • Ethically Aligned AI
    • Cultural Complexity
  • Collaboration
    • Industry Collaboration
    • Industry Projects
    • International Collaboration
  • News
  • Contact

Intra-domain and cross-domain transfer learning for time series data—How transferable are the features?

12.01.2022

In practice, it is very challenging and sometimes impossible to collect datasets of labelled data large enough to successfully train a machine learning model, and one possible solution to this problem is using transfer learning. In this study, we investigate how transferable are features between different domains of time series data and under what conditions. The effects of transfer learning are observed in terms of the predictive performance of the models and their convergence rate during training. In our experiment, we used reduced datasets of 1500 and 9000 data instances to mimic real-world conditions. We trained two sets of models (four different architectures) on the reduced datasets: those trained with transfer learning and those trained from scratch. Knowledge transfer was performed both within the same application domain (seismology) and between different application domains (seismology, speech, medicine, finance). We observed the prediction performance of the models and their training convergence rate. We repeated the experiments seven times and applied statistical tests to confirm the validity of the results. The overall conclusion of our study is that transfer learning is highly likely to either increase or not negatively affect the model’s predictive performance or its training convergence rate. We discuss which source and target domains are compatible for knowledge transfer. We also discuss the effect of the target dataset size and the choice of the model and its hyperparameters on transfer learning.

Authors:
Erik Otović, Marko Njirjak, Dario Jozinović, Goran Mauša, Alberto Michelini, Ivan Štajduhar
Journal:
Knowledge-Based Systems
Publishing date:
05.03.2022
View original article

Primary Sidebar

Latest Projects

ABsistemDCiCloud

Machine Learning for Knowledge Transfer in Medical Radiology

Estimating River Discharges in Highly Stratified Estuaries

Multilayer Framework for the Information Spreading Characterization in Social Media during the COVID-19 Crisis (InfoCoV)

European Network for assuring food integrity using non-destructive spectral sensors

Latest Research Papers

Neural Natural Language Generation: A Survey on Multilinguality, Multimodality, Controllability and Learning

Entropy-Based Concentration and Instantaneous Frequency of TFDs from Cohen’s, Affine, and Reassigned Classes

Coupled encoding methods for antimicrobial peptide prediction: How sensitive is a highly accurate model?

The Choice of Time–Frequency Representations of Non-Stationary Signals Affects Machine Learning Model Accuracy: A Case Study on Earthquake Detection from LEN-DB Data

Improved Parametrized Multiple Window Spectrogram with Application in Ship Navigation Systems

Latest News

Assoc. prof. Jonatan Lerga received the Croatian Academy of Sciences and Arts award

Dr. Sc. Nikola Lopac successfully defended his doctoral dissertation

Presentation at the conference “Digital Innovation and Technology for People”

Assoc. prof. dr. sc. Jonatan Lerga presented AIRI Center at the IEEE Rijeka : Computer Society Congress 2021

Prof. dr. sc. Ana Mestrovic participated at the Panel on perspectives and real-life applications of AI organized by IEEE Technology and Engineering Management Society

We provide the expertise for solving real world problems using AI

If your company wants to implement artificial intelligence in your products or services, or increase your level of cybersecurity, our multidisciplinary team of scientists is your ideal partner.

Contact us

Footer

Center for Artificial Intelligence and Cybersecurity
  • jlerga@airi.uniri.hr
  • +385 51 406 500

University of Rijeka

University of Rijeka

About the Center

  • About Us
  • News
  • Privacy Policy
  • Contact

Center Activities

  • Laboratories
  • Scientific Projects
  • Industry Projects
  • Research Papers
  • Industry Collaboration
  • International Collaboration

Footer bottom left

© 2020 Center for Artificial Intelligence and Cybersecurity, all rights reserved.

Designed & developed by Nela Dunato Art & Design