LSTSVR+: Least square twin support vector regression with privileged information

Abstract

In an educational setting, a teacher plays a crucial role in various classroom teaching patterns. Similarly, mirroring this aspect of human learning, the learning using privileged information (LUPI) paradigm introduces additional information to instruct learning models during the training stage. A different approach to train the twin variant of the regression model is provided by the new least square twin support vector regression using privileged information (LSTSVR+). It integrates the LUPI paradigm to utilize additional sources of information into the least square twin support vector regression. The proposed LSTSVR+ solves system of linear equations which adds up to the efficiency of the model. Further, we also establish a generalization error bound based on the Rademacher complexity of the proposed LSTSVR+ and incorporate the structural risk minimization principle. The proposed LSTSVR+ fills the gap between the contemporary paradigm of LUPI and classical LSTSVR. Further, to assess the performance of the proposed model, we conduct numerical experiments along with the baseline models across artificially generated datasets and 21 real-world datasets. The various experiments and statistical analysis infer the superiority of the proposed model. Moreover, the proposed LSTSVR+ outperforms baseline models in real-world applications on time-series datasets. The link for the code of the proposed LSTSVR+ is as follows: https://github.com/mtanveer1/LSTSVR-plus. © 2024 Elsevier Ltd