A Partial Functional Gaussian Process Regression Model Based on Additive Structure

Authors

  • Zunming Shen
  • Yijie Wang
  • Bowei Cui

DOI:

https://doi.org/10.54097/5wwdt705

Keywords:

Gaussian process, additive model, functional data analysis.

Abstract

A partially functional linear model is a widely studied and used method whose response variables are related to both vector-valued and functional predictors. However, due to the constraints of linear structure, the model lacks some flexibility. Based on this, this paper proposes a partial functional Gaussian process regression model. On the one hand, the proposed method uses truncation rule to approximate the functional predictors. Then, the different predictors are mapped into a unified regenerated kernel Hilbert space (RKHS) for modeling using kernel techniques. By assigning a priori of additive structure to the Gaussian process and orthogonalizing the kernel function, this paper uses Sobol index to measure the importance of each prediction component's influence on the prediction of response variables. In addition to quantifying the uncertainty of predictions, the proposed method enables joint modeling of non-Euclidean predictors and response variables by selecting appropriate kernels for non-Euclidean spaces. Both simulation studies and empirical data analyses demonstrate that the proposed approach exhibits strong competitiveness compared to several classical predictive methods.

Downloads

Download data is not yet available.

References

[1] Hussain, J. (2020). High dimensional data challenges in estimating multiple linear regression. Journal of Physics: Conference Series, 1591.

[2] Tran, A., Maupin, K., Mishra, A., Hu, Z., & Hu, C. (2023). Additive Gaussian Process Regression for Metamodeling in High-Dimensional Problems. Volume 2: 43rd Computers and Information in Engineering Conference (CIE).

[3] Yu, P., Du, J., & Zhang, Z. (2020). Single-index partially functional linear regression model. Statistical Papers, 61, 1107-1123.

[4] Zhu, R., Zhou, G., &Zhang, X. (2018). Optimal Model Average Estimation for Partial Functional Linear Models. System Science and Mathematics Sciences, 38(07):777-800.

[5] Schonlau, M., & Zou, R. (2020). The random forest algorithm for statistical learning. The Stata Journal, 20, 29 - 3.

[6] Zhang, P., Jia, Y., & Shang, Y. (2022). Research and application of XGBoost in imbalanced data. International Journal of Distributed Sensor Networks, 18.

[7] Pham, H., & Ólafsson, S. (2019). Bagged ensembles with tunable parameters. Computational Intelligence, 35, 184 - 203. Li, X., Yuan, C., & Shan, B. (2020). System Identification of Neural Signal Transmission Based on Backpropagation Neural Network. Mathematical Problems in Engineering, 2020, 1-8.

[8] Yu, Y., Si, X., Hu, C., & Zhang, J. (2019). A Review of Recurrent Neural Networks: LSTM Cells and Network Architectures. Neural Computation, 31, 1235-1270.

[9] Wu, R., & Wang, B. (2018). Gaussian process regression method for forecasting of mortality rates. Neurocomputing, 316, 232-239.

[10] Kopsiaftis, G., Protopapadakis, E., Voulodimos, A., Doulamis, N., & Mantoglou, A. (2019). Gaussian Process Regression Tuned by Bayesian Optimization for Seawater Intrusion Prediction. Computational Intelligence and Neuroscience, 2019.

[11] Buelta, A., Olivares, A., Staffetti, E., Aftab, W., & Mihaylova, L. (2021). A Gaussian Process Iterative Learning Control for Aircraft Trajectory Tracking. IEEE Transactions on Aerospace and Electronic Systems, 57, 3962-3973.

[12] Pfingstl, S., Braun, C., Nasrollahi, A., Chang, F., & Zimmermann, M. (2022). Warped Gaussian processes for predicting the degradation of aerospace structures. Structural Health Monitoring, 22, 2531 - 2546.

Downloads

Published

25-02-2025

How to Cite

Shen, Z., Wang, Y., & Cui, B. (2025). A Partial Functional Gaussian Process Regression Model Based on Additive Structure. Highlights in Science, Engineering and Technology, 128, 1-13. https://doi.org/10.54097/5wwdt705