Research on the Application of Random Forest Algorithm in High-Dimensional Nonlinear System Prediction

Authors

  • Peng Yang
  • Kezuo Wu
  • Ziming Wang

DOI:

https://doi.org/10.54097/ky8vry29

Keywords:

Random forest algorithm; cross-entropy loss function; logistic regression model; high-dimensional nonlinear data.

Abstract

This study constructs a predictive model based on the random forest algorithm, focusing on the challenge of predicting outcomes in complex systems. The research first performs time-series structured organization of historical data and extracts key features. A dynamic time-segmentation strategy is employed to divide the dataset into training and testing sets. Model parameters are optimized using information gain calculations and the cross-entropy loss function, enabling efficient capture of nonlinear relationships in high-dimensional data. The model uses key variables such as quantitative features and trend changes as inputs for predictive analysis, and incorporates a logistic regression model to hierarchically refine the results, forming a multi-model collaborative predictive framework. This study leverages the complementary advantages of multi-dimensional data processing workflows and algorithms to establish a predictive framework tailored for complex systems. It demonstrates significant adaptability in high-dimensional nonlinear data scenarios, providing a methodological framework with both theoretical value and practical significance for predictive analysis and feature variable impact assessment in similar complex systems.

Downloads

Download data is not yet available.

References

[1] Yang Yanping, Li Rong. Feature Selection for High-Dimensional Data Classification Based on Machine Learning [J]. Journal of Hunan University of Science and Technology (Natural Science Edition), 2025, 37 (01): 23-31.

[2] Che Zhihong, Lyu Feng. Research on Ensemble Algorithms Based on Random Forest [J]. Computer Programming Techniques and Maintenance, 2024, (05): 48-50+80.

[3] Zhang Kunbin, Chen Yuming, Wu Kesheng, et al. Research on Granular Vector-Driven Random Forest Classification Algorithm [J]. Computer Engineering and Applications, 2024, 60 (03): 148-156.

[4] Liu Kaiyuan. Application of Random Forest and Logistic Regression Models in Default Prediction [J]. Information and Computers (Theoretical Edition), 2016, (21): 111-112.

[5] Zhou Yunhao, Yang Baojie, Liu Dan, et al. Prediction Analysis Modeling and Simulation of Power Engineering Data Based on Random Forest Algorithm [J]. Electronic Design Engineering, 2024, 32 (04): 103-106+111.

[6] Chen Xi. A Study on the Evaluation Model of Volleyball Training Effectiveness Based on Information Gain and Random Forest Algorithm [J]. Journal of Kashgar University, 2024, 45 (06): 79-84.

Downloads

Published

26-08-2025

How to Cite

Yang, P., Wu, K., & Wang, Z. (2025). Research on the Application of Random Forest Algorithm in High-Dimensional Nonlinear System Prediction. Highlights in Science, Engineering and Technology, 152, 49-55. https://doi.org/10.54097/ky8vry29