PROJECT TITLE :

Study on the Impact of Partition-Induced Dataset Shift on $k$-Fold Cross-Validation

ABSTRACT:

Cross-validation is a very commonly used technique used to judge classifier performance. But, it can doubtless introduce dataset shift, a harmful factor that's often not taken into account and can end in inaccurate performance estimation. This paper analyzes the prevalence and impact of partition-induced covariate shift on totally different $k$-fold cross-validation schemes. From the experimental results obtained, we conclude that the degree of partition-induced covariate shift depends on the cross-validation scheme considered. During this way, worse schemes may hurt the correctness of one-classifier performance estimation and conjointly increase the required number of repetitions of cross-validation to reach a stable performance estimation.


Did you like this research project?

To get this research project Guidelines, Training and Code... Click Here

PROJECT TITLE : Millimeter-Wave Base Stations in the Sky: An Experimental Study of UAV-to-Ground Communications ABSTRACT: In this paper, a systems approach is taken to investigate how millimeter wave (mmWave) radio transmitters
PROJECT TITLE : Toward Predicting Active Participants in Tweet Streams A case study on Two Civil Rights Events ABSTRACT: In recent years, there has been a lot of interest in the field of research surrounding online social media.
PROJECT TITLE : Meta-Learning in Neural Networks A Survey ABSTRACT: In recent years, there has been a notable uptick in people's interest in the study of meta-learning, also known as learning how to learn. Meta-learning, on the
PROJECT TITLE : From Handcrafted to Deep Features for Pedestrian Detection A Survey ABSTRACT: Detecting pedestrians is an important but difficult problem in the field of computer vision, particularly in activities that are focused
PROJECT TITLE : Toward Predicting Active Participants in Tweet Streams: A Case Study on Two Civil Rights Events ABSTRACT: In recent years, there has been a lot of interest in the field of research surrounding online social media.