The Generalization Ability of Online Algorithms for Dependent Data - 2013


We study the generalization performance of online learning algorithms trained on samples coming from a dependent source of data. We show that the generalization error of any stable online algorithm concentrates around its regret-an easily computable statistic of the online performance of the algorithm-when the underlying ergodic process is β- or φ -mixing. We show high-probability error bounds assuming the loss function is convex, and we also establish sharp convergence rates and deviation bounds for strongly convex losses and several linear prediction problems such as linear and logistic regression, least-squares SVM, and boosting on dependent data. In addition, our results have straightforward applications to stochastic optimization with dependent data, and our analysis requires only martingale convergence arguments; we need not rely on more powerful statistical tools such as empirical process theory.

Did you like this research project?

To get this research project Guidelines, Training and Code... Click Here

PROJECT TITLE :Generalization of the Dark Channel Prior for Single Image Restoration - 2018ABSTRACT:Pictures degraded by lightweight scattering and absorption, such as hazy, sandstorm, and underwater pictures, often suffer color
PROJECT TITLE :Real-Time Trajectory Planning for Autonomous Urban Driving: Framework, Algorithms, and VerificationsABSTRACT:This paper focuses on the real-time trajectory planning downside for autonomous vehicles driving in realistic
PROJECT TITLE :Generalization of Pareto-Optimality for Many-Objective Evolutionary OptimizationABSTRACT:The vast majority of multiobjective evolutionary algorithms presented up to now are Pareto-primarily based. Sometimes, these
PROJECT TITLE :Euclidean Distance Matrices: Essential theory, algorithms, and applicationsABSTRACT:Euclidean distance matrices (EDMs) are matrices of the squared distances between points. The definition is deceivingly simple;
PROJECT TITLE :A Study on Relationship Between Generalization Abilities and Fuzziness of Base Classifiers in Ensemble LearningABSTRACT:We tend to investigate essential relationships between generalization capabilities and fuzziness

Ready to Complete Your Academic MTech Project Work In Affordable Price ?

Project Enquiry