Extracting a reliable signal from heterogeneous data
Journal Title: Modern Innovations, Systems and Technologies - Year 2024, Vol 4, Issue 1
Abstract
The article is devoted to the study of extracting a common reliable signal from data divided into heterogeneous groups. A soft maximum estimate of the maximum value is proposed as a computationally attractive alternative aimed at achieving a balance between a combined estimate and a (hard) estimate of the maximum value. The problem of extracting a common signal from heterogeneous data is considered. Since heterogeneity prevails in large-scale systems, the goal is a computationally efficient estimator (solution) with good statistical proper-ties with varying degrees of data heterogeneity. Using this estimate can lead to more reliable estimates for heterogeneous data compared to an estimate that does not take into account grouping, that is, a combined estimate. In large-scale data processing systems, where data heterogeneity is usually found, the computational aspect of evaluation is crucial. In substantiation of this thesis, the article provides an analysis of the effectiveness of soft maximum estimation for approval of large-scale data processing systems, confirming the effectiveness of the applied method. In summary soft maximin estimation will be practically useful in a number of different contexts, as a way of aggregating explained variances across groups.
Authors and Affiliations
D. I. Atlasov, O. Ja. Kravets
Keywords
Related Articles
- EP ID EP755328
- DOI 10.47813/2782-2818-2024-4-1-0122-0132
- Views 15
- Downloads 0
Extracting a reliable signal from heterogeneous data
The article is devoted to the study of extracting a common reliable signal from data divided into heterogeneous groups. A soft maximum estimate of the maximum value is proposed as a computationally attractive alternative...
Exploring collaborative filtering through K-Nearest Neighbors and Non-Negative Matrix Factorization
Collaborative filtering (CF) algorithms have received a lot of interest in recommender systems due to their ability to give personalized recommendations by exploiting user-item interaction data. In this article, we explo...
Study of methods of segmentation and detection of objects in the image in real time to prevent accidents of Russian Railways
With the development of the railway industry, the informatization of society and the automation of many technological processes, it becomes possible to create a complexof automatic control, diagnos...
Pressures during roller squeezing of leather
With the solution of contact and hydraulic problems of roller squeezing of leather, mathematical models of the patterns of distribution of normal stress and hydraulic squeezers during roller squeezing of leather were obt...
To plant molluscocide production technology
Currently, the vast range of helminthoses of farm fish and animals is causing significant economic damage. Effective prevention is an important element in the fight against these diseases. An effective method of preventi...