Optimal Bin Number Selection for Mutual Information Calculation Between EEG and Cardiorhythmogram Signals

Main Article Content

M. A. Zhukov
Anton Oleksandrovich Popov
V. I. Kharytonov
I. A. Chaikovsky

Abstract

In the present work the problem of optimal bin number selection for equidistant Mutual Information (MI) estimator between electroencephalogram (EEG) and cardiorhythmogram (CRG) is addressed. In the previously developed method the bin number selected based on the finding an optimal bin number on the MI values on the range of bin numbers. With application to the real raw EEG and CRG signals it was found that for closely placed or symmetrical channels of EEG data the method can be applied, and the true value of MI value can be found with proposed method. In application to MI calculation between raw EEG and CRG signals that are not significantly coupled, true MI value cannot be estimated with proposed method for small sample size.

Reference 12, figures 4.

Article Details

How to Cite
Zhukov, M. A., Popov, A. O., Kharytonov, V. I., & Chaikovsky, I. A. (2014). Optimal Bin Number Selection for Mutual Information Calculation Between EEG and Cardiorhythmogram Signals. Electronics and Communications, 19(6), 78–81. https://doi.org/10.20535/2312-1807.2014.19.6.113583
Section
Biomedical devices and systems

References

Cover, T.M., Thomas. Elements of information theory / T.M. Cover, Thomas - New York: Wiley, 1991. - ISBN 0471062596 9780471062592.

Doquire, G., Verleysen, M. A Comparison of Multivariate Mutual Information Estimators for Feature Selection / G. Doquire, M. Verleysen - : SciTePress - Science and and Technology Publications, 2012. - ISBN 978-989-8425-98-0, 978-989-8425-99-7.

Freedman, D., Diaconis, P. On the histogram as a density estimator: L 2 theory / D. Freedman, P. Di-aconis // Probability theory and related fields. - 1981. - Vol. 57. - P. 453–476.

Knuth, K.H. Optimal data-based binning for histograms / K.H. Knuth // arXiv preprint physics. - 2006.

Legg, P.A., Rosin, P.L., Marshall, D., Morgan, J.E. Improving accuracy and efficiency of registration by mutual information using Sturges’ histogram rule / P.A. Legg, P.L. Rosin, D. Marshall, J.E. Morgan // Proc. Med. Image Understand. Anal. - 2007. - P. 26–30.

Marek, T., Tichavsky, P. On the estimation of mutual information / T. Marek, P. Tichavsky - , 2008.

Shimazaki, H., Shinomoto, S. A Method for Selecting the Bin Size of a Time Histogram / H. Shima-zaki, S. Shinomoto // Neural Computation. - 2007. - Vol. 19. - P. 1503–1527.

Sorjamaa, A., Hao, J., Lendasse, A. Mutual information and k-nearest neighbors approximator for time series prediction / A. Sorjamaa, J. Hao, A. Lendasse - : Springer, 2005.

Sturges, H.A. The Choice of a Class Interval / H.A. Sturges // Journal of the American Statistical As-sociation. - 1926. - Vol. 21. - P. 65–66.

Suzuki, T., Sugiyama, M., Sese, J., Kanamori, T. Approximating Mutual Information by Maximum Likelihood Density Ratio Estimation / T. Suzuki, M. Sugiyama, J. Sese, T. Kanamori // Journal of Ma-chine Learning Research-Proceedings Track. - 2008. - Vol. 4. - P. 5–20.

Verleysen, M. K-Nearest Neighbours based on Mutual Information for Incomplete Data Classification / M. Verleysen - Bruges, Belgium: , 2008. - ISBN 2930307080 9782930307084.

Zhukov, M., Popov, A. Bin Number Selection for Equidistant Mutual Information Estimaton / M. Zhu-kov, A. Popov - Kyiv, Ukraine:, 2014.