logo

SCIENCE CHINA Technological Sciences, Volume 64 , Issue 9 : 1881-1892(2021) https://doi.org/10.1007/s11431-020-1824-4~

Semi-supervised non-negative Tucker decomposition for tensor data representation

More info
  • ReceivedNov 29, 2020
  • AcceptedMar 26, 2021
  • PublishedJul 26, 2021

Abstract


References

[1] Lee H, Battle A, Raina R, et al. Efficient sparse coding algorithms. In Advances in Neural Information Processing Systems 2007, 801--808. Google Scholar

[2] Li J, Zhou G, Qiu Y. Deep graph regularized non-negative matrix factorization for multi-view clustering. Neurocomputing, 2020, 390: 108-116 CrossRef Google Scholar

[3] Lee D D, Seung H S. Algorithms for non-negative matrix factorization. In Advances in Neural Information Processing Systems, 2001, 556--562. Google Scholar

[4] Zhou G, Zhao Q, Zhang Y. Linked Component Analysis From Matrices to High-Order Tensors: Applications to Biomedical Data. Proc IEEE, 2016, 104: 310-331 CrossRef Google Scholar

[5] Zhou G, Cichocki A, Zhang Y. Group Component Analysis for Multiblock Data: Common and Individual Feature Extraction.. IEEE Trans Neural Netw Learning Syst, 2016, 27: 2426-2439 CrossRef PubMed Google Scholar

[6] Elhamifar E, Vidal R. Sparse subspace clustering. In 2009 IEEE Conference on Computer Vision and Pattern Recognition, 2009, 2790--2797. Google Scholar

[7] Kolda T G, Bader B W. Tensor Decompositions and Applications. SIAM Rev, 2009, 51: 455-500 CrossRef ADS Google Scholar

[8] Cichocki A, Mandic D, De Lathauwer L. Tensor Decompositions for Signal Processing Applications: From two-way to multiway component analysis. IEEE Signal Process Mag, 2015, 32: 145-163 CrossRef ADS arXiv Google Scholar

[9] Cui G C, Zhu L, Gui L H. Multidimensional clinical data denoising via Bayesian CP factorization. Sci China Technol Sci, 2020, 63: 249-254 CrossRef ADS Google Scholar

[10] Zhang J, Li X, Jing P. Low-Rank Regularized Heterogeneous Tensor Decomposition for Subspace Clustering. IEEE Signal Process Lett, 2018, 25: 333-337 CrossRef ADS Google Scholar

[11] Zhao Q, Zhang L, Cichocki A. Bayesian CP Factorization of Incomplete Tensors with Automatic Rank Determination.. IEEE Trans Pattern Anal Mach Intell, 2015, 37: 1751-1763 CrossRef PubMed Google Scholar

[12] Qiu Y, Zhou G, Zhao Q, et al. Comparative study on the classification methods for breast cancer diagnosis. BULL POL ACAD SCI-TE 2018, 66: 841--848 doi: 10.24425/bpas.2018.125931. Google Scholar

[13] Chen X, Zhou G, Wang Y. Accommodating Multiple Tasks' Disparities With Distributed Knowledge-Sharing Mechanism.. IEEE Trans Cybern, 2020, : 1-13 CrossRef PubMed Google Scholar

[14] Yu J, Zhou G, Li C. Low Tensor-Ring Rank Completion by Parallel Matrix Factorization.. IEEE Trans Neural Netw Learning Syst, 2020, : 1-14 CrossRef PubMed Google Scholar

[15] Zhang L, Song L, Du B, et al. Nonlocal low-rank tensor completion for visual data. IEEE Transactions on Cybernetics 2021, 21: 673685, doi: 10.1109/TCYB.2019.29101510. Google Scholar

[16] Zhou G, Cichocki A, Zhao Q. Nonnegative Matrix and Tensor Factorizations : An algorithmic perspective. IEEE Signal Process Mag, 2014, 31: 54-65 CrossRef ADS Google Scholar

[17] Kim Y D, Choi S. Nonnegative tucker decomposition. In 2007 IEEE Conference on Computer Vision and Pattern Recognition, 2007, 1--8. Google Scholar

[18] Zhou G, Cichocki A, Zhao Q. Efficient Nonnegative Tucker Decompositions: Algorithms and Uniqueness. IEEE Trans Image Process, 2015, 24: 4990-5003 CrossRef PubMed ADS arXiv Google Scholar

[19] Yokota T, Zdunek R, Cichocki A. Smooth nonnegative matrix and tensor factorizations for robust multi-way data analysis. Signal Processing, 2015, 113: 234-249 CrossRef Google Scholar

[20] Qiu Y, Zhou G, Zhang Y, et al. Graph Regularized Nonnegative Tucker Decomposition for Tensor Data Representation IEEE International Conference on Acoustics, Speech and Signal Processing, 2019, 8613--8617. Google Scholar

[21] Qiu Y, Zhou G, Wang Y. A Generalized Graph Regularized Non-Negative Tucker Decomposition Framework for Tensor Data Representation.. IEEE Trans Cybern, 2020, : 1-14 CrossRef PubMed Google Scholar

[22] Li X, Ng M K, Cong G. MR-NTD: Manifold Regularization Nonnegative Tucker Decomposition for Tensor Data Dimension Reduction and Representation.. IEEE Trans Neural Netw Learning Syst, 2017, 28: 1787-1800 CrossRef PubMed Google Scholar

[23] Xu Y. Alternating proximal gradient method for sparse nonnegative Tucker decomposition. Math Prog Comp, 2015, 7: 39-70 CrossRef Google Scholar

[24] Wu Q, Zhang L, Cichocki A. Multifactor sparse feature extraction using Convolutive Nonnegative Tucker Decomposition. Neurocomputing, 2014, 129: 17-24 CrossRef Google Scholar

[25] Liu H, Wu Z, Cai D. Constrained Nonnegative Matrix Factorization for Image Representation.. IEEE Trans Pattern Anal Mach Intell, 2012, 34: 1299-1311 CrossRef PubMed Google Scholar

[26] Yi Y, Shi Y, Zhang H. Label propagation based semi-supervised non-negative matrix factorization for feature extraction. Neurocomputing, 2015, 149: 1021-1037 CrossRef Google Scholar

[27] Li Z, Tang J, He X. Robust Structured Nonnegative Matrix Factorization for Image Representation.. IEEE Trans Neural Netw Learning Syst, 2018, 29: 1947-1960 CrossRef PubMed Google Scholar

[28] Hyekyoung Lee , Jiho Yoo , Seungjin Choi . Semi-Supervised Nonnegative Matrix Factorization. IEEE Signal Process Lett, 2010, 17: 4-7 CrossRef ADS Google Scholar

[29] Jing P, Su Y, Li Z. Low-rank regularized tensor discriminant representation for image set classification. Signal Processing, 2019, 156: 62-70 CrossRef Google Scholar

[30] Hu W, Gao J, Xing J. Semi-Supervised Tensor-Based Graph Embedding Learning and Its Application to Visual Discriminant Tracking.. IEEE Trans Pattern Anal Mach Intell, 2017, 39: 172-188 CrossRef PubMed Google Scholar

[31] Dong Xu , Shuicheng Yan . Semi-Supervised Bilinear Subspace Learning. IEEE Trans Image Process, 2009, 18: 1671-1676 CrossRef PubMed ADS Google Scholar

[32] Zhang J, Han Y, Jiang J. Semi-supervised tensor learning for image classification. Multimedia Syst, 2017, 23: 63-73 CrossRef Google Scholar

[33] Ding C, He X, Simon H D. On the equivalence of nonnegative matrix factorization and spectral clustering. In Proceedings of the 2005 SIAM International Conference on Data Mining, 2005, 606--610. Google Scholar

[34] Zhou D, Bousquet O, Lal T, et al. Learning with local and global consistency. Advances in Neural Information Processing Systems, 2003, 16: 321--328. Google Scholar

[35] Fujiwara Y, Irie G. Efficient label propagation. In International Conference on Machine Learning. 2014, 784--792. Google Scholar

[36] Fei Wang , Changshui Zhang . Label Propagation through Linear Neighborhoods. IEEE Trans Knowl Data Eng, 2008, 20: 55-67 CrossRef Google Scholar

[37] Belkin M, Niyogi P. Laplacian eigenmaps and spectral techniques for embedding and clustering. Advances in Neural Information Processing Systems, 2001, 14: 585--591. Google Scholar

[38] ?krjanc I. Pitch Angle Control of Unmanned Air Vehicle with Uncertain System Parameters. J Intell Robot Syst, 2006, 47: 285-297 CrossRef Google Scholar

[39] Roweis S T. Nonlinear Dimensionality Reduction by Locally Linear Embedding. Science, 2000, 290: 2323-2326 CrossRef PubMed ADS Google Scholar

[40] Tian Z, Kuang R. Global linear neighborhoods for efficient label propagation. In Proceedings of the 2012 SIAM International Conference on Data Mining, 2012, 863--872. Google Scholar

[41] Guan N, Tao D, Luo Z. NeNMF: An Optimal Gradient Method for Nonnegative Matrix Factorization. IEEE Trans Signal Process, 2012, 60: 2882-2898 CrossRef ADS Google Scholar

[42] Phan A H, Cichocki A. Extended HALS algorithm for nonnegative Tucker decomposition and its applications for multiway analysis and classification. Neurocomputing, 2011, 74: 1956-1969 CrossRef Google Scholar

[43] Nesterov Y E. A method for solving the convex programming problem with convergence rate o (1/kˆ 2). In Dokl. akad. nauk Sssr, 1983, 269: 543--547. Google Scholar

[44] Nesterov Y. Smooth minimization of non-smooth functions. Math Program, 2005, 103: 127-152 CrossRef Google Scholar

[45] Jiang B, Ding C, Tang J. Image Representation and Learning With Graph-Laplacian Tucker Tensor Decomposition.. IEEE Trans Cybern, 2019, 49: 1417-1426 CrossRef PubMed Google Scholar

[46] Nesterov Y. Introductory lectures on convex optimization: A basic course, volume 87, Springer Science & Business Media 2013. Google Scholar

[47] Yang J, Parikh D, Batra D. Joint unsupervised learning of deep representations and image clusters. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016, 5147--5156. Google Scholar

  • Table 11  

    Table 1Table 1

    Quantitative clustering AC (%), NMI (%) and PUR (%) of different semi-supervised methods on five image data set varying labeling ratio $\tau$

  • Table 22  

    Table 2Table 2

    Quantitative classification ACC (%) using kNN algorithm on five image data set varying labeling ratio $\tau$

qqqq

Contact and support