Iranian Journal of Information Processing and Management

Iranian Journal of Information Processing and Management

Improving data quality in a network of optimizers

Document Type : Original Article

Authors
Tahereh Bahraini 1
Alireza Naeimi Sadigh 2
1 -Postdoctorate in Electrical Engineering; Sharif University of Technology-Doctorate
2 Semnan University, Computer Faculty
10.22034/jipm.2024.2005788.1236
Abstract
: In the process of data generation or transmission, the quality of data may degrade and not meet the required level for subsequent processing steps. Improving data quality is one of the crucial steps that needs to be taken to obtain accurate information hidden within the data in any field. Researchers have proposed various methods to perform this process, which differ based on the type of data. However, it is important to note that often these methods do not consider the existing similarities in different dimensions of the data simultaneously. This can have an undesirable or detrimental impact on certain parts of the data and may not improve the damaged segments. As a result, the obtained output will not contain all the desired information. In this paper, a new method is introduced in which data quality improvement is carried out using a set of collaborative nodes in an interactive network structure. This method enhances resistance against various types of degradation by employing a set of nodes. The performance of the proposed method is compared with six other state-of-the-art data quality improvement methods on real degraded datasets. The results obtained from the simulation show that the proposed method outperforms the other compared methods.
Keywords
Image denoising
hyperspectral images
interactive denoising
distributed filter network
hybrid noise
Subjects
شریفی، فرشته، امین ترابی جهرمی، و احمد کشاورز. 1400. ترکیب شبکه عصبی فازی پویا و مدل‏های پیش‏آموزش‏دیده شبکه عصبی کانولوشن به‏منظور طبقه‏بندی تصاویر فراطیفی. ‏چهارمین کنفرانس بین‏المللی محاسبات نرم، گیلان، دانشگاه گیلان.
https://civilica.com/doc/1418634 (دستیابی در‏ 24/12/1400)
صادقی، وحید. 1401. کاهش بعد تصاویر سنجش از دور فراطیفی با تخمین گرهای Hysime و Kmeans، نهمین کنفرانس ملی توسعه پایدار در مهندسی عمران. تهران. جامعه و مرکز راهکارهای دستیابی به توسعه پایدار
https://civilica.com/doc/1524059  (دستیابی در 6-/7/1401)
حسنی‏مقدم، حسن، علی‏اصغر تراهی، و پرویز ضیاییان فیروزآبادی. 1399. ادغام تصاویر فراطیفی با تصاویر دارای قدرت تفکیک مکانی بالا بر پایه سطوح مختلف تبدیل موجک گسسته‏هار. فصلنامه کاربرد سیستم اطلاعات جغرافیایی و سنجش از دور در برنامه‏ریزی 11 (4):؟‏.
https://civilica.com/doc/1225674 (دستیابی در: 17/3/1400)
جواهری، سامان، و علی‏اصغر تراهی و سید محمد توکلی صبور. 1399. شناسایی اهداف با استفاده از تلفیق تصاویر فراطیفی و تصاویر با قدرت تفکیک مکانی بالا فصلنامه کاربرد سیستم اطلاعات جغرافیایی و سنجش از دور در برنامه‏ریزی 11 (1):؟.
https://civilica.com/doc/1140139 (دستیابی در بهار 1399)
References:
Bahraini, T., M. Khademi, A. Ebrahimi-moghadam and H. Sadoghi Yazdi. 2021. Variational Bayesian inference in Noise Removal from Hyperspectral Images Using Cluster-Based Latent Variables. Nashriyyah-i Muhandisi-i Barq va Muhandisi-i Kampyutar-i Iran 80 (2): 85.
Bishop, Christopher M., and Nasser M. Nasrabadi. 2006. Pattern recognition and machine learning. Spring 4 (4): ?.
Bollenbeck, Felix, Andreas Backhaus, and Udo Seiffert. 2011. A multivariate wavelet-PCA denoising-filter for hyperspectral images. In 2011 3rd Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS), pp. 1-4. Lisbon, Portugal.
Buades, Antoni, Bartomeu Coll, and J-M. Morel. 2005. A non-local algorithm for image denoising. In 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR'05), vol. 2, pp. 60-65. Ieee. San Diego, CA, USA.
Cattivelli, Federico S., and Ali H. Sayed. 2009. Diffusion LMS strategies for distributed estimation. IEEE transactions on signal processing 58 (3): 1035-1048.
Chang, Chien-I., and Qian Du. 1999. Interference and noise-adjusted principal components analysis. IEEE transactions on geoscience and remote sensing 37 (5): 2387-2396.
Chen, Guangyi, and Shen-En Qian. 2008. Simultaneous dimensionality reduction and denoising of hyperspectral imagery using bivariate wavelet shrinking and principal component analysis. Canadian Journal of Remote Sensing 34 (5): 447-454.
_____. 2010. Denoising of hyperspectral imagery using principal component analysis and wavelet shrinkage. IEEE Transactions on Geoscience and remote sensing 49 (3): 973-980.
Chen, Guangyi, and W-P. Zhu. 2012. Signal denoising using neighbouring dual-tree complex wavelet coefficients. IET signal processing 6 (2): 143-147.
Chen, Shao-Lin, Xi-Yuan Hu, and Si-Long Peng. 2012. Hyperspectral imagery denoising using a spatial-spectral domain mixing prior. Journal of computer science and technology 27 (4): 851-861.
Dabov, Kostadin, Alessandro Foi, Vladimir Katkovnik, and Karen Egiazarian. 2007. Image denoising by sparse 3-D transform-domain collaborative filtering. IEEE Transactions on image processing 16 (8): 2080-2095.
Dabov, Kostadin, Alessandro Foi, Vladimir Katkovnik, and Karen Egiazarian. 2007. Image denoising by sparse 3-D transform-domain collaborative filtering. IEEE Transactions on image processing 16 (8): 2080-2095.
Elad, Michael, and Michal Aharon. 2006. Image denoising via sparse and redundant representations over learned dictionaries. IEEE Transactions on Image processing 15 (12): 3736-3745.
Ely, Gregory, Shuchin Aeron, and Eric L. Miller. 2013. Exploiting structural complexity for robust and rapid hyperspectral imaging. In 2013 IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 2193-2197. Vancouver, British Columbia, Canada.
Fan, Fan, Yong Ma, Chang Li, Xiaoguang Mei, Jun Huang, and Jiayi Ma. 2017. Hyperspectral image denoising with superpixel segmentation and low-rank representation. Information Sciences 397: 48-68.
 Green, Andrew A., Mark Berman, Paul Switzer, and Maurice D. Craig. 1988. A transformation for ordering multispectral data in terms of image quality with implications for noise removal. IEEE Transactions on geoscience and remote sensing 26 (1): 65-74.
He, Wei, Hongyan Zhang, Liangpei Zhang, and Huanfeng Shen. 2014. A noise-adjusted iterative randomized singular value decomposition method for hyperspectral image denoising. In 2014 IEEE Geoscience and Remote Sensing Symposium, pp. 1536-1539. Quebec City, Quebec, Canada.
He, Wei, Hongyan Zhang, Liangpei Zhang, and Huanfeng Shen. 2015. Total-variation-regularized low-rank matrix factorization for hyperspectral image restoration. IEEE transactions on geoscience and remote sensing 54 (1): 178-188.
Hu, Ting, Hongyan Zhang, Huanfeng Shen, and Liangpei Zhang. 2014. Robust registration by rank minimization for multiangle hyper/multispectral remotely sensed imagery. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 7 (6): 2443-2457.
Karami, Azam, Mehran Yazdi, and Alireza Zolghadre Asli. 2011. Noise reduction of hyperspectral images using kernel non-negative tucker decomposition. IEEE Journal of Selected Topics in Signal Processing 5 (3): 487-493.
Letexier, Damien, and Salah Bourennane. 2008. Noise removal from hyperspectral images by multidimensional filtering. IEEE Transactions on Geoscience and Remote Sensing 46 (7): 2061-2069.
Li, Qian, Houqiang Li, Zhenbo Lu, Qingbo Lu, and Weiping Li. 2014. Denoising of hyperspectral images employing two-phase matrix decomposition. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 7 (9): 3742-3754.
Lin, Tao, and Salah Bourennane. 2012. Hyperspectral image processing by jointly filtering wavelet component tensor. IEEE Transactions on Geoscience and Remote Sensing 51 (6): 3529-3541.
Liu, Ji, Przemyslaw Musialski, Peter Wonka, and Jieping Ye. 2012. Tensor completion for estimating missing values in visual data. IEEE transactions on pattern analysis and machine intelligence 35 (1): 208-220.
Liu, Licheng, Long Chen, CL Philip Chen, and Yuan Yan Tang. 2016. Weighted joint sparse representation for removing mixed noise in image. IEEE transactions on cybernetics 47 (3): 600-611.
Liu, Xuefeng, Salah Bourennane, and Caroline Fossati. 2011. Nonwhite noise reduction in hyperspectral images. IEEE Geoscience and Remote Sensing Letters 9 (3): 368-372.
Liu, Xuefeng, Salah Bourennane, and Caroline Fossati. 2012. Denoising of hyperspectral images using the PARAFAC model and statistical performance analysis. IEEE Transactions on Geoscience and Remote Sensing 50 (10): 3717-3724.
Maggioni, Matteo, Vladimir Katkovnik, Karen Egiazarian, and Alessandro Foi. 2012. Nonlocal transform-domain filter for volumetric data denoising and reconstruction. IEEE transactions on image processing 22 (1): 119-133.
Martin-Herrero, Julio. 2007. Anisotropic diffusion in the hypercube. IEEE Transactions on Geoscience and Remote Sensing 45 (5): 1386-1398.
Meng, Deyu, Zongben Xu, Lei Zhang, and Ji Zhao. 2013. A cyclic weighted median method for l1 low-rank matrix factorization with missing entries. In Proceedings of the AAAI Conference on Artificial Intelligence, vol. 27, no. 1, pp. 704-710. Washington, USA.
Othman, Hisham, and Shen-En Qian. 2006. Noise reduction of hyperspectral imagery using hybrid spatial-spectral derivative-domain wavelet shrinkage. IEEE Transactions on Geoscience and Remote Sensing 44 (2): 397-408.
Peng, Yi, Deyu Meng, Zongben Xu, Chenqiang Gao, Yi Yang, and Biao Zhang. 2014. Decomposable nonlocal tensor dictionary learning for multispectral image denoising. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2949-2956. OH, USA.
Rasti, Behnood, Johannes R. Sveinsson, and Magnus Orn Ulfarsson. 2014. Wavelet-based sparse reduced-rank regression for hyperspectral image restoration. IEEE Transactions on Geoscience and Remote Sensing 52 (10): 6688-6698.
Rasti, Behnood, Johannes R. Sveinsson, Magnus Orn Ulfarsson, and Jón Atli Benediktsson. 2013. Hyperspectral image denoising using first order spectral roughness penalty in wavelet domain. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 7 (6): 2458-2467.
Sadigh, Alireza Naeimi, and Hadi Zayyani. 2022. A proportionate robust diffusion recursive least exponential hyperbolic cosine algorithm for distributed estimation. IEEE Transactions on Circuits and Systems II: Express Briefs 69 (4): 2381-2385.
Sayed, Ali H. 2014. Adaptive networks. Proceedings of the IEEE 102 (4): 460-497.
Shao, Ling, Ruomei Yan, Xuelong Li, and Yan Liu. 2013. From heuristic optimization to dictionary learning: A review and comprehensive comparison of image denoising algorithms. IEEE transactions on cybernetics 44 (7): 1001-1013.
Song, Huihui, Guojie Wang, and Kaihua Zhang. 2014. Hyperspectral image denoising via low-rank matrix recovery. Remote sensing letters 5 (10): 872-881.
Wang, Qian, Lifu Zhang, Qingxi Tong, and Feizhou Zhang. 2014. Hyperspectral imagery denoising based on oblique subspace projection. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 7 (6): 2468-2480.
Wang, Yao, Jiangjun Peng, Qian Zhao, Yee Leung, Xi-Le Zhao, and Deyu Meng. 2017. Hyperspectral image restoration via total variation regularized low-rank tensor decomposition. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 11 (4): 1227-1243.
Xie, Qi, Qian Zhao, Deyu Meng, and Zongben Xu. 2017. Kronecker-basis-representation based tensor sparsity and its applications to tensor recovery. IEEE transactions on pattern analysis and machine intelligence 40 (8): 1888-1902.
Xie, Qi, Qian Zhao, Deyu Meng, Zongben Xu, Shuhang Gu, Wangmeng Zuo, and Lei Zhang. 2016. Multispectral images denoising by intrinsic tensor sparsity regularization. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 1692-1700. Las Vegas, NV, USA.
Yan, Ruomei, Ling Shao, and Yan Liu. 2013. Nonlocal hierarchical dictionary learning using wavelets for image denoising. IEEE transactions on image processing 22 (12): 4689-4698.
Yang, Chen, Cao Xiangyong, Zhao Qian, Meng Deyu, and Xu Zongben. 2017. Denoising hyperspectral image with non-iid noise structure. IEEE transactions on cybernetics 48 (3): 1054-1066.
Yuan, Qiangqiang, Liangpei Zhang, and Huanfeng Shen. 2012. Hyperspectral image denoising employing a spectral–spatial adaptive total variation model. IEEE Transactions on Geoscience and Remote Sensing 50 (10): 3660-3677.
_____. 2013. Hyperspectral image denoising with a spatial–spectral view fusion strategy. IEEE Transactions on Geoscience and Remote Sensing 52 (5): 2314-2325.
Zayyani, Hadi. 2020. Robust minimum disturbance diffusion LMS for distributed estimation. IEEE Transactions on Circuits and Systems II: Express Briefs 68 (1): 521-525.
Zhang, Hongyan, Wei He, Liangpei Zhang, Huanfeng Shen, and Qiangqiang Yuan. 2013. Hyperspectral image restoration using low-rank matrix recovery. IEEE transactions on geoscience and remote sensing 52 (8): 4729-4743.
Zhao, Qian, Deyu Meng, Zongben Xu, Wangmeng Zuo, and Lei Zhang. 2014. Robust principal component analysis with complex noise. In International conference on machine learning, pp. 55-63. PMLR. Beijing, China
Zheng, Yinqiang, Guangcan Liu, Shigeki Sugimoto, Shuicheng Yan, and Masatoshi Okutomi. 2012. Practical low-rank matrix approximation under robust l 1-norm. In 2012 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1410-1417. Providence, Rhode Island, USA.
Zhong, Ping, and Runsheng Wang. 2012. Multiple-spectral-band CRFs for denoising junk bands of hyperspectral imagery. IEEE Transactions on Geoscience and Remote Sensing 51 (4): 2260-2275.
Zou, Changzhong, and Youshen Xia. 2016. Poissonian hyperspectral image superresolution using alternating direction optimization. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 9 (9): 4464-4479.
Iranian Journal of Information Processing and Management
Volume 39, Issue 4 - Serial Number 119
Summer 2024
Pages 1419-1442

  • Receive Date 27 June 2023
  • Revise Date 16 June 2024
  • Accept Date 16 June 2024