Document Type : Review Article
Authors
Department of Computer Engineering and Information Technology, Razi University, Kermanshah, Iran.
Abstract
The success of handwriting recognition methods based on digitizer-pen signal processing is mostly dependent on the defined features. Strong and discriminating feature descriptors can play the main role in improving the accuracy of pattern recognition. Moreover, most recognition studies utilize local features or sequences of them. Whereas, it has been shown that the combination of global and local features can increase the recognition accuracy. This paper addresses two mentioned topics. First, a new high discriminative local feature, called Rotation Invariant Histogram of Degrees (RIHoD), is proposed for online digitizer-pen handwriting signals. Second, a feature representation layer is proposed, which maps local features into global ones in a new space using some learning kernels. Different aspects of the proposed local feature and learned global feature are analyzed and its efficiency is evaluated in several online handwriting recognition scenarios.
Keywords
[1] H. Ren, W. Wang, and C. Liu, "Recognizing online handwritten Chinese characters using RNNs with new computing architectures," Pattern Recognition, Vol. 93, pp. 179-192, 2019/09/01/ 2019.
[2] M. A. K.O and S. Poruran, "OCR-Nets: Variants of Pre-trained CNN for Urdu Handwritten Character Recognition via Transfer Learning," Procedia Computer Science, vol. 171, pp. 2294-2301, 2020/01/01/ 2020.
[3] O. AlZoubi, S. K. Tawalbeh, and M. Al-Smadi, "Affect detection from arabic tweets using ensemble and deep learning techniques," Journal of King Saud University - Computer and Information Sciences, 2020/10/16/ 2020.
[4] R. Sharma, B. Kaushik, and N. Gondhi, "Character Recognition using Machine Learning and Deep Learning - A Survey," in 2020 International Conference on Emerging Smart Computing and Informatics (ESCI), 12-14 March 2020 2020, pp. 341-345,
[5] X.-Y. Zhang, F. Yin, Y.-M. Zhang, C.-L. Liu, and Y. Bengio, "Drawing and recognizing chinese characters with recurrent neural network," IEEE transactions on pattern analysis and machine intelligence, vol. 40, no. 4, pp. 849-862, 2017
[6] G. S. Monisha and S. Malathi, "Effective Survey on Handwriting Character Recognition," in Computational Methods and Data Engineering, Singapore, V. Singh, V. K. Asari, S. Kumar, and R. B. Patel, Eds., 2021// 2021: Springer Singapore, pp. 115-131
[7] M. Asgari-Bidhendi, B. Janfada, O. R. Roshani Talab, and B. Minaei-Bidgoli, "ParsNER-Social: A Corpus for Named Entity Recognition in Persian Social Media Texts," (in en), Journal of AI and Data Mining, vol. 9, no. 2, pp. 181-192, 2021, doi: 10.22044/jadm.2020.9949.2143.
[8] M. Askari, M. Asadi, A. Asilian Bidgoli, and H. Ebrahimpour, "Isolated Persian/Arabic handwriting characters: Derivative projection profile features, implemented on GPUs," (in en), Journal of AI and Data Mining, vol. 4, no. 1, pp. 9-17, 2016, doi: 10.5829/idosi.JAIDM.2016.04.01.02.
[9] R. Ahmed Bhuiyan, N. Ahmed, M. Amiruzzaman, and M. R. Islam, "A Robust Feature Extraction Model for Human Activity Characterization Using 3-Axis Accelerometer and Gyroscope Data," Sensors, vol. 20, no. 23, p. 6990, 2020. [Online]. Available: https://www.mdpi.com/1424-8220/20/23/6990.
[10] M. Sepahvand, F. Abdali-Mohammadi, and F. Mardukhi, "Evolutionary Metric-Learning-Based Recognition Algorithm for Online Isolated Persian/Arabic Characters, Reconstructed Using Inertial Pen Signals," IEEE Transactions on Cybernetics, vol. 47, no. 9, pp. 2872-2884, 2017.
[11] J. Wang and F. Chuang, "An Accelerometer-Based Digital Pen With a Trajectory Recognition Algorithm for Handwritten Digit and Gesture Recognition," IEEE Transactions on Industrial Electronics, vol. 59, no. 7, pp. 2998-3007, 2012.
[12] Y. Hsu, C. Chu, Y. Tsai, and J. Wang, "An Inertial Pen With Dynamic Time Warping Recognizer for Handwriting and Gesture Recognition," IEEE Sensors Journal, vol. 15, no. 1, pp. 154-163, 2015.
[13] M. T. Ribeiro, S. Singh, and C. Guestrin, ""Why Should I Trust You?": Explaining the Predictions of Any Classifier," presented at the Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, California, USA, 2016. [Online]. Available: https://doi.org/10.1145/2939672.2939778.
[14] S. Mahmoud, "Recognition of writer-independent off-line handwritten Arabic (Indian) numerals using hidden Markov models," Signal Processing, vol. 88, no. 4, pp. 844-857, 2008/04/01/ 2008.
[15] V. Ghods and M. K. Sohrabi, "Online Farsi digit recognition using their upper half structure," in Sixth International Conference on Graphic and Image Processing (ICGIP 2014), 2015, vol. 9443: International Society for Optics and Photonics, p. 94430B.
[16] V. Ghods, E. Kabir, and F. Razzazi, "Decision fusion of horizontal and vertical trajectories for recognition of online Farsi subwords," Engineering Applications of Artificial Intelligence, vol. 26, no. 1, pp. 544-550, 2013/01/01/ 2013,
[17] Y. Elarian, I. Ahmad, S. Awaida, W. G. Al-Khatib, and A. Zidouri, "An Arabic handwriting synthesis system," Pattern Recognition, vol. 48, no. 3, pp. 849-861, 2015/03/01/ 2015,
[18] S. M. M. Ahsan, M. M. Billah, and N. S. Rahat, "LBP histogram for scale independent Bangla character recognition," in 2017 4th International Conference on Advances in Electrical Engineering (ICAEE), 28-30 Sept. 2017 2017, pp. 470-475,
[19] L. Liu, H. Zhang, A. Feng, X. Wan, and J. Guo, "Simplified Local Binary Pattern Descriptor for Character Recognition of Vehicle License Plate," in 2010 Seventh International Conference on Computer Graphics, Imaging and Visualization, 7-10 Aug. 2010 2010, pp. 157-161, doi: 10.1109/CGIV.2010.32
[20] N. A. Jebril, H. R. Al-Zoubi, and Q. Abu Al-Haija, "Recognition of Handwritten Arabic Characters using Histograms of Oriented Gradient (HOG)," Pattern Recognition and Image Analysis, vol. 28, no. 2, pp. 321-345, 2018/04/01 2018,
[21] M. Li, R. Zheng, S. Xu, Y. Fu, and D. Huang, "Manchu Word Recognition Based on Convolutional Neural Network with Spatial Pyramid Pooling," in 2018 11th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI), 13-15 Oct. 2018 2018, pp. 1-6, doi: 10.1109/CISP-BMEI.2018.8633131.
[22] M. I. Razzak, F. Anwar, S. A. Husain, A. Belaid, and M. Sher, "HMM and fuzzy logic: A hybrid approach for online Urdu script-based languages’ character recognition," Knowledge-Based Systems, vol. 23, no. 8, pp. 914-923, 2010/12/01/ 2010, doi: https://doi.org/10.1016/j.knosys.2010.06.007
[23] V. Ghods and E. Kabir, "Feature extraction for online Farsi characters," in 2010 12th International Conference on Frontiers in Handwriting Recognition, 2010: IEEE, pp. 477-482
[24] A. A. Mohamed, R. Yusof, S. A. Rahman, and S. Mutalib, "Baseline extraction algorithm for online signature recognition," WTOS, vol. 8, no. 4, pp. 491–500, 2009
[25] M. T. Ibrahim, M. Aurangzeb Khan, K. Saleem Alimgeer, M. Khalid Khan, I. A. Taj, and L. Guan, "Velocity and pressure-based partitions of horizontal and vertical trajectories for on-line signature verification," Pattern Recognition, vol. 43, no. 8, pp. 2817-2832, 2010/08/01/ 2010, doi: https://doi.org/10.1016/j.patcog.2010.02.011
[26] M. S. Baghshah, S. B. Shouraki, and S. Kasaei, "A Novel Fuzzy Classifier using Fuzzy LVQ to Recognize Online Persian Handwriting," in 2006 2nd International Conference on Information & Communication Technologies, 24-28 April 2006 2006, vol. 1, pp. 1878-1883, doi: 10.1109/ICTTA.2006.1684675
[27] N. Aouadi and A. Kacem, "A proposal for touching component segmentation in Arabic manuscripts," Pattern Analysis and Applications, vol. 20, no. 4, pp. 1005-1027, 2017/11/01 2017, doi: 10.1007/s10044-016-0543-1
[28] P. Alirezazadeh, A. Fathi, and F. Abdali-Mohammadi, "A Genetic Algorithm-Based Feature Selection for Kinship Verification," Signal Processing Letters, IEEE, vol. 22, no. 12, pp. 2459-2463, 2015
[29] S. Ahlawat and R. Rishi, "A genetic algorithm based feature selection for handwritten digit recognition," Recent Patents on Computer Science, vol. 12, no. 4, pp. 304-316, 2019.
[30] I. Rejer, "Genetic algorithm with aggressive mutation for feature selection in BCI feature space," Pattern Analysis and Applications, vol. 18, no. 3, pp. 485-492, 2015/08/01 2015, doi: 10.1007/s10044-014-0425-3
[31] M. Y. Potrus, U. K. Ngah, and B. S. Ahmed, "An evolutionary harmony search algorithm with dominant point detection for recognition-based segmentation of online Arabic text recognition," Ain Shams Engineering Journal, vol. 5, no. 4, pp. 1129-1139, 2014
[32] C. De Stefano, A. Della Cioppa, and A. Marcelli, "Character preclassification based on genetic programming," Pattern Recognition Letters, vol. 23, no. 12, pp. 1439-1448, 2002
[33] M. Sepahvand and F. Abdali-Mohammadi, "A novel representation in genetic programming for ensemble classification of human motions based on inertial signals," Expert Systems with Applications, vol. 185, p. 115624, 2021/12/15/ 2021, doi: https://doi.org/10.1016/j.eswa.2021.115624
[34] Y.-L. Hsu, C.-L. Chu, Y.-J. Tsai, and J.-S. Wang, "An inertial pen with dynamic time warping recognizer for handwriting and gesture recognition," Sensors Journal, IEEE, vol. 15, no. 1, pp. 154-163, 2015
[35] M. Sepahvand and F. Abdali-Mohammadi, "A Deep Learning-Based Compression Algorithm for 9-DOF Inertial Measurement Unit Signals Along With an Error Compensating Mechanism," IEEE Sensors Journal, vol. 19, no. 2, pp. 632-640, 2019, doi: 10.1109/JSEN.2018.2877360
[36] A. Kholmatov and B. Yanikoglu, "SUSIG: an on-line signature database, associated protocols and benchmark results," Pattern Analysis and Applications, vol. 12, no. 3, pp. 227-236, 2009/09/01 2009, doi: 10.1007/s10044-008-0118-x
[37] E. K. S Razavi S, "A dataset for online Farsi handwriting," presented at the 6th National conference on intelligent systems (in Farsi), 2004
[38] M. Sepahvand and F. Abdali-Mohammadi, "A novel multi-lead ECG personal recognition based on signals functional and structural dependencies using time-frequency representation and evolutionary morphological CNN," Biomedical Signal Processing and Control, vol. 68, p. 102766, 2021/07/01/ 2021, doi: https://doi.org/10.1016/j.bspc.2021.102766
[39] J. Robertson and R. Guest, "A feature based comparison of pen and swipe based signature characteristics," (in eng), Hum Mov Sci, vol. 43, pp. 169-82, Oct 2015, doi: 10.1016/j.humov.2015.06.003
[40] M. Ermes, J. PÄrkkÄ, J. MÄntyjÄrvi, and I. Korhonen, "Detection of Daily Activities and Sports With Wearable Sensors in Controlled and Uncontrolled Conditions," IEEE Transactions on Information Technology in Biomedicine, vol. 12, no. 1, pp. 20-26, 2008, doi: 10.1109/TITB.2007.899496
[41] D. Anguita, A. Ghio, L. Oneto, X. Parra, and J. L. Reyes-Ortiz, "Energy Efficient Smartphone-Based Activity Recognition using Fixed-Point Arithmetic," J. UCS, vol. 19, no. 9, pp. 1295-1314, 2013
[42] S. J. Preece, J. Y. Goulermas, L. P. J. Kenney, and D. Howard, "A Comparison of Feature Extraction Methods for the Classification of Dynamic Activities From Accelerometer Data," IEEE Transactions on Biomedical Engineering, vol. 56, no. 3, pp. 871-879, 2009, doi: 10.1109/TBME.2008.2006190
[43] S. Valikhani, F. Abdali-Mohammadi, and A. Fathi, "Online continuous multi-stroke Persian/Arabic character recognition by novel spatio-temporal features for digitizer pen devices," Neural Computing and Applications, vol. 32, no. 8, pp. 3853-3872, 2020/04/01 2020, doi: 10.1007/s00521-019-04225-6
[44] I. Abdelaziz, S. Abdou, and H. Al-Barhamtoshy, "A large vocabulary system for Arabic online handwriting recognition," Pattern Analysis and Applications, vol. 19, no. 4, pp. 1129-1141, 2016/11/01 2016, doi: 10.1007/s10044-015-0526-7
[45] M. A. Mehralian and K. Fouladi, "The Recognition of Online Handwritten Persian Characters Based on Their Main Bodies Using SVM," (in English), SIGNAL AND DATA PROCESSING, Article vol. -, no. 1 (SERIAL 17), pp. 59-66, 2012. [Online]. Available: https://www.sid.ir/en/Journal/ViewPaper.aspx?ID=315205
[46] M. S. Baghshah, "A novel fuzzy approach to recognition of online Persian handwriting," in 5th International Conference on Intelligent Systems Design and Applications (ISDA'05), 8-10 Sept. 2005 2005, pp. 268-273, doi: 10.1109/ISDA.2005.13
[47] K. E. Razavi S, "A simple method for discrete online Farsi letters recognition," presented at the 6th National conference on intelligent systems (in Farsi), 2005
[48] I. Theodorakopoulos, G. Economou, S. Fotopoulos, and A. Ifantis, "On-line signature recognition via fusion of dynamic features into dissimilarity space," in IEEE International Symposium on Signal Processing and Information Technology, 12-15 Dec. 2013 2013, pp. 000440-000445, doi: 10.1109/ISSPIT.2013.6781921
[49] N. Sae-Bae and N. Memon, "A simple and effective method for online signature verification," in 2013 International Conference of the BIOSIG Special Interest Group (BIOSIG), 5-6 Sept. 2013 2013, pp. 1-12
[50] S. Rashidi, A. Fallah, and F. Towhidkhah, "Feature extraction based DCT on dynamic signature verification," Scientia Iranica, vol. 19, no. 6, pp. 1810-1819, 2012/12/01/ 2012, doi: https://doi.org/10.1016/j.scient.2012.05.007
[51] B. Yanikoglu and A. Kholmatov, "Online signature verification using Fourier descriptors," EURASIP J. Adv. Signal Process, vol. 2009, p. Article 12, 2009, doi: 10.1155/2009/260516
[52] M. Moradi, M. A. Pourmina, and F. Razzazi, "FPGA-based farsi handwritten digit recognition system," International Journal of Simulation Systems, Science and Technology, vol. 11, no. 2, 2010
)