BIE: Binary Image Encoding for the Classification of Tabular Data
Pub. online: 19 April 2024
Type: Data Science In Action
Open Access
Open Access
Received
13 October 2023
13 October 2023
Accepted
13 February 2024
13 February 2024
Published
19 April 2024
19 April 2024
Abstract
There has been remarkable progress in the field of deep learning, particularly in areas such as image classification, object detection, speech recognition, and natural language processing. Convolutional Neural Networks (CNNs) have emerged as a dominant model of computation in this domain, delivering exceptional accuracy in image recognition tasks. Inspired by their success, researchers have explored the application of CNNs to tabular data. However, CNNs trained on structured tabular data often yield subpar results. Hence, there has been a demonstrated gap between the performance of deep learning models and shallow models on tabular data. To that end, Tabular-to-Image (T2I) algorithms have been introduced to convert tabular data into an unstructured image format. T2I algorithms enable the encoding of spatial information into the image, which CNN models can effectively utilize for classification. In this work, we propose two novel T2I algorithms, Binary Image Encoding (BIE) and correlated Binary Image Encoding (cBIE), which preserve complex relationships in the generated image by leveraging the native binary representation of the data. Additionally, cBIE captures more spatial information by reordering columns based on their correlation to a feature. To evaluate the performance of our algorithms, we conducted experiments using four benchmark datasets, employing ResNet-50 as the deep learning model. Our results show that the ResNet-50 models trained with images generated using BIE and cBIE consistently outperformed or matched models trained on images created using the previous State of the Art method, Image Generator for Tabular Data (IGTD).
Supplementary material
Supplementary MaterialWe provide the code and datasets separately in the supplementary material. Included in the code is also all of the figures included in the paper in svg, pdf, and png format. The code reflects the contents of the github repository used for these experiments at the time of publication (Halladay et al., 2023).
References
Aeberhard S, Forina M (1991). Wine. UCI Machine Learning Repository. https://doi.org/10.24432/C5PC7J
Albanese C, Li D, Lobachevskiy E, Meissner G (2013). A comparative analysis of correlation approaches in finance. The Journal of Derivatives, 21(2): 42–66. https://doi.org/10.3905/jod.2013.21.2.042
Buturović L, Miljković D (2020). A novel method for classification of tabular data using convolutional neural networks. BioRxiv, 2020–05. https://doi.org/10.1101/2020.05.02.074203
Choi S, Fang C, Haddad D, Kim M (2022). Predictive modeling of charge levels for battery electric vehicles using cnn efficientnet and igtd algorithm. arXiv preprint: https://arxiv.org/abs/2206.03612
Fisher RA (1936). The use of multiple measurements in taxonomic problems. Annals of Eugenics, 7(2): 179–188. https://doi.org/10.1111/j.1469-1809.1936.tb02137.x
Fisher RA (1988). Iris. UCI Machine Learning Repository. https://doi.org/10.24432/C56C76
Gokhale M, Mohanty SK, Ojha A (2023). Genevit: Gene vision transformer with improved deepinsight for cancer classification. Computers in Biology and Medicine, 155: 106643. https://doi.org/10.1016/j.compbiomed.2023.106643
Halladay J, Cullen D, Briner N, Warren J, Fye K, Basnet R, et al. (2022). Detection and characterization of ddos attacks using time-based features. IEEE Access, 10: 49794–49807. https://doi.org/10.1109/ACCESS.2022.3173319
Hand DJ, Christen P, Kirielle N (2021). F*: An interpretable transformation of the f-measure. Machine Learning, 110(3): 451–456. https://doi.org/10.1007/s10994-021-05964-1
He H, Garcia EA (2009). Learning from imbalanced data. IEEE Transactions on Knowledge and Data Engineering, 21(9): 1263–1284. https://doi.org/10.1109/TKDE.2008.239
Hossin M, Sulaiman MN (2015). A review on evaluation metrics for data classification evaluations. International Journal of Data Mining & Knowledge Management Process, 5(2): 1. https://doi.org/10.5121/ijdkp.2015.5201
Iqbal MI, Mukta MSH, Hasan AR, Islam S (2022). A dynamic weighted tabular method for convolutional neural networks. IEEE Access, 10: 134183–134198. https://doi.org/10.1109/ACCESS.2022.3231102
Krupski J, Graniszewski W, Iwanowski M (2021). Data transformation schemes for cnn-based network traffic analysis: A survey. Electronics, 10(16): 2042. https://doi.org/10.3390/electronics10162042
Ling CX, Huang J, Zhang H (2003). Auc: A better measure than accuracy in comparing learning algorithms. In: Advances in Artificial Intelligence: 16th Conference of the Canadian Society for Computational Studies of Intelligence (Y Xiang, (B Chaib-Draa, eds.), volume 16 of Proceedings, AI 2003, Halifax, Canada, June 11–13, 2003, 329–341. Springer.
Rabbah J, Ridouani M, Hassouni L (2022). A new churn prediction model based on deep insight features transformation for convolution neural network architecture and stacknet. International Journal of Web-Based Learning and Teaching Technologies (IJWLTT), 17(1): 1–18. https://doi.org/10.4018/ijwltt.300342
Sharma A, Vans E, Shigemizu D, Boroevich KA, Tsunoda T (2019). Deepinsight: A methodology to transform a non-image data to an image for convolution neural network architecture. Scientific Reports, 9(1): 11399. https://doi.org/10.1038/s41598-019-47765-6
Simon M, Rodner E, Denzler J (2016). Imagenet pre-trained models with batch normalization. arXiv preprint: https://arxiv.org/abs/1612.01452
Simonyan K, Zisserman A (2014). Very deep convolutional networks for large-scale image recognition. arXiv preprint: https://arxiv.org/abs/1409.1556
Taheri A, Ebrahimnezhad H, Sedaaghi MH (2022). Prediction of the critical temperature of superconducting materials using image regression and ensemble deep learning. Materials Today Communications, 33: 104743. https://doi.org/10.1016/j.mtcomm.2022.104743
Wolberg W, Mangasarian O, Street N, Street W (1995). Breast Cancer Wisconsin (Diagnostic). UCI Machine Learning Repository. https://doi.org/10.24432/C5DW2B
Zhu Y, Brettin T, Xia F, Partin A, Shukla M, Yoo H, et al. (2021). Converting tabular data into images for deep learning with convolutional neural networks. Scientific Reports, 11(1): 11325. https://doi.org/10.1038/s41598-021-90923-y
