<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.3 20210610//EN" "https://jats.nlm.nih.gov/publishing/1.3/JATS-journalpublishing1-3.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article" dtd-version="1.3" xml:lang="en">
  <front>
    <journal-meta>
      <journal-id journal-id-type="publisher-id">IJTNS</journal-id>
      <journal-title-group>
        <journal-title>International Journal of Technical and Natural Sciences</journal-title>
        <abbrev-journal-title abbrev-type="publisher">IJTNS</abbrev-journal-title>
      </journal-title-group>
      <issn publication-format="print">2671-3500</issn>
      <issn publication-format="electronic">2671-3519</issn>
      <publisher>
        <publisher-name>Balkan University Press</publisher-name>
      </publisher>
    </journal-meta>
    <article-meta>
      <article-id pub-id-type="publisher-id">374</article-id>
      <article-categories>
        <subj-group subj-group-type="heading">
          <subject>Article</subject>
        </subj-group>
      </article-categories>
      <title-group>
        <article-title>Analysis of an Educational dataset using Classification Algorithm in Conjunction with Wrapper Feature Selection Methods</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author" corresp="yes">
          <name name-style="western">
            <surname>Saxena</surname>
            <given-names>Mamta</given-names>
          </name>
          <xref ref-type="aff" rid="aff1" />
        </contrib>
        <contrib contrib-type="author">
          <name name-style="western">
            <surname>Singh</surname>
            <given-names>Netra Pal</given-names>
          </name>
          <xref ref-type="aff" rid="aff2" />
        </contrib>
        <aff id="aff1">
          <institution>School of Engineering and Technology, MVN University Palwal, Haryana, India</institution>
        </aff>
        <aff id="aff2">
          <institution>School of Business Management &amp; Commerce, MVN University, Palwal-121105, Haryana, India</institution>
        </aff>
      </contrib-group>
      <pub-date publication-format="electronic" date-type="pub" iso-8601-date="2026-01-01">
        <day>01</day>
        <month>01</month>
        <year>2026</year>
      </pub-date>
      <volume>5</volume>
      <issue>2</issue>
      <fpage>17</fpage>
      <lpage>44</lpage>
      <permissions>
        <license license-type="open-access" xlink:href="https://creativecommons.org/licenses/by-nc-nd/4.0/">
          <license-p>CC BY-NC-ND 4.0</license-p>
        </license>
      </permissions>
      <self-uri xlink:href="https://ijtns.ibupress.com/articles/analysis-of-an-educational-dataset-using-classification-algorithm-in-conjunction-with-wrapper-feature-selection-methods" />
      <abstract>
        <p>Feature selection plays a critical role in improving the efficiency, accuracy, and interpretability of machine learning models, particularly when dealing with high-dimensional datasets. Among various approaches, wrapper-based feature selection methods are known for their ability to capture feature interactions by directly optimizing model performance. This study presents a comprehensive comparative analysis of six wrapper feature selection techniques—Recursive Feature Elimination (RFE), Sequential Forward Selection (SFS), Sequential Backward Selection (SBS), Genetic Algorithm (GA), Particle Swarm Optimization (PSO), and Differential Evolution (DE)—in conjunction with five widely used classification algorithms: Decision Tree, K-Nearest Neighbour, Random Forest, Logistic Regression, and Support Vector Machine. Experiments are conducted on an educational dataset comprising 395 student records with 30 attributes obtained from the UCI repository, using different feature subset sizes (all features, top 20, top 15, and top 10). Model performance is evaluated using accuracy, precision, recall, F1-score, and AUC. The results demonstrate that wrapper methods significantly enhance classification performance while reducing dimensionality, with GA and RFE consistently emerging as the most effective techniques across multiple classifiers. DE also shows strong performance, particularly with Logistic Regression and Random Forest, whereas PSO generally underperforms in terms of AUC. Furthermore, reducing the feature set does not adversely affect predictive accuracy and, in several cases, leads to improved generalization. The findings confirm the effectiveness of wrapper methods for educational data mining and provide practical insights for selecting optimal feature–classifier combinations.</p>
      </abstract>
      <kwd-group kwd-group-type="author">
        <kwd>Classification Algorithms</kwd>
        <kwd>Feature Selection</kwd>
        <kwd>Performance Metrics</kwd>
        <kwd>Wrapper Methods</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <back>
    <ref-list>
      <title>References</title>
      <ref id="r1">
        <mixed-citation>Asif, R., Merceron, A., &amp; Pathan, M. K. (2017). Predicting student academic performance at degree level: A case study. International Journal of Intelligent Systems and Applications, 9 (12), 49–61. https://doi.org/10.5815/ijisa.2017.12.06 <pub-id pub-id-type="doi">10.5815/ijisa.2017.12.06</pub-id></mixed-citation>
      </ref>
      <ref id="r2">
        <mixed-citation>Bin Mat, U., Buniyamin, N., Arsad, P. M., &amp; Kassim, R. A. (2014). An overview of using academic analytics to predict and improve students’ achievement: A proposed proactive intelligent intervention. In Proceedings of the 2013 IEEE 5th International Conference on Engineering Education (ICEED) (pp. 126–130). IEEE. <pub-id pub-id-type="doi">10.1109/iceed.2013.6908316</pub-id></mixed-citation>
      </ref>
      <ref id="r3">
        <mixed-citation>Chandrashekar, G., &amp; Sahin, F. (2014). A survey on feature selection methods. Computers &amp; Electrical Engineering, 40 (1), 16–28. <pub-id pub-id-type="doi">10.1016/j.compeleceng.2013.11.024</pub-id></mixed-citation>
      </ref>
      <ref id="r4">
        <mixed-citation>Das, S., &amp; Suganthan, P. N. (2011). Differential evolution: A survey of the state-of-the-art. IEEE Transactions on Evolutionary Computation, 15 (1), 4–31. https://doi.org/10.1109/ TEVC.2010.2059031 <pub-id pub-id-type="doi">10.1109/tevc.2010.2059031</pub-id></mixed-citation>
      </ref>
      <ref id="r5">
        <mixed-citation>Dash, M., &amp; Liu, H. (1997). Feature selection for classification. Intelligent Data Analysis, 1 (3), 131–156.</mixed-citation>
      </ref>
      <ref id="r6">
        <mixed-citation>Dubois, P. F. (2007). Python: Batteries included. Computing in Science &amp; Engineering, 9 (3), 7–9. https://doi.org/10.1109/MCSE.2007.58 <pub-id pub-id-type="doi">10.1109/MCSE.2007.58</pub-id></mixed-citation>
      </ref>
      <ref id="r7">
        <mixed-citation>Feng, C., &amp; Xu, X. (2019). A hybrid feature selection method based on RFE and Relief for educational data mining. Computers in Human Behavior, 101 , 228–237. https://doi.org/10.1016/j. chb.2019.07.002 <pub-id pub-id-type="doi">10.1016/j</pub-id></mixed-citation>
      </ref>
      <ref id="r8">
        <mixed-citation>Goldberg, D. E. (1989). Genetic algorithms in search, optimization, and machine learning . Addison-Wesley.</mixed-citation>
      </ref>
      <ref id="r9">
        <mixed-citation>Guyon, I., &amp; Elisseeff, A. (2003). An introduction to variable and feature selection. Journal of Machine Learning Research, 3 , 1157–1182.</mixed-citation>
      </ref>
      <ref id="r10">
        <mixed-citation>Mamta Saxena, Netra Pal Singh</mixed-citation>
      </ref>
      <ref id="r11">
        <mixed-citation>Analysis of an Educational dataset using Classification Algorithm in Conjunction with Wrapper Feature Selection Methods</mixed-citation>
      </ref>
      <ref id="r12">
        <mixed-citation>Guyon, I., Weston, J., Barnhill, S., &amp; Vapnik, V. (2002). Gene selection for cancer classification using support vector machines. Machine Learning, 46 (1–3), 389–422. https://doi.org/10.1023/A:1012487302797 <pub-id pub-id-type="doi">10.1023/A:1012487302797</pub-id></mixed-citation>
      </ref>
      <ref id="r13">
        <mixed-citation>Holland, J. H. (1992). Adaptation in natural and artificial systems: An introductory analysis with applications to biology, control, and artificial intelligence . MIT Press.</mixed-citation>
      </ref>
      <ref id="r14">
        <mixed-citation>Islam, M. M., &amp; Murase, K. (2018). A hybrid wrapper–filter approach for feature selection using mutual information and differential evolution. Knowledge-Based Systems, 147 , 125–134. https://doi.org/10.1016/j.knosys.2018.01.002 <pub-id pub-id-type="doi">10.1016/j.knosys.2018.01.002</pub-id></mixed-citation>
      </ref>
      <ref id="r15">
        <mixed-citation>Jain, A. K., &amp; Zongker, D. (1997). Feature selection: Evaluation, application, and small sample performance. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19 (2), 153–158. https://doi.org/10.1109/34.574797 <pub-id pub-id-type="doi">10.1109/34.574797</pub-id></mixed-citation>
      </ref>
      <ref id="r16">
        <mixed-citation>Kennedy, J., &amp; Eberhart, R. (1995). Particle swarm optimization. In Proceedings of the IEEE International Conference on Neural Networks (pp. 1942–1948). IEEE. <pub-id pub-id-type="doi">10.1109/icnn.1995.488968</pub-id></mixed-citation>
      </ref>
      <ref id="r17">
        <mixed-citation>Khan, M. J., &amp; Jawaid, A. (2020). Prediction of at-risk students using genetic algorithm and random forest. Education and Information Technologies, 25 (4), 2979–2997.</mixed-citation>
      </ref>
      <ref id="r18">
        <mixed-citation>Kohavi, R., &amp; John, G. H. (1997). Wrappers for feature subset selection. Artificial Intelligence, 97 (1–2), 273–324. <pub-id pub-id-type="doi">10.1016/s0004-3702(97)00043-x</pub-id></mixed-citation>
      </ref>
      <ref id="r19">
        <mixed-citation>Li, J., Cheng, K., Wang, S., Morstatter, F., Trevino, R. P., Tang, J., &amp; Liu, H. (2017). Feature selection: A data perspective. ACM Computing Surveys, 50 (6), 1–45. <pub-id pub-id-type="doi">10.1145/3136625</pub-id></mixed-citation>
      </ref>
      <ref id="r20">
        <mixed-citation>Liu, H., &amp; Yu, L. (2005). Toward integrating feature selection algorithms for classification and clustering. IEEE Transactions on Knowledge and Data Engineering, 17 (4), 491–502. https:// doi.org/10.1109/TKDE.2005.66 <pub-id pub-id-type="doi">10.1109/TKDE.2005.66</pub-id></mixed-citation>
      </ref>
      <ref id="r21">
        <mixed-citation>Maldonado, S., &amp; Weber, R. (2009). A wrapper method for feature selection using support vector machines. Information Sciences, 179 (13), 2208–2217. <pub-id pub-id-type="doi">10.1016/j.ins.2009.02.014</pub-id></mixed-citation>
      </ref>
      <ref id="r22">
        <mixed-citation>Millman, K. J., &amp; Aivazis, M. A. (2011). Python for scientists and engineers. Computing in Science &amp; Engineering, 13 (2), 9–12. https://doi.org/10.1109/MCSE.2011.36 <pub-id pub-id-type="doi">10.1109/MCSE.2011.36</pub-id></mixed-citation>
      </ref>
      <ref id="r23">
        <mixed-citation>Moslehi, F., &amp; Haeri, A. (2020). A novel hybrid wrapper–filter approach based on genetic algorithm and particle swarm optimization for feature subset selection. Journal of Ambient Intelligence and Humanized Computing, 11 , 1105–1127.</mixed-citation>
      </ref>
      <ref id="r24">
        <mixed-citation>Patel, D., Saxena, A., &amp; Wang, J. (2024). A machine-learning-based wrapper method for feature selection. International Journal of Data Warehousing and Mining . https://doi.org/10.4018/ IJDWM.352041 <pub-id pub-id-type="doi">10.4018/ijdwm.352041</pub-id></mixed-citation>
      </ref>
      <ref id="r25">
        <mixed-citation>Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., … Duchesnay, E. (2011). Scikit-learn: Machine learning in Python. Journal of Machine Learning Research, 12 , 2825–2830.</mixed-citation>
      </ref>
      <ref id="r26">
        <mixed-citation>Pudil, P., Novovicová, J., &amp; Kittler, J. (1994). Floating search methods in feature selection. Pattern Recognition Letters, 15 (11), 1119–1125. https://doi.org/10.1016/0167-8655(94)90127-9 <pub-id pub-id-type="doi">10.1016/0167-8655(94)90127-9</pub-id></mixed-citation>
      </ref>
      <ref id="r27">
        <mixed-citation>Saeys, Y., Inza, I., &amp; Larrañaga, P. (2007). A review of feature selection techniques in bioinformatics. Bioinformatics, 23 (19), 2507–2517. <pub-id pub-id-type="doi">10.1093/bioinformatics/btm344</pub-id></mixed-citation>
      </ref>
      <ref id="r28">
        <mixed-citation>Saxena, M., &amp; Singh, N. P. (2025). Role of Hybrid Feature Selection Algorithms in Foreseeing Stu dent Performance. International Journal of Natural and Technical Sciences, 5(1), 43-75. https://doi.org/10.69648/NVAX8158 <pub-id pub-id-type="doi">10.69648/NVAX8158</pub-id></mixed-citation>
      </ref>
      <ref id="r29">
        <mixed-citation>Sharma, M., &amp; Kaur, P. (2020). An efficient differential evolution approach for feature selection in educational data mining. International Journal of Cognitive Computing in Engineering, 1 , 33–43.</mixed-citation>
      </ref>
      <ref id="r30">
        <mixed-citation>Siedlecki, W., &amp; Sklansky, J. (1989). A note on genetic algorithms for large-scale feature selection. Pattern Recognition Letters, 10 (5), 335–347. <pub-id pub-id-type="doi">10.1016/0167-8655(89)90037-8</pub-id></mixed-citation>
      </ref>
      <ref id="r31">
        <mixed-citation>Singh, A. K., &amp; Karthikeyan, S. (2024). A wrapper feature selection method for predicting student dropout in higher education. SSRN Electronic Journal . https://doi.org/10.2139/ ssrn.5002077 <pub-id pub-id-type="doi">10.2139/ssrn.5002077</pub-id></mixed-citation>
      </ref>
      <ref id="r32">
        <mixed-citation>Sivanandam, S. N., &amp; Deepa, S. N. (2007). Introduction to genetic algorithms . Springer. https://doi. org/10.1007/978-3-540-73190-0 <pub-id pub-id-type="doi">10.1007/978-3-540-73190-0</pub-id></mixed-citation>
      </ref>
      <ref id="r33">
        <mixed-citation>Storn, R., &amp; Price, K. (1997). Differential evolution – A simple and efficient heuristic for global optimization over continuous spaces. Journal of Global Optimization, 11 (4), 341–359. <pub-id pub-id-type="doi">10.1023/a:1008202821328</pub-id></mixed-citation>
      </ref>
      <ref id="r34">
        <mixed-citation>Tang, J., Alelyani, S., &amp; Liu, H. (2014). Feature selection for classification: A review. In H. Liu &amp; L. Yu (Eds.), Data classification: Algorithms and applications (pp. 37–64). CRC Press.</mixed-citation>
      </ref>
      <ref id="r35">
        <mixed-citation>Tomasevic, N., Gvozdenovic, N., &amp; Vranes, S. (2019). An overview and comparison of supervised data mining techniques for student exam performance prediction. Computers &amp; Education, 143 , 103676. https://doi.org/10.1016/j.compedu.2019.103676 <pub-id pub-id-type="doi">10.1016/j.compedu.2019.103676</pub-id></mixed-citation>
      </ref>
      <ref id="r36">
        <mixed-citation>Waheed, H., Goyal, M., &amp; Khanum, A. (2020). Machine learning-based early prediction of students’ performance using PSO. Education and Information Technologies, 25 (6), 4693–4711.</mixed-citation>
      </ref>
      <ref id="r37">
        <mixed-citation>Xue, B., Zhang, M., &amp; Browne, W. N. (2015). A comprehensive comparison on evolutionary feature selection approaches to classification. International Journal of Computational Intelligence and Applications, 14 (2), 1550008. <pub-id pub-id-type="doi">10.1142/s146902681550008x</pub-id></mixed-citation>
      </ref>
      <ref id="r38">
        <mixed-citation>Xue, B., Zhang, M., &amp; Browne, W. N. (2016). A survey on evolutionary computation appr</mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>