# awesome-decision-tree-papers
**Repository Path**: xielinjiangs/awesome-decision-tree-papers
## Basic Information
- **Project Name**: awesome-decision-tree-papers
- **Description**: A collection of research papers on decision, classification and regression trees with implementations.
- **Primary Language**: Unknown
- **License**: MIT
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No
## Statistics
- **Stars**: 0
- **Forks**: 0
- **Created**: 2020-11-05
- **Last Updated**: 2021-03-30
## Categories & Tags
**Categories**: Uncategorized
**Tags**: None
## README
# Awesome decision tree research papers
[](https://github.com/sindresorhus/awesome)
[](http://makeapullrequest.com)
A curated list of decision, classification and regression tree research papers with implementations from the following conferences:
- Machine learning
* [NeurIPS](https://nips.cc/)
* [ICML](https://icml.cc/)
* [ICLR](https://iclr.cc/)
- Computer vision
* [CVPR](http://cvpr2019.thecvf.com/)
* [ICCV](http://iccv2019.thecvf.com/)
* [ECCV](https://eccv2018.org/)
- Natural language processing
* [ACL](http://www.acl2019.org/EN/index.xhtml)
* [NAACL](https://naacl2019.org/)
* [EMNLP](https://www.emnlp-ijcnlp2019.org/)
- Data
* [KDD](https://www.kdd.org/)
* [ICDM](http://icdm2019.bigke.org/)
* [WWW](https://www2019.thewebconf.org/)
- Artificial intelligence
* [AAAI](https://www.aaai.org/)
* [IJCAI](https://www.ijcai.org/)
* [UAI](http://www.auai.org/)
A similar collection about [graph embedding](https://github.com/benedekrozemberczki/awesome-graph-embedding) and [community detection](https://github.com/benedekrozemberczki/awesome-community-detection) papers with implementations.
## 2018
- **Adapting to Concept Drift in Credit Card Transaction Data Streams Using Contextual Bandits and Decision Trees (AAAI 2018)**
- Dennis J. N. J. Soemers, Tim Brys, Kurt Driessens, Mark H. M. Winands, Ann Nowé
- [[Paper]](https://www.aaai.org/ocs/index.php/AAAI/AAAI18/paper/viewFile/16183/16394)
- **MERCS: Multi-Directional Ensembles of Regression and Classification Trees (AAAI 2018)**
- Elia Van Wolputte, Evgeniya Korneva, Hendrik Blockeel
- [[Paper]](https://www.aaai.org/ocs/index.php/AAAI/AAAI18/paper/viewFile/16875/16735)
- [[Code]](https://github.com/eliavw/mercs-v5)
- **Differential Performance Debugging With Discriminant Regression Trees (AAAI 2018)**
- Saeid Tizpaz-Niari, Pavol Cerný, Bor-Yuh Evan Chang, Ashutosh Trivedi
- [[Paper]](https://arxiv.org/abs/1711.04076)
- [[Code]](https://github.com/cuplv/DPDEBUGGER)
- **Estimating the Class Prior in Positive and Unlabeled Data Through Decision Tree Induction (AAAI 2018)**
- Jessa Bekker, Jesse Davis
- [[Paper]](https://aaai.org/ocs/index.php/AAAI/AAAI18/paper/view/16776)
- **MDP-Based Cost Sensitive Classification Using Decision Trees (AAAI 2018)**
- Shlomi Maliah, Guy Shani
- [[Paper]](https://aaai.org/ocs/index.php/AAAI/AAAI18/paper/view/17128)
- **Generative Adversarial Image Synthesis With Decision Tree Latent Controller (CVPR 2018)**
- Takuhiro Kaneko, Kaoru Hiramatsu, Kunio Kashino
- [[Paper]](https://arxiv.org/abs/1805.10603)
- [[Code]](https://github.com/LynnHo/DTLC-GAN-Tensorflow)
- **Enhancing Very Fast Decision Trees with Local Split-Time Predictions (ICDM 2018)**
- Viktor Losing, Heiko Wersing, Barbara Hammer
- [[Paper]](https://www.techfak.uni-bielefeld.de/~hwersing/LosingHammerWersing_ICDM2018.pdf)
- [[Code]](https://github.com/ICDM2018Submission/VFDT-split-time-prediction)
- **Finding Influential Training Samples for Gradient Boosted Decision Trees (ICML 2018)**
- Boris Sharchilev, Yury Ustinovskiy, Pavel Serdyukov, Maarten de Rijke
- [[Paper]](https://arxiv.org/abs/1802.06640)
- [[Code]](https://github.com/bsharchilev/influence_boosting)
- **Learning Optimal Decision Trees with SAT (IJCAI 2018)**
- Nina Narodytska, Alexey Ignatiev, Filipe Pereira, João Marques-Silva
- [[Paper]](https://www.ijcai.org/proceedings/2018/0189.pdf)
- **Extremely Fast Decision Tree (KDD 2018)**
- Chaitanya Manapragada, Geoffrey I. Webb, Mahsa Salehi
- [[Paper]](https://arxiv.org/abs/1802.08780)
- [[Code]](https://github.com/doubleplusplus/incremental_decision_tree-CART-Random_Forest_python)
- **Alternating optimization of decision trees with application to learning sparse oblique trees (NIPS 2018)**
- Miguel Á. Carreira-Perpiñán, Pooya Tavallali
- [[Paper]](https://papers.nips.cc/paper/7397-alternating-optimization-of-decision-trees-with-application-to-learning-sparse-oblique-trees)
- **Multi-Layered Gradient Boosting Decision Trees (NIPS 2018)**
- Ji Feng, Yang Yu, Zhi-Hua Zhou
- [[Paper]](https://papers.nips.cc/paper/7614-multi-layered-gradient-boosting-decision-trees.pdf)
- [[Code]](https://github.com/kingfengji/mGBDT)
## 2017
- **Strategic Sequences of Arguments for Persuasion Using Decision Trees (AAAI 2017)**
- Emmanuel Hadoux, Anthony Hunter
- [[Paper]](http://www0.cs.ucl.ac.uk/staff/a.hunter/papers/aaai17.pdf)
- **BoostVHT: Boosting Distributed Streaming Decision Trees (CIKM 2017)**
- Theodore Vasiloudis, Foteini Beligianni, Gianmarco De Francisci Morales
- [[Paper]](https://melmeric.files.wordpress.com/2010/05/boostvht-boosting-distributed-streaming-decision-trees.pdf)
- **Latency Reduction via Decision Tree Based Query Construction (CIKM 2017)**
- Aman Grover, Dhruv Arya, Ganesh Venkataraman
- [[Paper]](https://dl.acm.org/citation.cfm?id=3132865)
- **Enumerating Distinct Decision Trees (ICML 2017)**
- Salvatore Ruggieri
- [[Paper]](http://proceedings.mlr.press/v70/ruggieri17a/ruggieri17a.pdf)
- **Gradient Boosted Decision Trees for High Dimensional Sparse Output (ICML 2017)**
- Si Si, Huan Zhang, S. Sathiya Keerthi, Dhruv Mahajan, Inderjit S. Dhillon, Cho-Jui Hsieh
- [[Paper]](http://proceedings.mlr.press/v70/si17a.html)
- [[Code]](https://github.com/springdaisy/GBDT)
- **Extremely Fast Decision Tree Mining for Evolving Data Streams (KDD 2017)**
- Albert Bifet, Jiajin Zhang, Wei Fan, Cheng He, Jianfeng Zhang, Jianfeng Qian, Geoff Holmes, Bernhard Pfahringer
- [[Paper]](https://core.ac.uk/download/pdf/151040580.pdf)
- **LightGBM: A Highly Efficient Gradient Boosting Decision Tree (NIPS 2017)**
- Guolin Ke, Qi Meng, Thomas Finley, Taifeng Wang, Wei Chen, Weidong Ma, Qiwei Ye, Tie-Yan Liu
- [[Paper]](https://papers.nips.cc/paper/6907-lightgbm-a-highly-efficient-gradient-boosting-decision-tree)
- [[Code]](https://lightgbm.readthedocs.io/en/latest/)
- **Variable Importance Using Decision Trees (NIPS 2017)**
- Jalil Kazemitabar, Arash Amini, Adam Bloniarz, Ameet S. Talwalkar
- [[Paper]](https://papers.nips.cc/paper/6646-variable-importance-using-decision-trees)
- **A Practical Method for Solving Contextual Bandit Problems Using Decision Trees (UAI 2017)**
- Adam N. Elmachtoub, Ryan McNellis, Sechan Oh, Marek Petrik
- [[Paper]](https://arxiv.org/abs/1706.04687)
- **Complexity of Solving Decision Trees with Skew-Symmetric Bilinear Utility (UAI 2017)**
- Hugo Gilbert, Olivier Spanjaard
- [[Paper]](http://auai.org/uai2017/proceedings/papers/64.pdf)
## 2016
- **Sparse Perceptron Decision Tree for Millions of Dimensions (AAAI 2016)**
- Weiwei Liu, Ivor W. Tsang
- [[Paper]](https://aaai.org/ocs/index.php/AAAI/AAAI16/paper/view/12111)
- **Learning Online Smooth Predictors for Realtime Camera Planning Using Recurrent Decision Trees (CVPR 2016)**
- Jianhui Chen, Hoang Minh Le, Peter Carr, Yisong Yue, James J. Little
- [[Paper]](http://hoangle.info/papers/cvpr2016_online_smooth_long.pdf)
- **Online Learning with Bayesian Classification Trees (CVPR 2016)**
- Samuel Rota Bulò, Peter Kontschieder
- [[Paper]](http://www.dsi.unive.it/~srotabul/files/publications/CVPR2016.pdf)
- **Accurate Robust and Efficient Error Estimation for Decision Trees (ICML 2016)**
- Lixin Fan
- [[Paper]](http://proceedings.mlr.press/v48/fan16.pdf)
- **Meta-Gradient Boosted Decision Tree Model for Weight and Target Learning (ICML 2016)**
- Yury Ustinovskiy, Valentina Fedorova, Gleb Gusev, Pavel Serdyukov
- [[Paper]](http://proceedings.mlr.press/v48/ustinovskiy16.html)
- **Boosted Decision Tree Regression Adjustment for Variance Reduction in Online Controlled Experiments (KDD 2016)**
- Alexey Poyarkov, Alexey Drutsa, Andrey Khalyavin, Gleb Gusev, Pavel Serdyukov
- [[Paper]](https://www.kdd.org/kdd2016/papers/files/adf0653-poyarkovA.pdf)
- **Yggdrasil: An Optimized System for Training Deep Decision Trees at Scale (NIPS 2016)**
- Firas Abuzaid, Joseph K. Bradley, Feynman T. Liang, Andrew Feng, Lee Yang, Matei Zaharia, Ameet S. Talwalkar
- [[Paper]](https://papers.nips.cc/paper/6366-yggdrasil-an-optimized-system-for-training-deep-decision-trees-at-scale)
- **A Communication-Efficient Parallel Algorithm for Decision Tree (NIPS 2016)**
- Qi Meng, Guolin Ke, Taifeng Wang, Wei Chen, Qiwei Ye, Zhiming Ma, Tie-Yan Liu
- [[Paper]](https://arxiv.org/abs/1611.01276)
- [[Code]](https://github.com/microsoft/LightGBM/blob/master/docs/Features.rst)
## 2015
- **Particle Gibbs for Bayesian Additive Regression Trees (AISTATS 2015)**
- Balaji Lakshminarayanan, Daniel M. Roy, Yee Whye Teh
- [[Paper]](https://arxiv.org/abs/1502.04622)
- **DART: Dropouts meet Multiple Additive Regression Trees (AISTATS 2015)**
- Korlakai Vinayak Rashmi, Ran Gilad-Bachrach
- [[Paper]](https://arxiv.org/abs/1505.01866)
- [[Code]](https://xgboost.readthedocs.io/en/latest/)
- **Single target tracking using adaptive clustered decision trees and dynamic multi-level appearance models (CVPR 2015)**
- Jingjing Xiao, Rustam Stolkin, Ales Leonardis
- [[Paper]](https://www.cv-foundation.org/openaccess/content_cvpr_2015/app/3B_058.pdf)
- **Face alignment using cascade Gaussian process regression trees (CVPR 2015)**
- Donghoon Lee, Hyunsin Park, Chang Dong Yoo
- [[Paper]](https://slsp.kaist.ac.kr/paperdata/Face_Alignment_Using.pdf)
- [[Code]](https://github.com/donghoonlee04/cGPRT)
- **Tracking-by-Segmentation with Online Gradient Boosting Decision Tree (ICCV 2015)**
- Jeany Son, Ilchae Jung, Kayoung Park, Bohyung Han
- [[Paper]](Tracking-by-Segmentation with Online Gradient Boosting Decision Tree)
- **Entropy evaluation based on confidence intervals of frequency estimates : Application to the learning of decision trees (ICML 2015)**
- Mathieu Serrurier, Henri Prade
- [[Paper]](http://proceedings.mlr.press/v37/serrurier15.pdf)
- **A Decision Tree Framework for Spatiotemporal Sequence Prediction (KDD 2015)**
- Taehwan Kim, Yisong Yue, Sarah L. Taylor, Iain A. Matthews
- [[Paper]](http://www.yisongyue.com/publications/kdd2015_ssw_dt.pdf)
- **Efficient Non-greedy Optimization of Decision Trees (NIPS 2015)**
- Mohammad Norouzi, Maxwell D. Collins, Matthew Johnson, David J. Fleet, Pushmeet Kohli
- [[Paper]](https://arxiv.org/abs/1511.04056)
## 2014
- **On Building Decision Trees from Large-scale Data in Applications of On-line Advertising (CIKM 2014)**
- Shivaram Kalyanakrishnan, Deepthi Singh, Ravi Kant
- [[Paper]](https://www.cse.iitb.ac.in/~shivaram/papers/ksk_cikm_2014.pdf)
- **Fast Supervised Hashing with Decision Trees for High-Dimensional Data (CVPR 2014)**
- Guosheng Lin, Chunhua Shen, Qinfeng Shi, Anton van den Hengel, David Suter
- [[Paper]](https://arxiv.org/abs/1404.1561)
- **One Millisecond Face Alignment with an Ensemble of Regression Trees (CVPR 2014)**
- Vahid Kazemi, Josephine Sullivan
- [[Paper]](https://www.researchgate.net/publication/264419855_One_Millisecond_Face_Alignment_with_an_Ensemble_of_Regression_Trees)
- **Diagnosis determination: decision trees optimizing simultaneously worst and expected testing cost (ICML 2014)**
- Ferdinando Cicalese, Eduardo Sany Laber, Aline Medeiros Saettler
- [[Paper]](https://pdfs.semanticscholar.org/47ae/852f83b76f95b27ab00308d04f6020bdf71f.pdf)
## 2013
- **Weakly Supervised Learning of Image Partitioning Using Decision Trees with Structured Split Criteria (ICCV 2013)**
- Christoph N. Straehle, Ullrich Köthe, Fred A. Hamprecht
- [[Paper]](https://ieeexplore.ieee.org/document/6751340)
- **Revisiting Example Dependent Cost-Sensitive Learning with Decision Trees (ICCV 2013)**
- Oisin Mac Aodha, Gabriel J. Brostow
- [[Paper]](https://ieeexplore.ieee.org/document/6751133)
- **Conformal Prediction Using Decision Trees (ICDM 2013)**
- Ulf Johansson, Henrik Boström, Tuve Löfström
- [[Paper]](https://ieeexplore.ieee.org/abstract/document/6729517)
- **Focal-Test-Based Spatial Decision Tree Learning: A Summary of Results (ICDM 2013)**
- Zhe Jiang, Shashi Shekhar, Xun Zhou, Joseph K. Knight, Jennifer Corcoran
- [[Paper]](https://pdfs.semanticscholar.org/f28e/df8d9eed76e4ce97cb6bd4182d590547be5e.pdf)
- **Top-down particle filtering for Bayesian decision trees (ICML 2013)**
- Balaji Lakshminarayanan, Daniel M. Roy, Yee Whye Teh
- [[Paper]](https://arxiv.org/abs/1303.0561)
- **Quickly Boosting Decision Trees - Pruning Underachieving Features Early (ICML 2013)**
- Ron Appel, Thomas J. Fuchs, Piotr Dollár, Pietro Perona
- [[Paper]](http://proceedings.mlr.press/v28/appel13.pdf)
- **Knowledge Compilation for Model Counting: Affine Decision Trees (IJCAI 2013)**
- Frédéric Koriche, Jean-Marie Lagniez, Pierre Marquis, Samuel Thomas
- [[Paper]](https://www.researchgate.net/publication/262398921_Knowledge_Compilation_for_Model_Counting_Affine_Decision_Trees)
## 2012
- **Regression Tree Fields - An efficient, non-parametric approach to image labeling problems (CVPR 2012)**
- Jeremy Jancsary, Sebastian Nowozin, Toby Sharp, Carsten Rother
- [[Paper]](http://www.nowozin.net/sebastian/papers/jancsary2012rtf.pdf)
- **ConfDTree: Improving Decision Trees Using Confidence Intervals (ICDM 2012)**
- Gilad Katz, Asaf Shabtai, Lior Rokach, Nir Ofek
- [[Paper]](https://ieeexplore.ieee.org/document/6413889)
- **Improved Information Gain Estimates for Decision Tree Induction (ICML 2012)**
- Sebastian Nowozin
- [[Paper]](https://arxiv.org/abs/1206.4620)
- **Learning Partially Observable Models Using Temporally Abstract Decision Trees (NIPS 2012)**
- Erik Talvitie
- [[Paper]](https://papers.nips.cc/paper/4662-learning-partially-observable-models-using-temporally-abstract-decision-trees)
## 2011
- **Incorporating Boosted Regression Trees into Ecological Latent Variable Models (AAAI 2011)**
- Rebecca A. Hutchinson, Li-Ping Liu, Thomas G. Dietterich
- [[Paper]](https://www.aaai.org/ocs/index.php/AAAI/AAAI11/paper/viewFile/3711/4086)
- **Syntactic Decision Tree LMs: Random Selection or Intelligent Design (EMNLP 2011)**
- Denis Filimonov, Mary P. Harper
- [[Paper]](https://www.aclweb.org/anthology/D11-1064)
- **Speeding-Up Hoeffding-Based Regression Trees With Options (ICML 2011)**
- Elena Ikonomovska, João Gama, Bernard Zenko, Saso Dzeroski
- [[Paper]](https://icml.cc/Conferences/2011/papers/349_icmlpaper.pdf)
- **On the Complexity of Decision Making in Possibilistic Decision Trees (UAI 2011)**
- Hélène Fargier, Nahla Ben Amor, Wided Guezguez
- [[Paper]](https://dslpitt.org/uai/papers/11/p203-fargier.pdf)
- **Parallel boosted regression trees for web search ranking (WWW 2011)**
- Stephen Tyree, Kilian Q. Weinberger, Kunal Agrawal, Jennifer Paykin
- [[Paper]](http://www.cs.cornell.edu/~kilian/papers/fr819-tyreeA.pdf)
## 2010
- **Discrimination Aware Decision Tree Learning (ICDM 2010)**
- Faisal Kamiran, Toon Calders, Mykola Pechenizkiy
- [[Paper]](https://www.win.tue.nl/~mpechen/publications/pubs/KamiranICDM2010.pdf)
- **Decision Trees for Uplift Modeling (ICDM 2010)**
- Piotr Rzepakowski, Szymon Jaroszewicz
- [[Paper]](https://core.ac.uk/download/pdf/81899141.pdf)
- **Learning Markov Network Structure with Decision Trees (ICDM 2010)**
- Daniel Lowd, Jesse Davis
- [[Paper]](https://ix.cs.uoregon.edu/~lowd/icdm10lowd.pdf)
- **Multivariate Dyadic Regression Trees for Sparse Learning Problems (NIPS 2010)**
- Han Liu, Xi Chen
- [[Paper]](https://papers.nips.cc/paper/4178-multivariate-dyadic-regression-trees-for-sparse-learning-problems.pdf)
## 2009
- **Stochastic gradient boosted distributed decision trees (CIKM 2009)**
- Jerry Ye, Jyh-Herng Chow, Jiang Chen, Zhaohui Zheng
- [[Paper]](https://dl.acm.org/citation.cfm?id=1646301)
## 2008
- **Predicting Future Decision Trees from Evolving Data (ICDM 2008)**
- Mirko Böttcher, Martin Spott, Rudolf Kruse
- [[Paper]](https://ieeexplore.ieee.org/document/4781098)
- **Bayes optimal classification for decision trees (ICML 2008)**
- Siegfried Nijssen
- [[Paper]](http://icml2008.cs.helsinki.fi/papers/455.pdf)
## 2007
- **Sample compression bounds for decision trees (ICML 2007)**
- Mohak Shah
- [[Paper]](http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.331.9136&rep=rep1&type=pdf)
- **A Tighter Error Bound for Decision Tree Learning Using PAC Learnability (IJCAI 2007)**
- Chaithanya Pichuka, Raju S. Bapi, Chakravarthy Bhagvati, Arun K. Pujari, Bulusu Lakshmana Deekshatulu
- [[Paper]](https://www.ijcai.org/Proceedings/07/Papers/163.pdf)
- **Keep the Decision Tree and Estimate the Class Probabilities Using its Decision Boundary (IJCAI 2007)**
- Isabelle Alvarez, Stephan Bernard, Guillaume Deffuant
- [[Paper]](https://www.ijcai.org/Proceedings/07/Papers/104.pdf)
- **Real Boosting a la Carte with an Application to Boosting Oblique Decision Tree (IJCAI 2007)**
- Claudia Henry, Richard Nock, Frank Nielsen
- [[Paper]](https://www.ijcai.org/Proceedings/07/Papers/135.pdf)
- **Scalable look-ahead linear regression trees (KDD 2007)**
- David S. Vogel, Ognian Asparouhov, Tobias Scheffer
- [[Paper]](https://www.cs.uni-potsdam.de/ml/publications/kdd2007.pdf)
- **Mining optimal decision trees from itemset lattices (KDD 2007)**
- Siegfried Nijssen, Élisa Fromont
- [[Paper]](https://hal.archives-ouvertes.fr/hal-00372011/document)
## 2006
- **Decision Tree Methods for Finding Reusable MDP Homomorphisms (AAAI 2006)**
- Alicia P. Wolfe, Andrew G. Barto
- [[Paper]](https://www.aaai.org/Papers/AAAI/2006/AAAI06-085.pdf)
- **A Fast Decision Tree Learning Algorithm (AAAI 2006)**
- Jiang Su, Harry Zhang
- [[Paper]](http://www.cs.unb.ca/~hzhang/publications/AAAI06.pdf)
- **Anytime Induction of Decision Trees: An Iterative Improvement Approach (AAAI 2006)**
- Saher Esmeir, Shaul Markovitch
- [[Paper]](https://www.aaai.org/Papers/AAAI/2006/AAAI06-056.pdf)
- **When a Decision Tree Learner Has Plenty of Time (AAAI 2006)**
- Saher Esmeir, Shaul Markovitch
- [[Paper]](https://www.aaai.org/Papers/AAAI/2006/AAAI06-259.pdf)
- **Decision Trees for Functional Variables (ICDM 2006)**
- Suhrid Balakrishnan, David Madigan
- [[Paper]](http://archive.dimacs.rutgers.edu/Research/MMS/PAPERS/fdt17.pdf)
- **A general framework for accurate and fast regression by data summarization in random decision trees (KDD 2006)**
- Wei Fan, Joe McCloskey, Philip S. Yu
- [[Paper]](http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.442.2004&rep=rep1&type=pdf)
## 2005
- **Representing Conditional Independence Using Decision Trees (AAAI 2005)**
- Jiang Su, Harry Zhang
- [[Paper]](http://www.cs.unb.ca/~hzhang/publications/AAAI051SuJ.pdf)
- **Use of Expert Knowledge for Decision Tree Pruning (AAAI 2005)**
- Jingfeng Cai, John Durkin
- [[Paper]](http://www.aaai.org/Papers/AAAI/2005/SA05-009.pdf)
- **Effective Estimation of Posterior Probabilities: Explaining the Accuracy of Randomized Decision Tree Approaches (ICDM 2005)**
- Wei Fan, Ed Greengrass, Joe McCloskey, Philip S. Yu, Kevin Drummey
- [[Paper]](http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.218.9713&rep=rep1&type=pdf)
- **Exploiting Informative Priors for Bayesian Classification and Regression Trees (IJCAI 2005)**
- Nicos Angelopoulos, James Cussens
- [[Paper]](https://www.ijcai.org/Proceedings/05/Papers/1013.pdf)
- **Ranking Cases with Decision Trees: a Geometric Method that Preserves Intelligibility (IJCAI 2005)**
- Isabelle Alvarez, Stephan Bernard
- [[Paper]](https://www.ijcai.org/Proceedings/05/Papers/1502.pdf)
## 2004
- **On the Optimality of Probability Estimation by Random Decision Trees (AAAI 2004)**
- Wei Fan
- [[Paper]](http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.447.2128&rep=rep1&type=pdf)
- **Occam's Razor and a Non-Syntactic Measure of Decision Tree Complexity (AAAI 2004)**
- Goutam Paul
- [[Paper]](https://www.aaai.org/Papers/AAAI/2004/AAAI04-130.pdf)
- **Using Emerging Patterns and Decision Trees in Rare-Class Classification (ICDM 2004)**
- Hamad Alhammady, Kotagiri Ramamohanarao
- [[Paper]](https://ieeexplore.ieee.org/abstract/document/1410299)
- **Orthogonal Decision Trees (ICDM 2004)**
- Hillol Kargupta, Haimonti Dutta
- [[Paper]](https://www.csee.umbc.edu/~hillol/PUBS/odtree.pdf)
- **Improving the Reliability of Decision Tree and Naive Bayes Learners (ICDM 2004)**
- David George Lindsay, Siân Cox
- [[Paper]](http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.521.3127&rep=rep1&type=pdf)
- **Communication Efficient Construction of Decision Trees Over Heterogeneously Distributed Data (ICDM 2004)**
- Chris Giannella, Kun Liu, Todd Olsen, Hillol Kargupta
- [[Paper]](http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.79.7119&rep=rep1&type=pdf)
- **Decision Tree Evolution Using Limited Number of Labeled Data Items from Drifting Data Streams (ICDM 2004)**
- Wei Fan, Yi-an Huang, Philip S. Yu
- [[Paper]](http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.218.9450&rep=rep1&type=pdf)
- **Lookahead-based algorithms for anytime induction of decision trees (ICML 2004)**
- Saher Esmeir, Shaul Markovitch
- [[Paper]](http://www.cs.technion.ac.il/~shaulm/papers/pdf/Esmeir-Markovitch-icml2004.pdf)
- **Detecting Structural Metadata with Decision Trees and Transformation-Based Learning (NAACL 2004)**
- Joungbum Kim, Sarah E. Schwarm, Mari Ostendorf
- [[Paper]](https://www.aclweb.org/anthology/N04-1018)
- **On the Adaptive Properties of Decision Trees (NIPS 2004)**
- Clayton D. Scott, Robert D. Nowak
- [[Paper]](https://papers.nips.cc/paper/2625-on-the-adaptive-properties-of-decision-trees.pdf)
## 2003
- **Postprocessing Decision Trees to Extract Actionable Knowledge (ICDM 2003)**
- Qiang Yang, Jie Yin, Charles X. Ling, Tielin Chen
- [[Paper]](https://pdfs.semanticscholar.org/b2c6/ff54c7aeefc70820ff04a8fc8b804012c504.pdf)
- **K-D Decision Tree: An Accelerated and Memory Efficient Nearest Neighbor Classifier (ICDM 2003)**
- Tomoyuki Shibata, Takekazu Kato, Toshikazu Wada
- [[Paper]](https://ieeexplore.ieee.org/abstract/document/1250997)
- **Identifying Markov Blankets with Decision Tree Induction (ICDM 2003)**
- Lewis J. Frey, Douglas H. Fisher, Ioannis Tsamardinos, Constantin F. Aliferis, Alexander R. Statnikov
- [[Paper]](https://www.semanticscholar.org/paper/Identifying-Markov-Blankets-with-Decision-Tree-Frey-Fisher/1aa0b0ede22f3963c923ea320a8bed91ac5aafbf)
- **Comparing Naive Bayes, Decision Trees, and SVM with AUC and Accuracy (ICDM 2003)**
- Jin Huang, Jingjing Lu, Charles X. Ling
- [[Paper]](https://pdfs.semanticscholar.org/8a73/74b98a9d94b8c01e996e72340f86a4327869.pdf)
- **Boosting Lazy Decision Trees (ICML 2003)**
- Xiaoli Zhang Fern, Carla E. Brodley
- [[Paper]](https://www.aaai.org/Papers/ICML/2003/ICML03-026.pdf)
- **Decision Tree with Better Ranking (ICML 2003)**
- Charles X. Ling, Robert J. Yan
- [[Paper]](https://www.aaai.org/Papers/ICML/2003/ICML03-064.pdf)
- **Skewing: An Efficient Alternative to Lookahead for Decision Tree Induction (IJCAI 2003)**
- David Page, Soumya Ray
- [[Paper]](http://pages.cs.wisc.edu/~dpage/ijcai3.pdf)
- **Efficient decision tree construction on streaming data (KDD 2003)**
- Ruoming Jin, Gagan Agrawal
- [[Paper]](http://web.cse.ohio-state.edu/~agrawal.28/p/sigkdd03.pdf)
- **PaintingClass: interactive construction%2C visualization and exploration of decision trees (KDD 2003)**
- Soon Tee Teoh, Kwan-Liu Ma
- [[Paper]](https://www.researchgate.net/publication/220272011_PaintingClass_interactive_construction_visualization_and_exploration_of_decision_trees)
- **Accurate decision trees for mining high-speed data streams (KDD 2003)**
- João Gama, Ricardo Rocha, Pedro Medas
- [[Paper]](http://staff.icar.cnr.it/manco/Teaching/2006/datamining/Esami2006/ArticoliSelezionatiDM/SEMINARI/Mining%20Data%20Streams/kdd03.pdf)
- **Near-Minimax Optimal Classification with Dyadic Classification Trees (NIPS 2003)**
- Clayton D. Scott, Robert D. Nowak
- [[Paper]](http://nowak.ece.wisc.edu/nips03.pdf)
## 2002
- **Solving the Fragmentation Problem of Decision Trees by Discovering Boundary Emerging Patterns (ICDM 2002)**
- Jinyan Li, Limsoon Wong
- [[Paper]](https://www.comp.nus.edu.sg/~wongls/psZ/decisionTreeandEP-2.ps)
- **Learning Decision Trees Using the Area Under the ROC Curve (ICML 2002)**
- César Ferri, Peter A. Flach, José Hernández-Orallo
- [[Paper]](http://dmip.webs.upv.es/papers/ICML2002.pdf)
- **Finding an Optimal Gain-Ratio Subset-Split Test for a Set-Valued Attribute in Decision Tree Induction (ICML 2002)**
- Fumio Takechi, Einoshin Suzuki
- [[Paper]](https://www.researchgate.net/publication/221346121_Finding_an_Optimal_Gain-Ratio_Subset-Split_Test_for_a_Set-Valued_Attribute_in_Decision_Tree_Induction)
- **SECRET: a scalable linear regression tree algorithm (KDD 2002)**
- Alin Dobra, Johannes Gehrke
- [[Paper]](http://www.cs.cornell.edu/people/dobra/papers/secret-extended.pdf)
- **Instability of decision tree classification algorithms (KDD 2002)**
- Ruey-Hsia Li, Geneva G. Belford
- [[Paper]](http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.12.8094&rep=rep1&type=pdf)
- **Extracting decision trees from trained neural networks (KDD 2002)**
- Olcay Boz
- [[Paper]](http://dspace.library.iitb.ac.in/jspui/bitstream/10054/1285/1/5664.pdf)
- **Dyadic Classification Trees via Structural Risk Minimization (NIPS 2002)**
- Clayton D. Scott, Robert D. Nowak
- [[Paper]](https://papers.nips.cc/paper/2198-dyadic-classification-trees-via-structural-risk-minimization.pdf)
## 2001
- **Japanese Named Entity Recognition based on a Simple Rule Generator and Decision Tree Learning (ACL 2001)**
- Hideki Isozaki
- [[Paper]](https://www.aclweb.org/anthology/P01-1041)
- **Message Length as an Effective Ockham's Razor in Decision Tree Induction (AISTATS 2001)**
- Scott Needham, David L. Dowe
- [[Paper]](www.gatsby.ucl.ac.uk/aistats/aistats2001/files/needham122.ps)
- **SQL Database Primitives for Decision Tree Classifiers (CIKM 2001)**
- Kai-Uwe Sattler, Oliver Dunemann
- [[Paper]](http://fusion.cs.uni-magdeburg.de/pubs/classprim.pdf)
- **Mining Decision Trees from Data Streams in a Mobile Environment (ICDM 2001)**
- Hillol Kargupta, Byung-Hoon Park
- [[Paper]](https://ieeexplore.ieee.org/document/989530)
- **Efficient Determination of Dynamic Split Points in a Decision Tree (ICDM 2001)**
- David Maxwell Chickering, Christopher Meek, Robert Rounthwaite
- [[Paper]](https://pdfs.semanticscholar.org/3587/a245c34ea415b205a903bde3220eb533d1a7.pdf)
- **A Comparison of Stacking with Meta Decision Trees to Bagging, Boosting, and Stacking with other Methods (ICDM 2001)**
- Bernard Zenko, Ljupco Todorovski, Saso Dzeroski
- [[Paper]](http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.23.3118&rep=rep1&type=pdf)
- **Efficient algorithms for decision tree cross-validation (ICML 2001)**
- Hendrik Blockeel, Jan Struyf
- [[Paper]](http://www.jmlr.org/papers/volume3/blockeel02a/blockeel02a.pdf)
- **Bias Correction in Classification Tree Construction (ICML 2001)**
- Alin Dobra, Johannes Gehrke
- [[Paper]](http://www.cs.cornell.edu/people/dobra/papers/icml2001-bias.pdf)
- **Breeding Decision Trees Using Evolutionary Techniques (ICML 2001)**
- Athanassios Papagelis, Dimitrios Kalles
- [[Paper]](http://www.gatree.com/data/BreedinDecisioTreeUsinEvo.pdf)
- **Obtaining calibrated probability estimates from decision trees and naive Bayesian classifiers (ICML 2001)**
- Bianca Zadrozny, Charles Elkan
- [[Paper]](http://cseweb.ucsd.edu/~elkan/calibrated.pdf)
- **Temporal Decision Trees or the lazy ECU vindicated (IJCAI 2001)**
- Luca Console, Claudia Picardi, Daniele Theseider Dupré
- [[Paper]](https://www.researchgate.net/publication/220815333_Temporal_Decision_Trees_or_the_lazy_ECU_vindicated)
- **A Decision Tree of Bigrams is an Accurate Predictor of Word Sense (NAACL 2001)**
- Ted Pedersen
- [[Paper]](https://www.aclweb.org/anthology/N01-1011)
## 1999
- **Modeling decision tree performance with the power law (AISTATS 1999)**
- Lewis J. Frey, Douglas H. Fisher
- [[Paper]](https://www.microsoft.com/en-us/research/wp-content/uploads/2017/01/ModelingTree.pdf)
- **Causal Mechanisms and Classification Trees for Predicting Chemical Carcinogens (AISTATS 1999)**
- Louis Anthony Cox Jr.
- [[Paper]](https://pdfs.semanticscholar.org/0d7b/1d55c5abfd024aacf645c66d0c90c283814e.pdf)
- **POS Tags and Decision Trees for Language Modeling (EMNLP 1999)**
- Peter A. Heeman
- [[Paper]](https://www.aclweb.org/anthology/W99-0617)
- **Lazy Bayesian Rules: A Lazy Semi-Naive Bayesian Learning Technique Competitive to Boosting Decision Trees (ICML 1999)**
- Zijian Zheng, Geoffrey I. Webb, Kai Ming Ting
- [[Paper]](https://pdfs.semanticscholar.org/067e/86836ddbcb5e2844e955c16e058366a18c77.pdf)
- **The Alternating Decision Tree Learning Algorithm (ICML 1999)**
- Yoav Freund, Llew Mason
- [[Paper]](https://cseweb.ucsd.edu/~yfreund/papers/atrees.pdf)
- [[Code]](https://github.com/rajanil/mkboost)
- **Boosting with Multi-Way Branching in Decision Trees (NIPS 1999)**
- Yishay Mansour, David A. McAllester
- [[Paper]](https://papers.nips.cc/paper/1659-boosting-with-multi-way-branching-in-decision-trees.pdf)
## 1998
- **Learning Sorting and Decision Trees with POMDPs (ICML 1998)**
- Blai Bonet, Hector Geffner
- [[Paper]](https://bonetblai.github.io/reports/icml98-learning.pdf)
- **Using a Permutation Test for Attribute Selection in Decision Trees (ICML 1998)**
- Eibe Frank, Ian H. Witten
- [[Paper]](https://pdfs.semanticscholar.org/9aa9/21b0203e06e98b49bf726a33e124f4310ea3.pdf)
- **A Fast and Bottom-Up Decision Tree Pruning Algorithm with Near-Optimal Generalization (ICML 1998)**
- Michael J. Kearns, Yishay Mansour
- [[Paper]](https://www.cis.upenn.edu/~mkearns/papers/pruning.pdf)
## 1997
- **Pessimistic decision tree pruning based Continuous-time (ICML 1997)**
- Yishay Mansour
- [[Paper]](https://pdfs.semanticscholar.org/b6fc/e37612db10a9756b904b5e79e1144ca12574.pdf)
- **PAC Learning with Constant-Partition Classification Noise and Applications to Decision Tree Induction (ICML 1997)**
- Scott E. Decatur
- [[Paper]](https://www.semanticscholar.org/paper/PAC-Learning-with-Constant-Partition-Classification-Decatur/dd205073aeb512ecd1e823b35f556058fdeea5e0)
- **Option Decision Trees with Majority Votes (ICML 1997)**
- Ron Kohavi, Clayton Kunz
- [[Paper]](https://pdfs.semanticscholar.org/383b/381d1ac0bb41ec595e0d1603ed642809eb86.pdf)
- **Integrating Feature Construction with Multiple Classifiers in Decision Tree Induction (ICML 1997)**
- Ricardo Vilalta, Larry A. Rendell
- [[Paper]](https://pdfs.semanticscholar.org/1f73/d9d409a75d16871cfa1182ac72b37c839d86.pdf)
- **Functional Models for Regression Tree Leaves (ICML 1997)**
- Luís Torgo
- [[Paper]](https://pdfs.semanticscholar.org/48e4/b3187ca234308e97e1ac0cab84222c603bdd.pdf)
- **The Effects of Training Set Size on Decision Tree Complexity (ICML 1997)**
- Tim Oates, David D. Jensen
- [[Paper]](https://pdfs.semanticscholar.org/e003/9dbdec3bd4cfbb3273b623fbed2d6b2f0cc9.pdf)
- **Unsupervised On-line Learning of Decision Trees for Hierarchical Data Analysis (NIPS 1997)**
- Marcus Held, Joachim M. Buhmann
- [[Paper]](https://papers.nips.cc/paper/1479-unsupervised-on-line-learning-of-decision-trees-for-hierarchical-data-analysis.pdf)
- **Data-Dependent Structural Risk Minimization for Perceptron Decision Trees (NIPS 1997)**
- John Shawe-Taylor, Nello Cristianini
- [[Paper]](https://papers.nips.cc/paper/1359-data-dependent-structural-risk-minimization-for-perceptron-decision-trees)
- **Generalization in Decision Trees and DNF: Does Size Matter (NIPS 1997)**
- Mostefa Golea, Peter L. Bartlett, Wee Sun Lee, Llew Mason
- [[Paper]](https://papers.nips.cc/paper/1340-generalization-in-decision-trees-and-dnf-does-size-matter.pdf)
## 1996
- **Second Tier for Decision Trees (ICML 1996)**
- Miroslav Kubat
- [[Paper]](https://pdfs.semanticscholar.org/b619/7c531b1c83dfaa52563449f9b8248cc68c5a.pdf)
- **Non-Linear Decision Trees - NDT (ICML 1996)**
- Andreas Ittner, Michael Schlosser
- [[Paper]](http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.85.2133&rep=rep1&type=pdf)
- **Learning Relational Concepts with Decision Trees (ICML 1996)**
- Peter Geibel, Fritz Wysotzki
- [[Paper]](https://pdfs.semanticscholar.org/32f1/78d7266fee779257b87ac8f948951db57d1e.pdf)
## 1995
- **A Hill-Climbing Approach for Optimizing Classification Trees (AISTATS 1995)**
- Xiaorong Sun, Steve Y. Chiu, Louis Anthony Cox Jr.
- [[Paper]](https://link.springer.com/chapter/10.1007%2F978-1-4612-2404-4_11)
- **An Exact Probability Metric for Decision Tree Splitting (AISTATS 1995)**
- J. Kent Martin
- [[Paper]](http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.48.6378&rep=rep1&type=pdf)
- **On Pruning and Averaging Decision Trees (ICML 1995)**
- Jonathan J. Oliver, David J. Hand
- [[Paper]](http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.53.6733&rep=rep1&type=pdf)
- **On Handling Tree-Structured Attributed in Decision Tree Learning (ICML 1995)**
- Hussein Almuallim, Yasuhiro Akiba, Shigeo Kaneda
- [[Paper]](https://www.sciencedirect.com/science/article/pii/B9781558603776500116)
- **Retrofitting Decision Tree Classifiers Using Kernel Density Estimation (ICML 1995)**
- Padhraic Smyth, Alexander G. Gray, Usama M. Fayyad
- [[Paper]](https://pdfs.semanticscholar.org/3a05/8ab505f096b23962591bb14e495a543aa2a1.pdf)
- **Increasing the Performance and Consistency of Classification Trees by Using the Accuracy Criterion at the Leaves (ICML 1995)**
- David J. Lubinsky
- [[Paper]](https://www.sciencedirect.com/science/article/pii/B9781558603776500530)
- **Efficient Algorithms for Finding Multi-way Splits for Decision Trees (ICML 1995)**
- Truxton Fulton, Simon Kasif, Steven Salzberg
- [[Paper]](https://www.sciencedirect.com/science/article/pii/B9781558603776500384)
- **Theory and Applications of Agnostic PAC-Learning with Small Decision Trees (ICML 1995)**
- Peter Auer, Robert C. Holte, Wolfgang Maass
- [[Paper]](https://igi-web.tugraz.at/PDF/77.pdf)
- **Boosting Decision Trees (NIPS 1995)**
- Harris Drucker, Corinna Cortes
- [[Paper]](http://papers.nips.cc/paper/1059-boosting-decision-trees.pdf)
- **Using Pairs of Data-Points to Define Splits for Decision Trees (NIPS 1995)**
- Geoffrey E. Hinton, Michael Revow
- [[Paper]](https://www.cs.toronto.edu/~hinton/absps/bcart.pdf)
- **A New Pruning Method for Solving Decision Trees and Game Trees (UAI 1995)**
- Prakash P. Shenoy
- [[Paper]](https://arxiv.org/abs/1302.4981)
## 1994
- **A Statistical Approach to Decision Tree Modeling (ICML 1994)**
- Michael I. Jordan
- [[Paper]](https://www.sciencedirect.com/science/article/pii/B9781558603356500519)
- **In Defense of C4.5: Notes Learning One-Level Decision Trees (ICML 1994)**
- Tapio Elomaa
- [[Paper]](http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.30.9386)
- **An Improved Algorithm for Incremental Induction of Decision Trees (ICML 1994)**
- Paul E. Utgoff
- [[Paper]](https://www.sciencedirect.com/science/article/pii/B9781558603356500465)
- **Decision Tree Parsing using a Hidden Derivation Model (NAACL 1994)**
- Frederick Jelinek, John D. Lafferty, David M. Magerman, Robert L. Mercer, Adwait Ratnaparkhi, Salim Roukos
- [[Paper]](http://acl-arc.comp.nus.edu.sg/archives/acl-arc-090501d3/data/pdf/anthology-PDF/H/H94/H94-1052.pdf)
## 1993
- **Using Decision Trees to Improve Case-Based Learning (ICML 1993)**
- Claire Cardie
- [[Paper]](https://www.cs.cornell.edu/home/cardie/papers/ml-93.ps)
## 1991
- **Context Dependent Modeling of Phones in Continuous Speech Using Decision Trees (NAACL 1991)**
- Lalit R. Bahl, Peter V. de Souza, P. S. Gopalakrishnan, David Nahamoo, Michael Picheny
- [[Paper]](https://www.aclweb.org/anthology/H91-1051.pdf)
## 1989
- **Performance Comparisons Between Backpropagation Networks and Classification Trees on Three Real-World Applications (NIPS 1989)**
- Les E. Atlas, Ronald A. Cole, Jerome T. Connor, Mohamed A. El-Sharkawi, Robert J. Marks II, Yeshwant K. Muthusamy, Etienne Barnard
- [[Paper]](https://papers.nips.cc/paper/203-performance-comparisons-between-backpropagation-networks-and-classification-trees-on-three-real-world-applications)
## 1988
- **Multiple decision trees (UAI 1988)**
- Suk Wah Kwok, Chris Carter
- [[Paper]](https://arxiv.org/abs/1304.2363)
## 1987
- **Decision Tree Induction Systems: A Bayesian Analysis (UAI 1987)**
- Wray L. Buntine
- [[Paper]](https://arxiv.org/abs/1304.2732)