Gini Vs Entropy
Essentially there is not much difference between the two because they essentially do the same thing, however the difference comes when looking at the specifics and subtleties.
The points to remember when deciding are:
- Entropy uses logarithms under the cover so it can be slower.
- Gini is generally better for Continuous attributes
- Gini is better when you want to minimise classification
- Entropy may be better suited to exploratory analysis.
- In the vast majority of cases the outcome is unaffected
Charted as Unit Square we get this which implies a marginal difference between the two.
People who enjoyed this article also enjoyed the following:
Naive Bayes classification AI algorithm
K-Means Clustering AI algorithm
Equity Derivatives tutorial
Fixed Income tutorial
And the following Trails:
C++Java
python
Scala
Investment Banking tutorials
HOME
