📕 subnode [[@KGBicheno/co adaptation]] in 📚 node [[co-adaptation]]

co-adaptation

Go back to the [[AI Glossary]]

When neurons predict patterns in training data by relying almost exclusively on outputs of specific other neurons instead of relying on the network's behavior as a whole. When the patterns that cause co-adaption are not present in validation data, then co-adaptation causes overfitting. Dropout regularization reduces co-adaptation because dropout ensures neurons cannot rely solely on specific other neurons.

📖 stoas
⥱ context