Heads in Machine Learning Are Prediction Components of a Deep Neural Network

In deep learning networks, the head or heads of such a network is the “top” of the network (as opposed to the “bottom” that ingests data) that does some predictive task (such as a classification head or regression head). This is a separate component from the backbone network that does everything to produce the component on which the head or heads completes its tasks (in CNNs, this is the final convolutional feature map of the input image).

Pasted image 20231217225911 An example convolutional network for image detection (via the classification head) and localization (via the regression head). The Convolution and Pooling component is the backbone network.

Source#

Stack Overflow: What is a multi-headed model? And what exactly is a ‘head’ in a model?

This is a note from my working notes — 132 public notes that grow and get revised, unlike the dated posts.