Model: This model uses a deep neural network to predict the sentiment of a text input (positive, negative, or neutral). The network’s forward propagation is exemplified by:
$$ \mathbf{h}^{(l)} = f\Big(\mathbf{W}^{(l)}\mathbf{h}^{(l-1)} + \mathbf{b}^{(l)}\Big), \quad l = 1, \dots, L $$
$$ \hat{y} = \mathrm{softmax}\Big(\mathbf{W}^{(L)}\mathbf{h}^{(L-1)} + \mathbf{b}^{(L)}\Big) $$
$$ \hat{y} = \mathrm{softmax}\Big(\mathbf{W}^{(L)}\mathbf{h}^{(L-1)} + \mathbf{b}^{(L)}\Big) $$