Implement RNN Unit (15 points)

[chris-dare]

You are required to implement the forward method of RNNUnit module. The description of the inputs and
expected outputs are specified below: (see page 4 for details)
Inputs
• x (effective batch size, input size)
– Input at the current time step.
– NOTE: For now interpret effective batch size same as regular batch size. The difference will
become apparent later in the homework.
• h (effective batch size, hidden size)
– Hidden state generated by the previous time step, ht−1
Outputs
• h prime: (effective batch size, hidden size)
– New hidden state generated at the current time step, h_t