Build an interface for network creation

[s-sd]

options include: conv or fully connected
should take: input shape and output shape and continuous/ discrete/ multi-discrete
should output a constructed network

[i-gayo]

Will build on this! @i-gayo @s-sd

[s-sd]

That's great! Thanks @i-gayo ! Let me know if any help needed. You can directly create a branch called something like issue-10 and create a PR when you're ready to merge it to main. :)

A few additional related things:

• Best to put this in utils as a function that can be called.
• The simpler and more readable the implementation, the better.
• For multi-discrete networks, we want a branched network, each outputting the num_actions specified in multi-discrete e.g., if the user defines the actions space as MultiDiscrete([[2, 3], [2,4]]), we want 4 network branches, each with the number of nodes specified.
• Also MultiDiscrete should simplify to MultiBinary for cases where num-actions=2.

MultiDiscrete is a complicated case so you can even leave that for later, since I have not yet implemented REINFORCE for it yet. Let me know if any thoughts or ideas.

[i-gayo]

Implemented this function for discrete and continuous action spaces, but will still need to do a few things:

1. Implement for multi-discrete cases
2. Finalise input types / shapes for function
3. Check compatibility with demos, to check for bugs in code
4. (Optional) write tests