Hello!
In the Async version of the DQN(etc) implementation, I was wondering if there is a good way to pass information from the asynchronous Actor to the agent. In my case, I would like to use the logger to print some info about inner workings of the Actor (action probas), but in the general case, I think it can often make sense to pass some print/plot/debug data from one to the other. For example, I can also think of the total number of steps, which is computed from the number of passed transitions; but this isn't very robust for me since I push additional transitions to the entries in the _transition method.
Would it make sense to add a PASS_INFO operation along with the STEP/NETWORKS... operations from the async Actor? And the Agent could grab said info at will.
Thanks in advance for any help!
Hello!
In the Async version of the DQN(etc) implementation, I was wondering if there is a good way to pass information from the asynchronous Actor to the agent. In my case, I would like to use the logger to print some info about inner workings of the Actor (action probas), but in the general case, I think it can often make sense to pass some print/plot/debug data from one to the other. For example, I can also think of the total number of steps, which is computed from the number of passed transitions; but this isn't very robust for me since I push additional transitions to the entries in the _transition method.
Would it make sense to add a PASS_INFO operation along with the STEP/NETWORKS... operations from the async Actor? And the Agent could grab said info at will.
Thanks in advance for any help!