#280 till relies on the old `gym.make` for the creation of the replay env and should use the new env config.
#280 till relies on the old
gym.makefor the creation of the replay env and should use the new env config.