You need to update every slave the same way as the master.
Yes you have to update the agents manually. Or you keep the current agent version, this should work also. It is possible that some agent plugins need an update but this depends on the used plugins.