You would need a static tunnel. The ssh connection when querying the normal agent will be closed after a few seconds.