I always felt like he dealt with rupees outside the confines of time. Somewhat like the Happy Mask Salesman. And then his "stamp" was some kind of time-spatial magic which allowed him to keep track of all customers in and out of time. The guy stays at his post until the very end (not that I've ever tested that ??), allowing you to still withdraw and deposit rupees.