Using frontline version
If you do a run with the Big Quiver perk, then go back to town and replace it with another perk, it'll still stay active and you'll be able to pick up arrows up to 30.
I have Smart Start and HP % perk active, with the third slot unavailable to me in this screenshot.