With Windows and Mac it’s easy to copy all of the necessary files to the USB, since the installations are self-contained. (See this earlier post for Mac; hopefully Windows is just as simple?.)
I don’t know about Linux, but do you think that any of your target audience are Linux users? And if so, wouldn’t they be comfortable just installing Gramps?