Any flash drive will be compabile. It's just hardware.
But, that flash drive needs to be formatted with a file system that both Windows and your Mac can read, and you need to be able to copy files from the 10.4.11 Mac to that flash drive.
Fat32 will work. So will ExFat. NTFS will not, unless you have NTFS drivers installed on your 10.4.11 Mac