If you want the data, try booting with a Linux Live CD such as Knoppix. You can then connect your USB HD and then copy files over from your Win98 system.

And yes, reinstalling Windows will delete...