Windows has the Safely Remove Hardware option. But this is cumbersome. You get several dialog boxes before you can eject a drive. And then there's the aggravating message you get when the drive is ready to be removed.
If this annoys you, try USB Disk Ejector. This free program is simple and fast to use.