It looks like my decision to go Kindle is timely. Amazon has just announced that they will be releasing the Kindleware for Windows and it should be able to synchronize books between my PC and my yet-to-arrive Kindle.
As far as I know, the Kindle doesn’t come with any PC software (yet) and the upcoming Kindleware should be able to fill this void.