Navigate to the HTML file you wish to open and double-click it to you that file in your browser. Internet Explorer becomes your default browser when you install Windows.

As a result of this, to preview a file you will need to first set up Safari to open the HTML file on disk, and then when you save changes in TextWrangler you will need to refresh the browser to ...