It turns out there is a way to do this.
Put your 'contact' page in:
Then add the following line to your
page "/contact/index.php", :directory_index => false
You'll end up with an
index.php file in the
contact directory, just the way (I think) you want it.