So basically, as far as the story is concerned, each chapter would be an hour of story time, even if it takes much longer for the player to get through the chapter?
That doesn't sound weird to me at all. Most games have no concept of time, or a distorted view of it anyway. I say go with your story idea.