I cannot reproduce this in any of the following cases:
- Edit Book > Preview
- Edit Chapter of a Book > Preview
- Create Book > Preview
- Create Chapter of a Book > Preview
- Create Book as Chapter of a Different Book > Preview
If you can reproduce this issue consistently on different books, please provide more information.