Please go to Settings->Import Settings and uncheck "Process EXIF Data". Then your images will show up with the rotation you are expecting. Note that if you've imported any files since that setting was introduced, you may end up with different songs with different orientation issues. This setting was introduced because the Android version has been incorrectly handling image file rotation, and it created an incompatibility with the Windows version that handles it properly. So for new users, that setting is on by default, but it's supposed to be turned off for existing users, however one of the updates did not address that correctly, so it was enabled for all users. If you want to have correct rotation between Android and Windows, then you'll have to manually rotate all of your song files. For example, you can load your song file, tap the second icon at the bottom left, then Rotation, then just rotate the page 90 degrees and it should show up just fine.
Mike
Mike