The 4x speed is all the drive is reporting. If the reported speeds vary if you eject + reinsert the disc, it must be having some sort of trouble reading them. So yeah, cleaning the drive may help. It could also be a sign of the drive dying.
avi and mp4 aren't disc image files, that's why they aren't on the 'supported' files list.