Nokia Lumia 920 - Can I use Cinemagraph in portrait mode on my Nokia Lumia device?

Yes. Both portrait and landscape modes are supported.