Generally, yes. Once you find a model you like, I would recommend double checking the owner’s manual or even search Amazon reviews for the camera just to confirm that it supports MJPEG.
For example, my Amcrest IP2M841 which I previously used as a baby camera previously supported MJPEG and then dropped support for it in a newer firmware! 
Probably not something that would happen commonly, but doesn’t hurt just to double check.