That’s probably the first place I would start.
If you copied the link to the image while you were signed in and viewing a preview of it, then it might be an authenticated link.
You might try the following steps to get a raw direct link to the image.
Google Drive
For Google Drive it’s a bit more complicated, but there are a bunch of sites online that will convert the URL for you. (eg. https://www.gdirect.link/ )
When you get the shareable URL, it will be in the following format where XXXXX is the document ID:
https://drive.google.com/file/d/XXXXXX/view?usp=sharing
It needs to be in the format:
https://drive.google.com/uc?export=download&id=XXXXXX
Another user mentioned that resizing their images helped: