You can enable "Show only the drawn area in layer thumbnails" from in the top bar. When this setting is on, the thumbnails in the Layer panel will display only the drawn parts of the layer.
Your changes will take effect the next time you open the canvas.
▼When enabled
▼When disabled