Starting with Windows 11 build 22557, File Explorer will show a thumbnail preview of folder contents on the folder’s icon. Usually, the last item added to the folder will show as a thumbnail preview on the folder’s icon.
You can change the folder icon to show any custom icon you want instead of the folders’ default icon or thumbnail preview.
This tutorial will show you how to change the icon of a folder in Windows 11.