Search the app name (press the Windows key on the keyboard or click the button in the corner). Click “Open File Location ... to replace the boring old taskbar icons with personalized ones.
Old File Explorer allows drag and ... classic File Explorer first and then open its Windows 11 counterpart by right-clicking ...
Windows 11 Taskbar has the File Explorer icon pinned by default ... However, if you use Windows 10, you can use the old method to pin any File Explorer folder to the Taskbar.