So I now think you are describing the Files app. The file explorer.
The Files app, when first opened displays Recent.
The upper row of icons and all of the view below are “Android shortcuts”. Files app does not work like an old school file explorer in this mode. (Maybe it works in “Safe mode” !)
Using the three bar menu top left opens a navigator, the top part of this panel continues to link to shortcuts, while a small lower section (one or two entries only) links to a regular file explorer:
Device (by name)
SD card (if correctly installed as external storage).
So now tap the Device.
This view still has the Android shortcuts along the top. Disregard them.
This view occupying the rest of the screen is now more like a regular file explorer. Only now can you delete and rename, hopefully more as you expect.
In addition, the view is toggled by a switch in the upper part of screen, below the shortcuts, on the left.
https://doc.e.foundation/support-topics
[HOWTO] Use the Files App