We should invent new futuristic physical media. They should have real heft and ideally make a satisfying noise when you plug them in and be completely overegineered, so they last as long or longer as pottery. Something like upgraded MiniDisc, cassettes or USB sticks. If you plug it in, the device and the connector should be sturdy enough to stand on.

Maybe looking like this labeler cartridge:

Or like isolinear chips from Star Trek:

I know Microsoft is doing something similar with Project Silica.

Please anyone, if you can give examples from fiction or reality, I’m happy to hear it.