The private key associated with an address (erd1...) needs to be stored in a specific format. In order to use that private key to sign transactions and perform various actions, one needs a wallet.
There are multiple ways you can store your funds. The following page will showcase some of them: https://docs.multiversx.com/wallet/overview