How do I stop getting billed for Services that I can't turn off/disable/delete?

Are these documents helpful?

https://docs.aws.amazon.com/kms/latest/developerguide/deleting-keys-scheduling-key-deletion.html

https://docs.aws.amazon.com/cloud-map/latest/dg/deleting-services.html

Assuming the Keys you mentioned are AWS managed keys, you won't be able to delete them since these are the default keys created for different AWS services but you won't be charged for the storage of these keys, Amazon States the following;

You are not charged for the following:

Creation and storage of AWS managed or AWS owned KMS keys. These keys are automatically created on your behalf when you first attempt to encrypt a resource in an AWS service that integrates with AWS KMS. You can neither manage the lifecycle nor access permissions on AWS managed keys.

Source -> https://aws.amazon.com/kms/pricing/

The only charge that would occur would be the chargers for the API calls.

I would suggest you take a look at AWS Cost explorer and filter by usage or service type. This will provide you with a better idea of where these chargers are coming from and identify any resources that are the cause of this.

AWS Cost Explorer -> https://docs.aws.amazon.com/cost-management/latest/userguide/ce-filtering.html