What are valid format for Sagemaker model monitor baseline dataset's header?

NO.

https://docs.aws.amazon.com/sagemaker/latest/dg/model-monitor-create-baseline.html

All column names in your baseline dataset must be compliant with Spark. For column names, use only lowercase characters, and _ as the only special character.

ex Feature_names