How to avoid transforming data for a dropped column without updating glue catalog

Hello,

AWS Glue Data Catalog acts as meta-database for Redshift Spectrum.Hence, both Glue and Redshift Spectrum will have same schema information. If you drop a column in Redshift Spectrum , then it automatically gets dropped off from Glue catalog and Athena.

For example: I ran a glue crawler with S3 file which has below columns ->

friendlyid bigint, url string, status string, substatus string, starttime string, endtime string, actionabletime string

This created a table in Athena and Redshift . Then I altered the redshift table to drop the column "status"by using below command -> alter table spec_schema.antofagasta_waterloss_csv drop column status;

Now , when I check Glue and Athena , at both the places I dont see the column "status".

=======================================================================================================================================================

I hope you find the above information helpful.

 Thank you !