Year wrongly set to 2022 for AWS Kinesis Firehose Delivery Stream to S3

0

AWS Region: ap-southeast-1

Currently I am using the AWS Kinesis Firehose Delivery Stream to Stream the Cloudwatch Logs to S3 with the Prefix appending Timestamp, like this /year=!{timestamp:YYYY}/month=!{timestamp:MM}/day=!{timestamp:dd}/hour=!{timestamp:HH}/

However, found that after 25 Dec 2021, the Log File to S3 was wrongly put the Object to e.g. /year=2022/month=12/day=26/hour=00 now.

Anyone has the same issue now, looks critical issue for us as we use this timestamp for Partitioning on AWS Athena

preguntada hace 2 años444 visualizaciones
1 Respuesta
0
Respuesta aceptada

Hello Keith,

The Amazon Kinesis Firehose Delivery Stream uses Java DateTimeFormatter.

Amazon Kinesis Firehose Delivery Stream: The timestamp namespace

y means year-of-era / Y means Week-based-year

Please use "year=!{timestamp:yyyy}" instead of "year=!{timestamp:YYYY}".

Thank you

AWS
Sean_P
respondido hace 2 años
AWS
EXPERTO
revisado hace 2 años
  • Oh, thanks for remind on using the Java DateTimeFormatter, let me update the CloudFormation and see the case can be resolved.

    Thanks Sean!

No has iniciado sesión. Iniciar sesión para publicar una respuesta.

Una buena respuesta responde claramente a la pregunta, proporciona comentarios constructivos y fomenta el crecimiento profesional en la persona que hace la pregunta.

Pautas para responder preguntas