All Content tagged with Amazon Data Firehose

Amazon Data Firehose provides the easiest way to acquire, transform, and deliver data streams within seconds to data lakes, data warehouses, and analytics services.

Content language: English

Select tags to filter
Sort by most recent
151 results
I'm using **Amazon Kinesis Data Firehose** to deliver streaming data into an **Apache Iceberg table** registered in the **AWS Glue Data Catalog**, which is part of a non-default catalog (`s3tablescata...
1
answers
0
votes
26
views
asked 4 days ago
Hello, I have configured an **Amazon Kinesis Data Firehose** delivery stream to deliver data directly into an **Apache Iceberg table**, using the **Direct PUT** method. The destination is set as an I...
1
answers
0
votes
57
views
asked 7 days ago
Hello I'm using firehose to get inputs from kinesis streams and to write to S3 tables, my question is, Can one input record be mapped to multiple output records? Is this answer still valid https://r...
1
answers
0
votes
57
views
asked 10 days ago
I am trying to set the identifier-field-ids to the Iceberg tables so that Firehose can perform update/delete operations on Iceberg tables as cannot add unique keys on dynamic database. I am creating I...
1
answers
0
votes
118
views
AWS
asked 17 days ago
I want to send data from firehose to S3 Tables , Is there any working example or document available , I am unable to find a working example ,step by step
1
answers
0
votes
164
views
asked a month ago
Would it not be be best to incorporate kinesis data firehose features as options into services that want to deliver to s3 etc., at least in AWS services, for example kinesis data analytics? That can e...
1
answers
0
votes
30
views
asked a month ago
I have Firehouse which sends data to Redshift. It was working fine and then all of sudden it stopped sending data to Redshift. It sends the data fine to s3 but fails to send to Redshift. I have follo...
1
answers
0
votes
34
views
asked 2 months ago
I am emitting records from lambda function using firehose.put_record_batch function. However firehose raises delivery error even though python record exactly matches the schema of the table. identifie...
1
answers
0
votes
61
views
asked 2 months ago
The JSON data with a nested structure is streamed into FireHose via a direct put over to S3 through a Glue schema that is configured. It has been noticed from querying via Athena or S3 files that only...
1
answers
0
votes
77
views
asked 2 months ago
I have a firehose stream to copy json data from s3 to redshift with a lambda processor in between. The lambda is formatting the data in base64 and redshift is copy succesfully the data into the table...
1
answers
0
votes
35
views
asked 2 months ago
A company has one million users that use its mobile app. The company must analyze the data usage in near-real time. The company also must encrypt the data in near-real time and must store the data in ...
2
answers
0
votes
63
views
asked 2 months ago
For a specific web service in API Gateway, we send incoming JSON requests to SQS, which then forwards them to an EventBridge event bus. A rule on the event bus directs the messages to Firehose for fur...
2
answers
0
votes
153
views
asked 3 months ago