Questions tagged with Amazon Data Firehose
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Can you explain the trade-offs and considerations involved in choosing between the "direct" and "buffering" delivery modes in Amazon Kinesis Firehose, and under what scenarios each mode would be more...
1
answers
0
votes
776
views
asked a year agolg...
Hi,
I am writing data to S3 from an event bus using dynamic partitioning of the scheme...
1
answers
1
votes
687
views
asked a year agolg...
How do you debug your Eventbridge pipe line with self hosted kafka as source and firehose as targetlg...
Hello,
I am having hard time getting the eventbridge pipeline to work. I tried all different combinations. I am using the self hosted kafka cluster(cloudkarafka.com deployed on aws) and my target is...
0
answers
0
votes
116
views
asked a year agolg...
Delivering records to Security Lake custom source prefix is not possible with Kinesis Firehose?lg...
I'm trying to set up custom sources for Security Lake and have a Kinesis Firehose delivery stream configured to deliver parquet files into the Security Lake bucket under the ext/ prefix.
The problem...
1
answers
0
votes
322
views
asked a year agolg...
I want to take advantage of AWS Kinesis Data Firehose with a destination of HTTP endpoint to stream text records. The destination expects for authentication an HTTP header of the form:...
1
answers
0
votes
952
views
asked a year agolg...
Hi there, I'm looking at my CloudWatch logs to try to estimate the average size of a record delivered to S3 via my firehose instance. Here's my math:
I look at `Records delivered to Amazon S3 (Sum)`...
1
answers
0
votes
527
views
asked a year agolg...
I have an architecture where two entities are posting data to an API gateway. They both follow their own (different) json schema, API GW then pushes it into Kinesis Stream/Firehose. Should I create a...
1
answers
0
votes
769
views
asked a year agolg...
Is there an additional cost when we compress data like bzip? It is not clear from the firehose pricing web and I need this information for some realistic cost...
2
answers
0
votes
316
views
asked a year agolg...
Hi there! I'm streaming a bunch of json data into an s3 bucket via firehose. I was wondering what's the best practice for uniqueness checks on those individual json objects since firehose aggregates...
2
answers
0
votes
422
views
asked a year agolg...
I want to create a real time data streaming dashboard on Quicksight using a 3rd Party API Endpoint. Can anyone suggest how to proceed ?
1
answers
0
votes
297
views
asked a year agolg...
Hi all,
We are working on a solution based on **CloudWatch Logs Destinations** and **Kinesis Firehose** to be able to centralize **CloudWatch Logs** coming from **multiple Application Accounts**...
1
answers
0
votes
2152
views
asked a year agolg...
I am trying to confirm my OpenSearch setup is working but I am not able to insert new data to confirm this. Here are a list of commands and response I am seeing from OpenSearch. My goal is to hook...
0
answers
0
votes
151
views
asked a year agolg...