- Newest
- Most votes
- Most comments
Worth taking a look at this:
-
Use S3 Cross-Region Replication (CRR) Strategically Since you can’t move all data to one region, replicate only the subset of data needed for processing in the US East (N. Virginia) region using S3 CRR. This avoids repeated cross-region fetches and reduces transfer costs over time.
-
Cache with CloudFront or Lambda@Edge • Leverage CloudFront to cache S3 content at edge locations near your EC2 instances. • Leveraging Lambda@Edge can preprocess or filter data before it hits your app.
-
PrivateLink may not benefit here since it doesn’t reduce inter-region transfer costs.
-
Consider S3 Access Points for Fine-Grained Access S3 Access Points help manage access policies per application or team, but do not directly reduce transfer costs. However, they can help enforce data residency boundaries by restricting access to region-specific endpoints.
-
Analyze and Model Transfer Costs • Cost and Usage Reports (CUR) • CUDOS Dashboard (via QuickSight) • Athena queries to identify top transfer sources/destinations
-
Architect for Local Processing If feasible, shift compute to the data instead of pulling data to compute. For example, spin up EC2 or Lambda in Frankfurt to pre-process or filter data before sending only the results to N. Virginia.
For compliance + cost + performance, bringing compute to the data is almost always better than bringing data to the compute.
For real time data processing, you can write a lambda function with api gateway in Frankfurt region ad invoke the API from EC2. You can set caching for API. This ideal for compliance and cost control.
S3 replication and CloudFront does not help with compliance since the data will be temporarily stored in a different region. S3 access point won't reduce cost.
Relevant content
asked 2 years ago
asked 3 years ago
