Skip to content

Total novice, who likes helping beginners get started?

0

I consider myself technically proficient, but not CLI level etc. and I am getting nowhere fast on my own.

I am simply trying to use AWS Deep Glacier for ~7TB of video archives as a DR vault in case of emergency. Plan is to back it up from my Synology NAS directly.

I cant even seem to get started. I tried creating a user and access key to the vault.

In the Glacier backup app, I get testing connection failed. I then was going to try to just backup to S3 and migrate to glacier, so I used Synology hyper backup which seems to connect but says insufficient permissions.

After 1.5 days banging my head, I am humbly admitting I may be in over my head - TIA for any help :)

asked 6 months ago59 views
2 Answers
0

It's great that you're looking to set up a disaster recovery solution using AWS Glacier for your video archives. Many beginners find AWS services challenging at first, so you're not alone in feeling overwhelmed. Let's break this down into simpler steps to help you get started.

First, it's important to understand that Amazon S3 Glacier is primarily designed for long-term, low-cost storage of data that is rarely accessed. For your use case of backing up from a Synology NAS, it's actually recommended to use S3 with Glacier storage classes rather than using Glacier directly.

Here's a simplified approach you can try:

  1. Start by creating an S3 bucket in the AWS console. This will be easier to work with than Glacier directly.

  2. When creating your bucket, you can choose the S3 Glacier Flexible Retrieval (formerly S3 Glacier) or S3 Glacier Deep Archive storage class. This will give you the cost benefits of Glacier with the easier management of S3.

  3. For user access, create an IAM user with programmatic access. This will give you an access key ID and secret access key.

  4. Attach a policy to this user that gives it permission to access your S3 bucket. You might start with the AmazonS3FullAccess policy, but for better security, you should create a custom policy that only allows access to your specific bucket.

  5. Use these credentials in your Synology Hyper Backup application. Make sure you're using the S3 backup option, not the Glacier option.

If you're still getting "insufficient permissions" errors, double-check your IAM user's permissions. Make sure they have rights to list buckets, and read/write objects in your specific bucket.

Remember, it's okay to start small. Try uploading a small amount of data first to test your setup before attempting to backup all 7TB.

If you continue to have trouble, don't hesitate to reach out to AWS support or consult their documentation. They have extensive guides and tutorials that can help you through the process step-by-step.

Lastly, keep in mind that while AWS services are powerful, they can have a steep learning curve. Take your time, be patient with yourself, and don't be afraid to ask for help. Many AWS professionals started exactly where you are now!
Sources
Community | 5 Tips I Wish I'd Known When I Was New to AWS
What Is Amazon S3 Glacier? - Amazon S3 Glacier

answered 6 months ago
AWS
EXPERT
reviewed 6 months ago
0

If you're looking for archival storage solutions use the S3 Glacier storage classes in Amazon S3 like S3 Glacier Flexible Retrieval, and S3 Glacier Deep Archive instead of using S3 Glacier Vault . To learn more about these storage options, see S3 Glacier storage classes and Long-term data storage using S3 Glacier storage classes in the Amazon S3 User Guide. These storage classes use the Amazon S3 API, are available in all regions, and can be managed within the Amazon S3 console/CLI/SDK. They offer features like Storage Cost Analysis, Storage Lens, advanced optional encryption features, and more.

https://docs.aws.amazon.com/amazonglacier/latest/dev/introduction.html https://docs.aws.amazon.com/AmazonS3/latest/userguide/glacier-storage-classes https://docs.aws.amazon.com/AmazonS3/latest/userguide/storage-class-intro.html#sc-glacier https://docs.aws.amazon.com/AmazonS3/latest/userguide/storage-class-intro.html#sc-compare

Some example commands are provided to use those storage classes at below link: https://docs.aws.amazon.com/AmazonS3/latest/userguide/sc-howtoset.html https://awscli.amazonaws.com/v2/documentation/api/2.0.34/reference/s3api/put-object.html https://docs.aws.amazon.com/cli/latest/reference/s3/cp.html

You should also think about restore strategy and procedure for your archive. Here are some links for the same:

https://repost.aws/knowledge-center/restore-s3-object-glacier-storage-class https://docs.aws.amazon.com/cli/latest/reference/s3api/restore-object.html

AWS
answered 6 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.