migrating a BIG site, issues, how to?

Question

_THE SHORT QUESTION_: How do I upload a huge website to EB?    
  
-----  
  
_IN MORE DETAILS_:  
  
I have inherited a website that must be migrated. (old host got bought out, new company will not support or install PostgreSQL)  
  
The site is huge over 40GB and over 125,000 files. (after I cleaned things up and removed tmp data) The site is going to be replaced, so I am not about to do a major restructure on it.  
  
The database is ready in RDS, but trying to upload the files has not worked. I didn't even try to upload a zip to the AWS Console.  I think it would exceed MAX_POST_SIZE, So I installed EB CLI. It works, I can eb shh without issue.  
  
I ran eb deploy and after 3 hours, I went home for the day and left it running.  I came in this morning to "**ERROR: FileTooLargeError - Archive cannot be any larger than 512MB**"  
  
Can EB handle a large website?  What if I want to make a small change, do I have to re-zip and upload the entire website every time??? This seems wasteful, even uploading 10MB for a "2-bit change"  
  
at this point I am leaning towards just spinning up an EC2 and running it in a "traditional" manner.  but I want to use EB for the application I am developing now, and it will grow to an even larger size.  Of course it will be designed for distributed data using S3 for the bulk of content.

Answer

So the answer then is no, there is no other way.  Yes, the site limit is 512Mb. And yes, you must re-deploy the entire site for a 2 bit change. Bummer.

Answer

Hello,  
  
There is a maximum size limit to the application zip file being uploaded to Beanstalk for deployment, in this case it is 512MB. This is a hard limit and cannot be changed.  
  
For more information, please see:  
http://docs.aws.amazon.com/elasticbeanstalk/latest/dg/using-features.deployment.html  
  
In general, for assets such as images, it would be better to have them stored in S3 and served by S3, where the Beanstalk environment's EC2 instances only runs your code. That way, serving images are offloaded to S3, and subsequent deployments due to EC2 instance replacements or scale out by your Beanstalk environments autoscaling group will be much faster.  
  
Thanks,  
Brennon

Answer

So I ended up just setting up an Amazon Linux EC2 with Apache2 & php.  I let filezilla upload the files over sftp without any issues.  
  
As per usual, automagic didn't work.

migrating a BIG site, issues, how to?

관련 콘텐츠