Move EMR Notebooks S3 directory structure between accounts

Question

Hi!
So, we are currently working on migrating between 2 accounts.
In the old account, we were working with EMR Notebooks directly, without EMR Studio or EMR WorkSpaces.
In the new account, we made the necessary steps to start working with EMR Studio and EMR WorkSpaces.

However, when we manually migrate the old notebooks from their S3 location to the new S3 location for the respective workspace, only the notebooks in root level directory appear, and not the whole directory structure. Even more surprisingly, when I create a folder through the Jupyter UI with the exact name as in the S3, the respective notebooks appear. This last behavior prompts me to eliminate any permissions issues.

Of course, I have tried to attach/re-attach/restart the respective WorkSpaces.

Have you any suggestion on what is happening here and how can I solve this?

Thanks!

Answer

Hello Nikos,

To answer your question, we require details that are non-public information. Could you please open a support case with AWS using the following link https://console.aws.amazon.com/support/home#/case/create ?

Answer

Hello Nikos,

Please execute the following steps:
In JupyterLab open a terminal session and execute the following command:

`find ~/work/  ! -readable  -maxdepth 1 2>/dev/null -print0 | xargs -0 mkdir || true`

Please confirm if you can view the folders now. Please note you might need to adjust the "maxdepth" parameter from 1 to 2, etc. based on your directory depth level.

Please let us know if the step work for you Nikos.

Move EMR Notebooks S3 directory structure between accounts

Relevant content