s3fox does not create valid export manifest files
Author: Chuck Edwards | | December 27, 2009
S3fox provides a handy utility for creating import manifest and signature files; however, it doesn’t seem to properly create export manifests. In fact, it seems like it only creates import manifest files. The version I used was 0.4.8.
Here’s a screenshot of the s3fox create manifest interface:
Note there is nowhere in the GUI to specify export or import. Note also in the manifest preview on the right that the exportBucket token is not visible. Looking at the spec for export the exportBucket token is required for AWS to know where to get your data. Without it, you’ll get a note from Amazon asking what you’re trying to do. So, if you want to export data from an S3 bucket to a USB drive, it’s best to manually create a manifest file according to the AWS spec.
If you manually create an export manifest, you’ll also need to manually create a signature file. The procedure for manually creating signature files was not immediately obvious (to me, anyway) on the AWS site, but I found it on Jeorge Escobar’s blog (thanks, Jeorge!) You’ll need to download the signature tool then in a command line terminal, change to the signature tool directory and run the following command:
java -jar lib/AWSImportClientSignatureTool-1.0.jar <manifest file> <job ID> <SIGNATURE file>
Once you have the manifest and signature file, you can simply follow the documented procedure and expect to see your USB drive in a few days.
Related Posts
How to Solve the Oracle Error ORA-12154: TNS:could not resolve the connect identifier specified
The “ORA-12154: TNS Oracle error message is very common for database administrators. Learn how to diagnose & resolve this common issue here today.
Data Types: The Importance of Choosing the Correct Data Type
Most DBAs have struggled with the pros and cons of choosing one data type over another. This blog post discusses different situations.
How to Recover a Table from an Oracle 12c RMAN Backup
Our database experts explain how to recover and restore a table from an Oracle 12c RMAN Backup with this step-by-step blog. Read more.