UMSL Genomics:Data Storage: Difference between revisions

From OpenWetWare
Jump to navigationJump to search
No edit summary
No edit summary
 
(No difference)

Latest revision as of 08:30, 17 December 2014

Home        Resources        Research        Data Storage        Publications        Contact       



Amazon Glacier Data Storage

Figure 1]
Java-based interface with Amazon Glacier

Information Technology Services at UMSL has made 110 TB of cloud-based storage available to the Biology Department. This storage is available from Amazon Glacier, which is described in detail here: Introduction to Amazon Glacier.

Getting Started
In order to interact with Amazon Glacier, you need three things:

  • An Access Key
  • A Secret Access Key
  • The appropriate Java file



Both of the access keys are provided by ITS and are unique for each user. If you need your keys, contact Michael Hughes (hughesmi <at> umsl.edu). The Java file can be downloaded here: File:Umsl glacier.jar. Please download this file and place it in an appropriate folder. Once it is downloaded, run the executable .jar file. This should open a window that looks like Figure 1. Copy and paste the Access Key and the Secret Access Key into the appropriate sections. From the "Vault Selection" drop down menu, select "UMSL Biologyvault". Now you're ready to go.


Uploading Files

It is recommended that all files for a project or data set be combined together into a single .zip or .tar.gz file. This will reduce the space on the cloud storage, but more importantly, it will simplify the management and retrieval of your data. Also, please include your sso id in the filename. For example, a useful filename for upload might be: "hughesmi_sequencing_12-12-14.zip." This will allow us to more easily keep track of each users footprint on the archive. Once you have your files ready, simply drag the file into the box on the right titled "Drag and Drop Files". Click "Upload". When you receive notification that it's finished, click on "View Log" in the middle of the interface, and copy the new entry somewhere safe for your records. It will be most convenient to have the ArchiveID handy when you wish to retrieve your files.


Downloading Files

Click on "Download Archive" in the middle of the Java interface. A pop-up window will appear. Copy and paste the ArchiveID for the file you wish to retrieve into the long section at the top of the pop-up window. For example, a typical ArchiveID looks something like this: "Ruh5cw7_O62Eqprx8J4IqHOOuGyJsf8UTZtkfy2SjXlEf1qzKuNsZ65rT3-uTYLPb99ayJlTG87x4xCXZsMseyvlMO_14SbQBqLLXFsgrqK7zNfw9m3XLiqosIyslXEo26TtNKFezw." Click on "Request Download" and when prompted, provide the new filename and directory you wish to download this file into. Note well: data retrieval is a slow process and may take as long as a day.


Deleting Files

Exactly the same as downloading files, except you click on "Delete Archive" in the top menu bar, and it does not take very long at all.


Questions?

Contact Michael Hughes: (hughesmi <at> umsl.edu).






UMSL Genomics
Department of Biology
University of Missouri, St. Louis