Skip to content

Making data downloadable from our web server

Jump to bottom
Jochen Weile edited this page Jun 5, 2023 · 1 revision

Making data downloadable from our web server

Making sequencing data from rothseq1 or rothsequt available on our development web server dalai requires two(!) separate network transfers. This is because the web content is located on a storage partition which is only visible to dalai (/dev/mapper/vgdata-lv_srv). Neither rothseq1 nor rothsequt can directly talk to dalai.

Of the currently active lab members, only the following have profiles on dalai from which files can be linked: Dayag, Daniel T., Fritz, Jochen, Warren. If you'd like to be on that list, you may have to ask our Sysadmin Thomas to set you up.

Procedure

  1. Transfer data to galen as an intermediate.
    • If the data is on rothseq1, log into it and cp the data to somewhere in your home directory (to make it accessible via galen). Even though it might be tempting, don't use ln, as the link would just break later on dalai where rothseq1's file system isn't mounted.
    • If the data is currently located on rothseq-ut, you must be physically located in the lab (as being elsewhere would require running two VPNs at the same time, which tend to interact unpredicably). Start a VPN connection to the other site (LTRI or CCBR depending on your current location). Use scp -3 [email protected]:/path/to/file [email protected]:~/ with appropriate origin and destination arguments to initiate a triangle-transfer to your home directory on galen. (Replace /path/to/file as appropriate). Depending on file size this may take several hours.
  2. Transfer data from galen to dalai.
    • Log into dalai.mshri.on.ca and go to /srv/www/people/$USER (This is where the /dev/mapper/vgdata-lv_srv is mounted). Copy (again, don't softlink!) the file to an appropriate folder within. This may again take some time (but hopefully not as long as the scp transfer from step 1).
    • Grant read permission to the apache server pseudo-user via chmod o+r <FILE>
  3. The files will become visible at http://dalai.mshri.on.ca/~$USER
  4. Remember to delete the intermediate copy from galen to not needless use up disk space.
Clone this wiki locally