-1

I have a 1GB tarred dataset that I wish to publish using a dedicated service (such as figshare or OSF.io) that hosts such databases, and additionally, e.g., counts the downloads.

My wish is to be able to download the dataset with wget command - to use it in a Jupyter Notebook.

Problems with the services tested so far: figshare -- the 1GB upload is stuck at 96-98% (tried a couple of times), and on OSF I was unable to download the dataset with wget.

I am aware that I could just use GDrive, Dropbox, or Github repository, but I'd like to have an external service for that, for two reasons:

  1. People don't download it from "my" resources;
  2. Count the number of downloads.

Do any of you know any other services that ship the functionalities I mentioned?

semmyk-research
  • 3,560
  • 1
  • 3
  • 23
Mikolaj Buchwald
  • 119
  • 3
  • 2
    I am not sure if this question fits the purpose or guideline of this site. There are probably other stack exchange sites that could answer this question better. – Job_September_2020 Apr 30 '23 at 00:02
  • There might be sites appropriate for your particular discipline. If that field has a SE site, ask there. – Ethan Bolker Apr 30 '23 at 00:54
  • Is this related to Academia? We do have questions about hosting e.g. data for papers https://academia.stackexchange.com/questions/187292/where-should-i-host-software-for-individual-papers if you're interested. But trying to drill into "can access with wget" seems out of scope. –  Apr 30 '23 at 01:25
  • FWIW Zenodo appears to support wget: https://github.com/zenodo/zenodo/issues/1629 – saritonin Apr 30 '23 at 06:31
  • 1
    Are you sure that this doesn't have to do with a limit on file sizes. I'm just guessing here, but 1000 is 97% of 1024 ... so if you have calculated your 1Gb based on a 1024 unit, and figshare calculate it on a 1000 unit AND (and here I'm unsure) there is a 1Gb file size limit then your upload WILL get stuck at somewhere between 96 and 98% – CrimsonDark Apr 30 '23 at 12:21
  • Thank you, I will try Zenodo. Figshare stucked randomly on: 94%, 96, or 98%. – Mikolaj Buchwald May 01 '23 at 08:57
  • SO on GitHub: https://stackoverflow.com/questions/21668239/how-do-i-track-file-download-count ... https://stackoverflow.com/questions/70062726/github-get-download-count-from-specific-file – semmyk-research May 01 '23 at 10:30
  • Also a good idea, especially that Zenodo doesn't seem to count wget downloads (only button clicks), or it takes some time to count/update the download, thank you semmyk – Mikolaj Buchwald May 01 '23 at 17:48

1 Answers1

1

To answer my own question: Zenodo supports both: downloading with wget, and counting the number of downloads/views.

Special thanks to @saritonin for pointing me it that direction. To be honest, I completely forgot about Zenodo. :)

Mikolaj Buchwald
  • 119
  • 3