Hello!
I am hoping to get some clarification. I am trying to export fairly large datasets from some experiments that have over 300 hours of collection time. The temperature readings export without any difficulty, but growth rate and normalized OD files do not. I checked the logs and there is no error message related to what the UI suggests. The logs say the data exports finish, but no download file is ever generated. Is there a way to export these larger files without using the UI?
Hi @smst295
Is there a way to export these larger files without using the UI?
Yes, you can SSH into your leader, and run something like:
pio run export_experiment_data --output /var/www/pioreactorui/static/exports/output.zip --dataset-name growth_rates --dataset-name od_readings_filtered --experiment 'My Experiment 1' --experiment 'My other experiment' --partition-by-unit --partition-by-experiment
Just fill in the experiments you want (and add more experiments by appending more --experiment "x" to the command).
This will run the command, and show some progress too. Once it is done, in your web browser’s url, enter the url:
http://<whatever url you use to visit the UI>/static/exports/output.zip
ex:
http://pio_leader.local/static/exports/output.zip
and that should start the download.
Let me know if something doesn’t work, or you’d like to add some changes and need a hand!