988 n5 export rpc #1047
Merged
988 n5 export rpc #1047
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Basic GUI that lets you choose compression type before exportation. Has no wiring for GUI.
Refactored the auto generated code conn*To* functions and making them inline.
Refactor most of the automatically generated code within PDEExportDataPanel to help the code become more readable.
Initial code written to allow exporting using the RPC service and write the files where they need to be.
Added functionality of exportation to the java GUI elements.
Allows users to specify the name they want for their dataset.
Forgot to delete a duplicate dependency in the POM file.
Let users decide a time range for the data they are exporting to N5. No longer does it have to be the entire time block.
The order of a functions input was wrong and I fixed it.
Changed the initialization of tests, but not the underlying test itself.
The exporter just writes the data directly to N5 directory, making thing's significantly easier.
Align the files that depend on the N5 export service to work with its new configuration.
Exports without using the tmp file storage unit
Make N5 and secondary sim data required properties.
Changed the naming scheme of datasets to follow a string template and revised tests to use this naming scheme.
Make the export data be within a singular bucket and have the URL represent where the data is served on the S3Proxy instance.
Make there be no pop-up to download the exported data.
Removed the code for the old export code that didn't go through an RPC service. Also removed functionality of the API calls, making them return nothing for now.
Closed
AvocadoMoon
commented
Dec 5, 2023
Basic GUI that lets you choose compression type before exportation. Has no wiring for GUI.
Refactored the auto generated code conn*To* functions and making them inline.
Refactor most of the automatically generated code within PDEExportDataPanel to help the code become more readable.
Added functionality of exportation to the java GUI elements.
Allows users to specify the name they want for their dataset.
Forgot to delete a duplicate dependency in the POM file.
Let users decide a time range for the data they are exporting to N5. No longer does it have to be the entire time block.
The order of a functions input was wrong and I fixed it.
Changed the initialization of tests, but not the underlying test itself.
The exporter just writes the data directly to N5 directory, making thing's significantly easier.
Align the files that depend on the N5 export service to work with its new configuration.
Exports without using the tmp file storage unit
Make N5 and secondary sim data required properties.
Changed the naming scheme of datasets to follow a string template and revised tests to use this naming scheme.
Make the export data be within a singular bucket and have the URL represent where the data is served on the S3Proxy instance.
Make there be no pop-up to download the exported data.
Removed the code for the old export code that didn't go through an RPC service. Also removed functionality of the API calls, making them return nothing for now.
jcschaff
force-pushed
the
988-n5-export-rpc
branch
from
019d2a3 to
a526776
Compare
… 988-n5-export-rpc
Before I used bean utils to cast the format Specs object to N5Specs, now I use atomic type casting.
jcschaff
force-pushed
the
988-n5-export-rpc
branch
from
02f87f3 to
a526776
Compare
Before I used bean utils to cast the format Specs object to N5Specs, now I use atomic type casting.
jcschaff
requested changes
Dec 5, 2023
… 988-n5-export-rpc
Added the required N5 env variables for the shell script to function properly.
Fixed the newline in my config file and replaced all string versions of the N5 file suffix with literals.
jcschaff
approved these changes
Dec 7, 2023
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
I've added functionality for the GUI to send an RPC request to export sim data into an N5 file format, and for that request to be handled by an N5 export service which can finish the request and host it at an S3 endpoint.