Done
Pinned fields
Click on the next to a field label to start pinning.
Details
Assignee
Igor GaponenkoIgor GaponenkoReporter
Igor GaponenkoIgor GaponenkoReviewers
Fritz MuellerRubinTeam
Data Access and DatabaseComponents
Sprint
Details
Details
Assignee
Igor Gaponenko
Igor GaponenkoReporter
Igor Gaponenko
Igor GaponenkoReviewers
Fritz Mueller
RubinTeam
Data Access and Database
Components
Sprint
Checklist
Checklist
Checklist
Created August 19, 2024 at 4:31 PM
Updated October 4, 2024 at 6:07 PM
Resolved October 4, 2024 at 6:07 PM
Specifically, the ticket’s title mentions the “build” container. Options for adding the relevant libraries (dependencies) will be investigated as well. The description will be adjusted accordingly based on the results of the investigation. No significant work on the Replication/INget system per se will ve done in the scope of this effort. A simple test application may be added to the collection of the Replication tools to demo the API.
AWS SDK would allow the Qser Replication/Ingest system to interact with the S3-compatible object stores. This is needed for:
ingest workflow:
pull Parquet files from a store
push translated and partitioned ingest products into a store
ingest system:
pulling table contributions from a store
replication system:
backing up table data into a store
restore table data from a store
Details on the latest version of the SDK can be found at: