Add the AWS SDK for C++ into the Qserv build container

Description

Specifically, the ticket’s title mentions the “build” container. Options for adding the relevant libraries (dependencies) will be investigated as well. The description will be adjusted accordingly based on the results of the investigation. No significant work on the Replication/INget system per se will ve done in the scope of this effort. A simple test application may be added to the collection of the Replication tools to demo the API.

AWS SDK would allow the Qser Replication/Ingest system to interact with the S3-compatible object stores. This is needed for:

  • ingest workflow:

    • pull Parquet files from a store

    • push translated and partitioned ingest products into a store

  • ingest system:

    • pulling table contributions from a store

  • replication system:

    • backing up table data into a store

    • restore table data from a store

Details on the latest version of the SDK can be found at:

Issue Matrix

hide

Activity

Show:

Igor Gaponenko October 4, 2024 at 6:07 PM

The PR was reviewed and approved by .

Igor Gaponenko September 27, 2024 at 6:34 AM

Done
Pinned fields
Click on the next to a field label to start pinning.

Details

Assignee

Reporter

Reviewers

Fritz Mueller

RubinTeam

Data Access and Database

Components

Sprint

Checklist

Created August 19, 2024 at 4:31 PM
Updated October 4, 2024 at 6:07 PM
Resolved October 4, 2024 at 6:07 PM