Skip to content
This repository was archived by the owner on Jul 6, 2024. It is now read-only.

Convert Scorecard loading from "bq" to the BigQuery API #54

Open
scovetta opened this issue Jun 25, 2021 · 0 comments
Open

Convert Scorecard loading from "bq" to the BigQuery API #54

scovetta opened this issue Jun 25, 2021 · 0 comments

Comments

@scovetta
Copy link
Contributor

Currently, we're running a series of BigQuery commands (bq query, bq extract, and gsutil cp) to obtain the scorecard data dump in order to reload the database.

This requires an account to be logged in locally (using gcloud auth login). The account itself was created explicitly for this purpose, but it still isn't ideal. I also don't know how long until the authorization expires and the job would break.

I think by using the API, we can use a token of some sort. I'm not super familiar with the capabilities here. We should have someone look into this and convert the scorecard import job accordingly.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

1 participant