bigquery: refactor RowIterator to support fast query path (#2484)

This CL significantly revamps the rowiterator.

Previously, row iteration necessitated a reference to a Table object.
For jobs, this meant we would consult job statistics to find the
reference to the destination table.

With this change, we switch to using the jobs.getQueryResults RPC to get
rows from a job, while still allowing table reads to use the existing
tabledata.list mechanism.

This change also includes support for a caching abstraction in the row
iterator, which is added but not yet leveraged.  This will be wired up
in subsequent PRs that change the query execution path.

Additionally, this PR address some other reported issues against the library as the use of jobs.getQueryResults allows the service to make decisions about the source of results (e.g. in cases where a scripting/multistatement query returns resultsets from a child job).

Fixes: #1960, #1974
6 files changed
tree: e81df5c145f42280929db2785526c9979db7ab7a
  1. .github/
  2. .gitignore
  9. asset/
  10. automl/
  11. bigquery/
  12. bigtable/
  13. billing/
  14. civil/
  15. cloudbuild/
  16. cloudtasks/
  17. cmd/
  18. compute/
  19. container/
  20. containeranalysis/
  21. datacatalog/
  22. dataproc/
  23. datastore/
  24. debugger/
  25. dialogflow/
  26. dlp/
  27. doc.go
  28. errorreporting/
  29. examples_test.go
  30. expr/
  31. firestore/
  32. functions/
  33. gaming/
  34. go.mod
  35. go.sum
  36. grafeas/
  37. httpreplay/
  38. iam/
  39. internal/
  40. iot/
  41. kms/
  42. language/
  43. license_test.go
  44. logging/
  45. longrunning/
  46. memcache/
  47. monitoring/
  48. osconfig/
  49. oslogin/
  50. phishingprotection/
  51. profiler/
  52. pubsub/
  53. recaptchaenterprise/
  54. recommender/
  55. redis/
  56. rpcreplay/
  57. scheduler/
  58. secretmanager/
  59. securitycenter/
  60. servicedirectory/
  61. spanner/
  62. speech/
  63. storage/
  64. talent/
  65. texttospeech/
  66. tools.go
  67. trace/
  68. translate/
  69. videointelligence/
  70. vision/
  71. webrisk/

Google Cloud Client Libraries for Go


Go packages for Google Cloud Platform services.

import ""

To install the packages on your system, do not clone the repo. Instead:

  1. Change to your project directory:

    cd /my/cloud/project
  2. Get the package you want to use. Some products have their own module, so it's best to go get the package(s) you want to use:

    $ go get # Replace with the package you want to use.

NOTE: Some of these packages are under development, and may occasionally make backwards-incompatible changes.

NOTE: Github repo is a mirror of

Supported APIs

Google APIStatusPackage
Data Loss
Text To

Alpha status: the API is still being actively developed. As a result, it might change in backward-incompatible ways and is not recommended for production use.

Beta status: the API is largely complete, but still has outstanding features and bugs to be addressed. There may be minor backwards-incompatible changes where necessary.

Stable status: the API is mature and ready for production use. We will continue addressing bugs and feature requests.

Documentation and examples are available at

Go Versions Supported

We support the two most recent major versions of Go. If Google App Engine uses an older version, we support that as well.


By default, each API will use Google Application Default Credentials for authorization credentials used in calling the API endpoints. This will allow your application to run in many environments without requiring explicit configuration.

client, err := storage.NewClient(ctx)

To authorize using a JSON key file, pass option.WithCredentialsFile to the NewClient function of the desired package. For example:

client, err := storage.NewClient(ctx, option.WithCredentialsFile("path/to/keyfile.json"))

You can exert more control over authorization by using the package to create an oauth2.TokenSource. Then pass option.WithTokenSource to the NewClient function: snip:# (auth-ts)

tokenSource := ...
client, err := storage.NewClient(ctx, option.WithTokenSource(tokenSource))


Contributions are welcome. Please, see the CONTRIBUTING document for details.

Please note that this project is released with a Contributor Code of Conduct. By participating in this project you agree to abide by its terms. See Contributor Code of Conduct for more information.