storage/internal/benchserver: make body reads idempotent

When we converted "files" to be
    map[string]io.Reader
we used an io.LimitedReader that then unfortunately
meant that multiple runs wouldn't stream back the
content. That's because when io.LimitedReader hits
io.EOF, we need to reset its N for it to read
more from rand.Reader.

This would then mean that the second request would
stream back 0 bytes, which is not what we want.

An update to make this reset would be a bit complex,
so instead make "files"
    map[string]int64
mapping the file name to its size. When a request
is then made for the file, we'll create a fresh
io.LimitedReader, which produces the correct behavior.

Change-Id: I609da9458fc28efece4967a73520b5ac6214f6cb
Reviewed-on: https://code-review.googlesource.com/c/gocloud/+/44191
Reviewed-by: kokoro <noreply+kokoro@google.com>
Reviewed-by: Alex Hong <hongalex@google.com>
1 file changed
tree: dade634a45df77020a7b163a27405e150893f153
  1. asset/
  2. automl/
  3. bigquery/
  4. bigtable/
  5. civil/
  6. cloudtasks/
  7. cmd/
  8. compute/
  9. container/
  10. containeranalysis/
  11. dataproc/
  12. datastore/
  13. debugger/
  14. dialogflow/
  15. dlp/
  16. errorreporting/
  17. expr/
  18. firestore/
  19. functions/
  20. grafeas/
  21. httpreplay/
  22. iam/
  23. internal/
  24. iot/
  25. irm/
  26. kms/
  27. language/
  28. logging/
  29. longrunning/
  30. monitoring/
  31. oslogin/
  32. phishingprotection/
  33. profiler/
  34. pubsub/
  35. recaptchaenterprise/
  36. redis/
  37. rpcreplay/
  38. scheduler/
  39. securitycenter/
  40. spanner/
  41. speech/
  42. storage/
  43. talent/
  44. texttospeech/
  45. trace/
  46. translate/
  47. videointelligence/
  48. vision/
  49. webrisk/
  50. CHANGES.md
  51. cloud.go
  52. CODE_OF_CONDUCT.md
  53. CONTRIBUTING.md
  54. examples_test.go
  55. go.mod
  56. go.sum
  57. issue_template.md
  58. LICENSE
  59. license_test.go
  60. README.md
  61. regen-gapic.sh
  62. RELEASING.md
  63. tidyall.sh
  64. tools.go
README.md

Google Cloud Client Libraries for Go

GoDoc

Go packages for Google Cloud Platform services.

import "cloud.google.com/go"

To install the packages on your system, do not clone the repo. Instead use

$ go get -u cloud.google.com/go/...

NOTE: Some of these packages are under development, and may occasionally make backwards-incompatible changes.

NOTE: Github repo is a mirror of https://code.googlesource.com/gocloud.

Supported APIs

Google APIStatusPackage
Assetalphacloud.google.com/go/asset/v1beta
BigQuerystablecloud.google.com/go/bigquery
Bigtablestablecloud.google.com/go/bigtable
Cloudtasksstablecloud.google.com/go/cloudtasks/apiv2
Containerstablecloud.google.com/go/container/apiv1
ContainerAnalysisbetacloud.google.com/go/containeranalysis/apiv1beta1
Dataprocstablecloud.google.com/go/dataproc/apiv1
Datastorestablecloud.google.com/go/datastore
Debuggeralphacloud.google.com/go/debugger/apiv2
Dialogflowalphacloud.google.com/go/dialogflow/apiv2
Data Loss Preventionalphacloud.google.com/go/dlp/apiv2
ErrorReportingalphacloud.google.com/go/errorreporting
Firestorestablecloud.google.com/go/firestore
IAMstablecloud.google.com/go/iam
IoTalphacloud.google.com/iot/apiv1
KMSstablecloud.google.com/go/kms
Natural Languagestablecloud.google.com/go/language/apiv1
Loggingstablecloud.google.com/go/logging
Monitoringalphacloud.google.com/go/monitoring/apiv3
OS Loginalphacloud.google.com/go/oslogin/apiv1
Pub/Substablecloud.google.com/go/pubsub
Phishing Protectionalphacloud.google.com/go/phishingprotection/apiv1betad1
reCAPTCHA Enterprisealphacloud.google.com/go/recaptchaenterprise/apiv1betad1
Memorystorealphacloud.google.com/go/redis/apiv1
Schedulerstablecloud.google.com/go/scheduler/apiv1
Spannerstablecloud.google.com/go/spanner
Speechstablecloud.google.com/go/speech/apiv1
Storagestablecloud.google.com/go/storage
Talentalphacloud.google.com/go/talent/apiv4beta1
Text To Speechalphacloud.google.com/go/texttospeech/apiv1
Tracealphacloud.google.com/go/trace/apiv2
Translatestablecloud.google.com/go/translate
Video Intelligencealphacloud.google.com/go/videointelligence/apiv1beta1
Visionstablecloud.google.com/go/vision/apiv1

Alpha status: the API is still being actively developed. As a result, it might change in backward-incompatible ways and is not recommended for production use.

Beta status: the API is largely complete, but still has outstanding features and bugs to be addressed. There may be minor backwards-incompatible changes where necessary.

Stable status: the API is mature and ready for production use. We will continue addressing bugs and feature requests.

Documentation and examples are available at godoc.org/cloud.google.com/go

Go Versions Supported

We support the two most recent major versions of Go. If Google App Engine uses an older version, we support that as well.

Authorization

By default, each API will use Google Application Default Credentials for authorization credentials used in calling the API endpoints. This will allow your application to run in many environments without requiring explicit configuration.

client, err := storage.NewClient(ctx)

To authorize using a JSON key file, pass option.WithCredentialsFile to the NewClient function of the desired package. For example:

client, err := storage.NewClient(ctx, option.WithCredentialsFile("path/to/keyfile.json"))

You can exert more control over authorization by using the golang.org/x/oauth2 package to create an oauth2.TokenSource. Then pass option.WithTokenSource to the NewClient function: snip:# (auth-ts)

tokenSource := ...
client, err := storage.NewClient(ctx, option.WithTokenSource(tokenSource))

Contributing

Contributions are welcome. Please, see the CONTRIBUTING document for details. We‘re using Gerrit for our code reviews. Please don’t open pull requests against this repo, new pull requests will be automatically closed.

Please note that this project is released with a Contributor Code of Conduct. By participating in this project you agree to abide by its terms. See Contributor Code of Conduct for more information.