Hello Signoz people I’m having issues setting up...
# support
r
Hello Signoz people I’m having issues setting up cold storage It’s not really clear what should be put in these variables in the following section: —— clickhouse: coldStorage: enabled: true defaultKeepFreeSpaceBytes: "1073741824" type: gcs endpoint: "" accessKey: "???" secretAccess: “???” —— For the context we’re on GCP and Kubernetes and I tried to put k8s secret name and secret’s key name there but that didn’t work. The secret contains bucket json key. Any suggestions?
r
@Nagesh Bansal i did exactly like that, (check snippet above), still I’m not sure folder is being written to, although no free space left. I checked the docs section for kubernetes and did exactly according to it
ok, will roll back to it, since it crashed the CHI can you confirm the type should be
gcs
as in docs?
n
@Roman Levytskyi the type should be
gcs
if you're going for gcs the helm charts ensure ClickHouse is compatible with GCS can you share the logs from the clickhouse pod
r
clickhouse.txt
i attached the log, can you have a quick look?
looks like sth s3 related
n
Please ensure that both keys are of following format:
Copy code
access_key_id: SERVICE ACCOUNT HMAC KEY
secret_access_key: SERVICE ACCOUNT HMAC SECRET
r
can you please elaborate more @Nagesh Bansal? i currently have it like this:
Copy code
accessKey: "service-account-key"
secretAccess: "signoz-storage-secret"
r
thanks @Nagesh Bansal is it possible to use
valueFrom
on both of those keys?
because it’s highly insecure to put them inline
@Nagesh Bansal any thoughts?
n
Hey @Roman Levytskyi, let me check what can we do here
although were you able to make it work
r
yes, it’s working fine, although retrieving traces/logs got slower now, the issue is that the secrets are right in the manifest, which is unsafe and they should stay in k8s secrets
question: if we check traces, and the trace is a recent one, is there any chance that SigNoz is also checking the cold storage although IMO it shouldn’t?
asking because trace retrieval takes a very long time now, around 20-30 seconds