This message was deleted.
# supports
Slackbot
08/29/2023, 5:37 PMThis message was deleted.
v
Viljar Võidula
08/29/2023, 5:38 PMI've been using it for 1.5 months , been stable so far , no complaints, only thing to watch out is configuration , depending on setup might need to change some things
✅ 1
g
Godspower Unuane
08/29/2023, 5:40 PMjust keep getting this after every deployment
v
Viljar Võidula
08/29/2023, 5:41 PMah its probably the query service dying , k8s deployment?
g
Godspower Unuane
08/29/2023, 5:41 PMno docker-compose
v
Viljar Võidula
08/29/2023, 5:43 PMrecommend going over the logs - , might have more info, i had similar issues with way too large sampling on my apps and tracing enabled. Ran a single instance clickhouse on some cheap EC2 instance with gp2 storage
Viljar Võidula
08/29/2023, 5:43 PMi turned my sampling rate to 0.2 and increased storage to get more iops and was a lot better after
g
Godspower Unuane
08/29/2023, 5:43 PMi havent even connected it to anything yet
v
Viljar Võidula
08/29/2023, 5:44 PMoh 😞 then i dont know 😞
Viljar Võidula
08/29/2023, 5:45 PMon k8s the deployment takes quite a bit of time tho , for example when running on minikube
Viljar Võidula
08/29/2023, 5:45 PMit takes like 15 minutes for me to switch all the pods
u
Ulisses Silva
08/29/2023, 7:26 PMhow did you changed the sampling rate, @Viljar Võidula?
Using the settings from this page ? https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/processor/probabilisticsamplerprocessor
s
Srikanth Chekuri
08/30/2023, 12:15 PMSampling can happen at the collector or at the agent level (less sophisticated). @Viljar Võidula is probably referring to head based mode.
v
Viljar Võidula
08/30/2023, 12:16 PMsorry for late reply . i have self instrumented app and i modified sampling rate from the app code. Didnt know about collectors work at that time yet .
10 Views