Slackbot
01/19/2023, 5:33 AMShravan Kgl
01/19/2023, 6:32 AMShravan Kgl
01/19/2023, 6:43 AMSrikanth Chekuri
01/19/2023, 7:22 AMk8s_namespace_name
?Srikanth Chekuri
01/19/2023, 7:24 AMSELECT
database,
table,
formatReadableSize(sum(data_compressed_bytes) AS size) AS compressed,
formatReadableSize(sum(data_uncompressed_bytes) AS usize) AS uncompressed,
round(usize / size, 2) AS compr_rate,
sum(rows) AS rows,
count() AS part_count
FROM system.parts
WHERE (active = 1) AND (database LIKE '%') AND (table LIKE '%')
GROUP BY
database,
table
ORDER BY size DESC;
Ankit Nayan
Did you have materialised columns forthis could be coming from logs when you convert an interesting field to selected field cc @nitya-signoz?k8s_namespace_name
nitya-signoz
01/19/2023, 9:01 AMOPTIMIZE TABLE signoz_logs.logs final
Shravan Kgl
01/19/2023, 9:26 AMShravan Kgl
01/19/2023, 9:38 AMShravan Kgl
01/19/2023, 9:40 AMShravan Kgl
01/19/2023, 9:44 AMnitya-signoz
01/19/2023, 9:46 AMShravan Kgl
01/19/2023, 9:46 AMShravan Kgl
01/19/2023, 9:47 AMnitya-signoz
01/19/2023, 9:50 AMShravan Kgl
01/19/2023, 9:52 AMShravan Kgl
01/19/2023, 9:53 AMnitya-signoz
01/19/2023, 9:58 AMShravan Kgl
01/19/2023, 10:25 AMnitya-signoz
01/19/2023, 10:44 AMShravan Kgl
01/19/2023, 10:45 AMnitya-signoz
01/19/2023, 10:46 AMShravan Kgl
01/19/2023, 10:50 AMShravan Kgl
01/19/2023, 10:56 AMk8s-infra:
presets:
logCollection:
# whether to enable log collection
enabled: true
blacklist:
# whether to enable blacklisting
enabled: true
additionalExclude: ["log_file_path"]
Is this enoughnitya-signoz
01/19/2023, 11:29 AMextract_metadata_from_filepath
which will finally become like this
presets:
loggingExporter:
enabled: false
otlpExporter:
enabled: true
logsCollection:
enabled: true
include:
- /var/log/pods/*/*/*.log
startAt: beginning
includeFilePath: false
includeFileName: false
blacklist:
enabled: true
signozLogs: true
namespaces:
- kube-system
pods:
- hotrod
- locust
containers: []
additionalExclude: []
operators:
# Find out which format is used by kubernetes
- type: router
id: get-format
routes:
- output: parser-docker
expr: 'body matches "^\\{"'
- output: parser-crio
expr: 'body matches "^[^ Z]+ "'
- output: parser-containerd
expr: 'body matches "^[^ Z]+Z"'
# Parse CRI-O format
- type: regex_parser
id: parser-crio
regex: '^(?P<time>[^ Z]+) (?P<stream>stdout|stderr) (?P<logtag>[^ ]*) ?(?P<log>.*)$'
output: move-body
timestamp:
parse_from: attributes.time
layout_type: gotime
layout: '2006-01-02T15:04:05.000000000-07:00'
# Parse CRI-Containerd format
- type: regex_parser
id: parser-containerd
regex: '^(?P<time>[^ ^Z]+Z) (?P<stream>stdout|stderr) (?P<logtag>[^ ]*) ?(?P<log>.*)$'
output: move-body
timestamp:
parse_from: attributes.time
layout: '%Y-%m-%dT%H:%M:%S.%LZ'
# Parse Docker format
- type: json_parser
id: parser-docker
output: move-body
timestamp:
parse_from: attributes.time
layout: '%Y-%m-%dT%H:%M:%S.%LZ'
# Clean up log body
- type: move
id: move-body
from: attributes.log
to: body
Shravan Kgl
01/19/2023, 11:36 AMPrashant Shahi
01/19/2023, 11:55 AMIt means the pv’s are wiped. @Prashant Shahi can you help here.@Shravan Kgl can you share what happened here to cause that? Did anyone from team triggered upgrade command or removed PVs manually?
Shravan Kgl
01/19/2023, 11:56 AM