Hi Team , can someone help me with this issue. I h...
# supports
Saad Ansari
11/27/2023, 6:04 PMHi Team , can someone help me with this issue. I have deployed signoz using helm cmd , but getting the below issue during helm upgrade
Copy code
coalesce.go:175: warning: skipped value for zookeeper.initContainers: Not a table.
Error: UPGRADE FAILED: cannot patch "gg-signoz-schema-migrator-ecb41750145b" with kind Job: Job.batch "gg-signoz-schema-migrator-ecb41750145b" is invalid: spec.template: Invalid value: core.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:time.Date(1, time.January, 1, 0, 0, 0, 0, time.UTC), DeletionTimestamp:<nil>, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"<http://app.kubernetes.io/component|app.kubernetes.io/component>":"schema-migrator", "<http://app.kubernetes.io/instance|app.kubernetes.io/instance>":"gg-signoz", "<http://app.kubernetes.io/name|app.kubernetes.io/name>":"signoz", "<http://batch.kubernetes.io/controller-uid|batch.kubernetes.io/controller-uid>":"953acf58-9ead-4cd9-913b-ded5d232fdc7", "<http://batch.kubernetes.io/job-name|batch.kubernetes.io/job-name>":"gg-signoz-schema-migrator-ecb41750145b", "controller-uid":"953acf58-9ead-4cd9-913b-ded5d232fdc7", "job-name":"gg-signoz-schema-migrator-ecb41750145b"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:core.PodSpec{Volumes:[]core.Volume(nil), InitContainers:[]core.Container{core.Container{Name:"gg-signoz-schema-migrator-init", Image:"<http://docker.io/busybox:1.35|docker.io/busybox:1.35>", Command:[]string{"sh", "-c", "until wget --user \"${CLICKHOUSE_USER}:${CLICKHOUSE_PASSWORD}\" --spider -q gg-signoz-clickhouse:8123/ping; do echo -e \"waiting for clickhouseDB\"; sleep 5; done; echo -e \"clickhouse ready, starting schema migrator now\";"}, Args:[]string(nil), WorkingDir:"", Ports:[]core.ContainerPort(nil), EnvFrom:[]core.EnvFromSource(nil), Env:[]core.EnvVar{core.EnvVar{Name:"CLICKHOUSE_USER", Value:"admin", ValueFrom:(*core.EnvVarSource)(nil)}, core.EnvVar{Name:"CLICKHOUSE_PASSWORD", Value:"27ff0399-0d3a-4bd8-919d-17c2181e6fb9", ValueFrom:(*core.EnvVarSource)(nil)}, core.EnvVar{Name:"CLICKHOUSE_SECURE", Value:"false", ValueFrom:(*core.EnvVarSource)(nil)}}, Resources:core.ResourceRequirements{Limits:core.ResourceList(nil), Requests:core.ResourceList(nil), Claims:[]core.ResourceClaim(nil)}, ResizePolicy:[]core.ContainerResizePolicy(nil), VolumeMounts:[]core.VolumeMount(nil), VolumeDevices:[]core.VolumeDevice(nil), LivenessProbe:(*core.Probe)(nil), ReadinessProbe:(*core.Probe)(nil), StartupProbe:(*core.Probe)(nil), Lifecycle:(*core.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*core.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}}, Containers:[]core.Container{core.Container{Name:"schema-migrator", Image:"signoz/signoz-schema-migrator:0.88.1", Command:[]string(nil), Args:[]string{"--dsn", "<tcp://gg-signoz-clickhouse:9000?username=admin&password=27ff0399-0d3a-4bd8-919d-17c2181e6fb9>"}, WorkingDir:"", Ports:[]core.ContainerPort(nil), EnvFrom:[]core.EnvFromSource(nil), Env:[]core.EnvVar(nil), Resources:core.ResourceRequirements{Limits:core.ResourceList(nil), Requests:core.ResourceList(nil), Claims:[]core.ResourceClaim(nil)}, ResizePolicy:[]core.ContainerResizePolicy(nil), VolumeMounts:[]core.VolumeMount(nil), VolumeDevices:[]core.VolumeDevice(nil), LivenessProbe:(*core.Probe)(nil), ReadinessProbe:(*core.Probe)(nil), StartupProbe:(*core.Probe)(nil), Lifecycle:(*core.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*core.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]core.EphemeralContainer(nil), RestartPolicy:"OnFailure", TerminationGracePeriodSeconds:(*int64)(0xc01805b860), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string(nil), ServiceAccountName:"", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", SecurityContext:(*core.PodSecurityContext)(0xc01c53e480), ImagePullSecrets:[]core.LocalObjectReference(nil), Hostname:"", Subdomain:"", SetHostnameAsFQDN:(*bool)(nil), Affinity:(*core.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]core.Toleration(nil), HostAliases:[]core.HostAlias(nil), PriorityClassName:"", Priority:(*int32)(nil), PreemptionPolicy:(*core.PreemptionPolicy)(nil), DNSConfig:(*core.PodDNSConfig)(nil), ReadinessGates:[]core.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), Overhead:core.ResourceList(nil), EnableServiceLinks:(*bool)(nil), TopologySpreadConstraints:[]core.TopologySpreadConstraint(nil), OS:(*core.PodOS)(nil), SchedulingGates:[]core.PodSchedulingGate(nil), ResourceClaims:[]core.PodResourceClaim(nil)}}: field is immutablen
Nicolas Rakover
11/27/2023, 6:31 PMI've seen this due to a
schema-migratorkubectl -n <your signoz namespace> get jobskubectl -n <your signoz namespace> delete jobs/<name of schema migrator job>Nicolas Rakover
11/27/2023, 6:31 PMOnce you've cleaned that up, doing the
helms
Saad Ansari
11/27/2023, 7:48 PMyea it worked
Saad Ansari
11/27/2023, 7:48 PMthanks
p
Pranay
11/28/2023, 4:47 AM
Thanks for helping Saad @Nicolas Rakover 👍
n
Nicolas Rakover
11/28/2023, 5:12 PMyou got it dude
e
efajunk
11/29/2023, 10:12 PMHi! I'm trying to make a fresh install with helm, and this migrator has stuck and doesn't let it happen)
efajunk
11/29/2023, 10:14 PMI just get:
signoz-schema-migrator-init wget: bad address 'signoz-clickhouse:8123'
signoz-schema-migrator-init waiting for clickhouseDB
indefinitely in job's log
Is there any way to skip it when it's just the first deploy?)
efajunk
11/29/2023, 10:17 PMIs it safe to use
schemaMigrator:
enabled: false
for the first time?
efajunk
11/29/2023, 10:24 PMWell, temporary disabling the migrator was helpful. Thanks :D
77 Views