Skip to content

[BUG] flaky test #10789

Description

@cjc7373

test 1

https://github.com/apecloud/kubeblocks/actions/runs/32095654810/job/95586440678?pr=10734

• [FAILED] [12.181 seconds]
ParameterView Controller [It] refreshes to Synced when runtime config drifts without a draft
/home/runner/work/kubeblocks/kubeblocks/controllers/parameters/parameterview_controller_test.go:2061

  Timeline >>
  STEP: clean resources @ 08/18/26 03:36:27.822
  STEP: clear resources Cluster @ 08/18/26 03:36:27.822
  STEP: clear resources ClusterDefinition @ 08/18/26 03:36:27.824
  STEP: clear resources ComponentDefinition @ 08/18/26 03:36:27.825
  STEP: clear resources ComponentVersion @ 08/18/26 03:36:27.827
  STEP: clear resources ParametersDefinition @ 08/18/26 03:36:27.829
  STEP: clear resources ParamConfigRenderer @ 08/18/26 03:36:27.83
  STEP: clear resources ComponentDefinition @ 08/18/26 03:36:27.832
  STEP: clear resources Component @ 08/18/26 03:36:27.833
  STEP: clear resources ConfigMap @ 08/18/26 03:36:27.835
  STEP: clear resources Secret @ 08/18/26 03:36:27.837
  STEP: clear resources InstanceSet @ 08/18/26 03:36:27.838
  STEP: clear resources ComponentParameter @ 08/18/26 03:36:27.84
  STEP: clear resources ParameterView @ 08/18/26 03:36:27.841
  STEP: clear resources Parameter @ 08/18/26 03:36:27.843
  STEP: Create a config template obj @ 08/18/26 03:36:27.845
  STEP: Create a parameters definition obj @ 08/18/26 03:36:27.846
  STEP: Create a component definition obj and mock to available @ 08/18/26 03:36:28.658
  STEP: wait until the current cache can resolve parameter bindings for the component definition @ 08/18/26 03:36:28.771
  STEP: Creating a cluster @ 08/18/26 03:36:28.798
  STEP: Create a component obj @ 08/18/26 03:36:28.801
  STEP: Create a ITS obj @ 08/18/26 03:36:28.804
  [FAILED] in [It] - /home/runner/work/kubeblocks/kubeblocks/controllers/parameters/parameterview_controller_test.go:2130 @ 08/18/26 03:36:38.941
  STEP: clean resources @ 08/18/26 03:36:38.941
  STEP: clear resources Cluster @ 08/18/26 03:36:38.941
  STEP: clear resources ClusterDefinition @ 08/18/26 03:36:38.945
  STEP: clear resources ComponentDefinition @ 08/18/26 03:36:38.947
  STEP: clear resources ComponentVersion @ 08/18/26 03:36:38.952
  STEP: clear resources ParametersDefinition @ 08/18/26 03:36:38.954
  STEP: clear resources ParamConfigRenderer @ 08/18/26 03:36:39.901
  STEP: clear resources ComponentDefinition @ 08/18/26 03:36:39.908
  STEP: clear resources Component @ 08/18/26 03:36:39.911
  STEP: clear resources ConfigMap @ 08/18/26 03:36:39.924
  STEP: clear resources Secret @ 08/18/26 03:36:39.947
  STEP: clear resources InstanceSet @ 08/18/26 03:36:39.951
  STEP: clear resources ComponentParameter @ 08/18/26 03:36:39.958
  STEP: clear resources ParameterView @ 08/18/26 03:36:39.986
  STEP: clear resources Parameter @ 08/18/26 03:36:39.995
  << Timeline

  [FAILED] Timed out after 10.001s.
  The function passed to Eventually failed at /home/runner/work/kubeblocks/kubeblocks/controllers/parameters/parameterview_controller_test.go:2129 with:
  Expected
      <string>: [client]
      host=localhost
      socket=/var/run/mysqld/mysqld.sock
      
      [mysqld]
      consensus_auto_leader_transfer=ON
      general_log=0
      gtid_mode=OFF
      innodb-buffer-pool-size=512M
      log-bin=master-bin
      pid-file=/var/run/mysqld/mysqld.pid
      port=3306
      server-id=1
      slow_query_log=0
      socket=/var/run/mysqld/mysqld.sock
      
  to contain substring
      <string>: gtid_mode=ON
  In [It] at: /home/runner/work/kubeblocks/kubeblocks/controllers/parameters/parameterview_controller_test.go:2130 @ 08/18/26 03:36:38.941
------------------------------
W0818 03:36:40.004103   33341 reflector.go:462] pkg/mod/k8s.io/client-go@v0.29.14/tools/cache/reflector.go:229: watch of *v1.InstanceSet ended with: an error on the server ("unable to decode an event from the watch stream: context canceled") has prevented the request from succeeding
W0818 03:36:40.004161   33341 reflector.go:462] pkg/mod/k8s.io/client-go@v0.29.14/tools/cache/reflector.go:229: watch of *v1alpha1.ParameterView ended with: an error on the server ("unable to decode an event from the watch stream: context canceled") has prevented the request from succeeding
W0818 03:36:40.004223   33341 reflector.go:462] pkg/mod/k8s.io/client-go@v0.29.14/tools/cache/reflector.go:229: watch of *v1alpha1.ParamConfigRenderer ended with: an error on the server ("unable to decode an event from the watch stream: context canceled") has prevented the request from succeeding
W0818 03:36:40.004249   33341 reflector.go:462] pkg/mod/k8s.io/client-go@v0.29.14/tools/cache/reflector.go:229: watch of *v1alpha1.ParametersDefinition ended with: an error on the server ("unable to decode an event from the watch stream: context canceled") has prevented the request from succeeding
W0818 03:36:40.004284   33341 reflector.go:462] pkg/mod/k8s.io/client-go@v0.29.14/tools/cache/reflector.go:229: watch of *v1alpha1.Parameter ended with: an error on the server ("unable to decode an event from the watch stream: context canceled") has prevented the request from succeeding
W0818 03:36:40.004308   33341 reflector.go:462] pkg/mod/k8s.io/client-go@v0.29.14/tools/cache/reflector.go:229: watch of *v1alpha1.ComponentParameter ended with: an error on the server ("unable to decode an event from the watch stream: context canceled") has prevented the request from succeeding
W0818 03:36:40.004331   33341 reflector.go:462] pkg/mod/k8s.io/client-go@v0.29.14/tools/cache/reflector.go:229: watch of *v1.ComponentDefinition ended with: an error on the server ("unable to decode an event from the watch stream: context canceled") has prevented the request from succeeding
W0818 03:36:40.004364   33341 reflector.go:462] pkg/mod/k8s.io/client-go@v0.29.14/tools/cache/reflector.go:229: watch of *v1.Component ended with: an error on the server ("unable to decode an event from the watch stream: context canceled") has prevented the request from succeeding
W0818 03:36:40.004387   33341 reflector.go:462] pkg/mod/k8s.io/client-go@v0.29.14/tools/cache/reflector.go:229: watch of *v1.ConfigMap ended with: an error on the server ("unable to decode an event from the watch stream: context canceled") has prevented the request from succeeding

Summarizing 1 Failure:
  [FAIL] ParameterView Controller [It] refreshes to Synced when runtime config drifts without a draft
  /home/runner/work/kubeblocks/kubeblocks/controllers/parameters/parameterview_controller_test.go:2130

Ran 42 of 42 Specs in 98.129 seconds
FAIL! -- 41 Passed | 1 Failed | 0 Pending | 0 Skipped

test 2

https://github.com/apecloud/kubeblocks/actions/runs/32092614780/job/95577721589?pr=10734


------------------------------
• [FAILED] [11.330 seconds]
Cluster Controller cluster provisioning [It] creates one KubeBlocks TLS source shared by every shard
/home/runner/work/kubeblocks/kubeblocks/controllers/apps/cluster/cluster_controller_test.go:800

  Timeline >>
  STEP: clean resources @ 08/18/26 02:45:05.436
  STEP: clear resources Cluster @ 08/18/26 02:45:05.436
  STEP: clear resources ClusterDefinition @ 08/18/26 02:45:05.439
  STEP: clear resources ComponentDefinition @ 08/18/26 02:45:05.442
  STEP: clear resources ComponentVersion @ 08/18/26 02:45:05.444
  STEP: clear resources Component @ 08/18/26 02:45:05.446
  STEP: clear resources PersistentVolumeClaim @ 08/18/26 02:45:05.449
  STEP: clear resources Pod @ 08/18/26 02:45:05.451
  STEP: clear resources VolumeSnapshot @ 08/18/26 02:45:05.454
  STEP: clear resources Service @ 08/18/26 02:45:05.459
  STEP: clear resources StorageClass @ 08/18/26 02:45:05.462
  STEP: clear resources ShardingDefinition @ 08/18/26 02:45:05.464
  STEP: Create a componentDefinition obj @ 08/18/26 02:45:05.467
  STEP: Create a componentVersion obj @ 08/18/26 02:45:05.48
  STEP: Create a clusterDefinition obj @ 08/18/26 02:45:05.483
  STEP: Wait objects available @ 08/18/26 02:45:05.49
  STEP: scaling out without rotating the shared CA @ 08/18/26 02:45:06.482
  [FAILED] in [It] - /home/runner/work/kubeblocks/kubeblocks/controllers/apps/cluster/cluster_controller_test.go:852 @ 08/18/26 02:45:16.491
  STEP: clean resources @ 08/18/26 02:45:16.491
  STEP: clear resources Cluster @ 08/18/26 02:45:16.491
  STEP: clear resources ClusterDefinition @ 08/18/26 02:45:16.561
  STEP: clear resources ComponentDefinition @ 08/18/26 02:45:16.593
  STEP: clear resources ComponentVersion @ 08/18/26 02:45:16.648
  STEP: clear resources Component @ 08/18/26 02:45:16.685
  STEP: clear resources PersistentVolumeClaim @ 08/18/26 02:45:16.687
  STEP: clear resources Pod @ 08/18/26 02:45:16.692
  STEP: clear resources VolumeSnapshot @ 08/18/26 02:45:16.696
  STEP: clear resources Service @ 08/18/26 02:45:16.699
  STEP: clear resources StorageClass @ 08/18/26 02:45:16.703
  STEP: clear resources ShardingDefinition @ 08/18/26 02:45:16.706
  STEP: clean resources @ 08/18/26 02:45:16.732
  STEP: clear resources Cluster @ 08/18/26 02:45:16.732
  STEP: clear resources ClusterDefinition @ 08/18/26 02:45:16.734
  STEP: clear resources ComponentDefinition @ 08/18/26 02:45:16.737
  STEP: clear resources ComponentVersion @ 08/18/26 02:45:16.741
  STEP: clear resources Component @ 08/18/26 02:45:16.745
  STEP: clear resources PersistentVolumeClaim @ 08/18/26 02:45:16.747
  STEP: clear resources Pod @ 08/18/26 02:45:16.75
  STEP: clear resources VolumeSnapshot @ 08/18/26 02:45:16.753
  STEP: clear resources Service @ 08/18/26 02:45:16.756
  STEP: clear resources StorageClass @ 08/18/26 02:45:16.76
  STEP: clear resources ShardingDefinition @ 08/18/26 02:45:16.763
  << Timeline

  [FAILED] Timed out after 10.001s.
  The function passed to Eventually failed at /home/runner/work/kubeblocks/kubeblocks/controllers/apps/cluster/cluster_controller_test.go:841 with:
  Expected
      <[]v1.Component | len:2, cap:4>: [
          {
              TypeMeta: {
                  Kind: "Component",
                  APIVersion: "apps.kubeblocks.io/v1",
              },
              ObjectMeta: {
                  Name: "test-clusterkynaxr-mysql-jsw",
                  GenerateName: "",
                  Namespace: "default",
                  SelfLink: "",
                  UID: "b2b2eb12-94bc-44b4-a30c-18d5f77578d5",
                  ResourceVersion: "447",
                  Generation: 1,
                  CreationTimestamp: {
                      Time: 2026-08-18T02:45:06Z,
                  },
                  DeletionTimestamp: nil,
                  DeletionGracePeriodSeconds: nil,
                  Labels: {
                      "app.kubernetes.io/managed-by": "kubeblocks",
                      "apps.kubeblocks.io/component-name": "mysql-jsw",
                      "apps.kubeblocks.io/sharding-name": "mysql",
                      "app.kubernetes.io/component": "test-compdefjixvrq",
                      "app.kubernetes.io/instance": "test-clusterkynaxr",
                  },
                  Annotations: {
                      "apps.kubeblocks.io/cluster-uid": "66fb2451-0e90-4c11-a641-b0e288fdc6e6",
                      "kubeblocks.io/generation": "3",
                  },
                  OwnerReferences: [
                      {
                          APIVersion: "apps.kubeblocks.io/v1",
                          Kind: "Cluster",
                          Name: "test-clusterkynaxr",
                          UID: "66fb2451-0e90-4c11-a641-b0e288fdc6e6",
                          Controller: true,
                          BlockOwnerDeletion: true,
                      },
                  ],
                  Finalizers: [
                      "cluster.kubeblocks.io/finalizer",
                  ],
                  ManagedFields: [
                      {
                          Manager: "cluster.test",
                          Operation: "Update",
                          APIVersion: "apps.kubeblocks.io/v1",
                          Time: {
                              Time: 2026-08-18T02:45:06Z,
                          },
                          FieldsType: "FieldsV1",
                          FieldsV1: {
                              Raw: "{\"f:metadata\":{\"f:annotations\":{\".\":{},\"f:apps.kubeblocks.io/cluster-uid\":{},\"f:kubeblocks.io/generation\":{}},\"f:finalizers\":{\".\":{},\"v:\\\"cluster.kubeblocks.io/finalizer\\\"\":{}},\"f:labels\":{\".\":{},\"f:app.kubernetes.io/component\":{},\"f:app.kubernetes.io/instance\":{},\"f:app.kubernetes.io/managed-by\":{},\"f:apps.kubeblocks.io/component-name\":{},\"f:apps.kubeblocks.io/sharding-name\":{}},\"f:ownerReferences\":{\".\":{},\"k:{\\\"uid\\\":\\\"66fb2451-0e90-4c11-a641-b0e288fdc6e6\\\"}\":{}}},\"f:spec\":{\".\":{},\"f:compDef\":{},\"f:flatInstanceOrdinal\":{},\"f:ordinals\":{},\"f:podUpdatePolicy\":{},\"f:replicas\":{},\"f:resources\":{},\"f:serviceVersion\":{},\"f:terminationPolicy\":{},\"f:tlsConfig\":{\".\":{},\"f:enable\":{},\"f:issuer\":{\".\":{},\"f:name\":{},\"f:secretRef\":{\".\":{},\"f:ca\":{},\"f:cert\":{},\"f:key\":{},\"f:name\":{},\"f:namespace\":{}}}}}}",
                          },
                          Subresource: "",
                      },
                  ],
              },
              Spec: {
                  TerminationPolicy: "WipeOut",
                  CompDef: "test-compdefjixvrq",
                  ServiceVersion: "8.0.31-r1",
                  ServiceRefs: nil,
                  Labels: nil,
                  Annotations: nil,
                  Env: nil,
                  Resources: {Limits: nil, Requests: nil, Claims: nil},
                  VolumeClaimTemplates: nil,
                  PersistentVolumeClaimRetentionPolicy: nil,
                  Volumes: nil,
                  Network: nil,
                  Services: nil,
                  SystemAccounts: nil,
                  Replicas: 1,
                  Configs: nil,
                  ServiceAccountName: "",
                  ParallelPodManagementConcurrency: nil,
                  PodUpdatePolicy: "PreferInPl...

  Gomega truncated this representation as it exceeds 'format.MaxLength'.
  Consider having the object provide a custom 'GomegaStringer' representation
  or adjust the parameters in Gomega's 'format' package.

  Learn more here: https://onsi.github.io/gomega/#adjusting-output

  to have length 3
  In [It] at: /home/runner/work/kubeblocks/kubeblocks/controllers/apps/cluster/cluster_controller_test.go:852 @ 08/18/26 02:45:16.491
------------------------------
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••W0818 02:45:44.606606   32960 reflector.go:462] pkg/mod/k8s.io/client-go@v0.29.14/tools/cache/reflector.go:229: watch of *v1.Component ended with: an error on the server ("unable to decode an event from the watch stream: context canceled") has prevented the request from succeeding
W0818 02:45:44.606666   32960 reflector.go:462] pkg/mod/k8s.io/client-go@v0.29.14/tools/cache/reflector.go:229: watch of *v1.ServiceDescriptor ended with: an error on the server ("unable to decode an event from the watch stream: context canceled") has prevented the request from succeeding
W0818 02:45:44.606733   32960 reflector.go:462] pkg/mod/k8s.io/client-go@v0.29.14/tools/cache/reflector.go:229: watch of *v1.Cluster ended with: an error on the server ("unable to decode an event from the watch stream: context canceled") has prevented the request from succeeding
W0818 02:45:44.606773   32960 reflector.go:462] pkg/mod/k8s.io/client-go@v0.29.14/tools/cache/reflector.go:229: watch of *v1.ComponentVersion ended with: an error on the server ("unable to decode an event from the watch stream: context canceled") has prevented the request from succeeding
W0818 02:45:44.606811   32960 reflector.go:462] pkg/mod/k8s.io/client-go@v0.29.14/tools/cache/reflector.go:229: watch of *v1.SidecarDefinition ended with: an error on the server ("unable to decode an event from the watch stream: context canceled") has prevented the request from succeeding
W0818 02:45:44.606853   32960 reflector.go:462] pkg/mod/k8s.io/client-go@v0.29.14/tools/cache/reflector.go:229: watch of *v1.ComponentDefinition ended with: an error on the server ("unable to decode an event from the watch stream: context canceled") has prevented the request from succeeding
W0818 02:45:44.606887   32960 reflector.go:462] pkg/mod/k8s.io/client-go@v0.29.14/tools/cache/reflector.go:229: watch of *v1.ShardingDefinition ended with: an error on the server ("unable to decode an event from the watch stream: context canceled") has prevented the request from succeeding
W0818 02:45:44.606924   32960 reflector.go:462] pkg/mod/k8s.io/client-go@v0.29.14/tools/cache/reflector.go:229: watch of *v1.ClusterDefinition ended with: an error on the server ("unable to decode an event from the watch stream: context canceled") has prevented the request from succeeding
W0818 02:45:44.606963   32960 reflector.go:462] pkg/mod/k8s.io/client-go@v0.29.14/tools/cache/reflector.go:229: watch of *v1.Service ended with: an error on the server ("unable to decode an event from the watch stream: context canceled") has prevented the request from succeeding
W0818 02:45:44.607026   32960 reflector.go:462] pkg/mod/k8s.io/client-go@v0.29.14/tools/cache/reflector.go:229: watch of *v1.Secret ended with: an error on the server ("unable to decode an event from the watch stream: context canceled") has prevented the request from succeeding
W0818 02:45:44.607106   32960 reflector.go:462] pkg/mod/k8s.io/client-go@v0.29.14/tools/cache/reflector.go:229: watch of *v1.ClusterRole ended with: an error on the server ("unable to decode an event from the watch stream: context canceled") has prevented the request from succeeding


Summarizing 1 Failure:
  [FAIL] Cluster Controller cluster provisioning [It] creates one KubeBlocks TLS source shared by every shard
  /home/runner/work/kubeblocks/kubeblocks/controllers/apps/cluster/cluster_controller_test.go:852

Ran 162 of 162 Specs in 58.373 seconds
FAIL! -- 161 Passed | 1 Failed | 0 Pending | 0 Skipped

Metadata

Metadata

Labels

kind/bugSomething isn't working

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions