Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

no such host error #7763

Open
cloudcafetech opened this issue May 1, 2024 · 8 comments
Open

no such host error #7763

cloudcafetech opened this issue May 1, 2024 · 8 comments
Assignees
Labels
Needs info Waiting for information

Comments

@cloudcafetech
Copy link

cloudcafetech commented May 1, 2024

  • K8s version 1.29

  • Velero version 1.13.0 using helm

  • CMD kubectl get all -n minio-store

NAME          READY   STATUS    RESTARTS   AGE
pod/minio-0   1/1     Running   0          36m

NAME                TYPE        CLUSTER-IP       EXTERNAL-IP   PORT(S)                         AGE
service/minio       ClusterIP   None             <none>        9000/TCP                        36m
service/minio-svc   NodePort    10.104.103.217   <none>        9090:31312/TCP,9000:31678/TCP   36m

NAME                     READY   AGE
statefulset.apps/minio   1/1     36m
  • CMD kubectl get schedule -n velero
NAME        STATUS    SCHEDULE       LASTBACKUP   AGE   PAUSED
k8s-daily   Enabled   */10 * * * *   48s          53m   
test        Enabled   */10 * * * *   11m          27m   
  • CMD velero get backup
NAME                  STATUS       ERRORS   WARNINGS   CREATED                         EXPIRES   STORAGE LOCATION   SELECTOR
k8s-cluster-backup    Completed    0        3          2024-05-01 05:47:29 +0000 UTC   29d       default            <none>
test-20240501063004   New          0        0          <nil>                           29d       default            <none>
test-20240501062003   New          0        0          <nil>                           29d       default            <none>
test-20240501061804   New          0        0          <nil>                           29d       default            <none>
test-20240501061604   InProgress   0        0          2024-05-01 06:35:34 +0000 UTC   29d       default            <none>
test-20240501061404   New          0        0          <nil>                           29d       default            <none>

-CMD velero describe backup test-20240501061604

Name:         test-20240501061604
Namespace:    velero
Labels:       velero.io/schedule-name=test
              velero.io/storage-location=default
Annotations:  velero.io/resource-timeout=10m0s
              velero.io/source-cluster-k8s-gitversion=v1.29.0
              velero.io/source-cluster-k8s-major-version=1
              velero.io/source-cluster-k8s-minor-version=29

Phase:  InProgress


Namespaces:
  Included:  *
  Excluded:  <none>

Resources:
  Included:        *
  Excluded:        <none>
  Cluster-scoped:  included

Label selector:  <none>

Or label selector:  <none>

Storage Location:  default

Velero-Native Snapshot PVs:  auto
Snapshot Move Data:          false
Data Mover:                  velero

TTL:  720h0m0s

CSISnapshotTimeout:    10m0s
ItemOperationTimeout:  4h0m0s

Hooks:  <none>

Backup Format Version:  1.1.0

Started:    2024-05-01 06:35:34 +0000 UTC
Completed:  <n/a>

Expiration:  2024-05-31 06:35:31 +0000 UTC

Estimated total items to be backed up:  1052
Items backed up so far:                 6

Backup Volumes:
  <error getting backup volume info: Get "http://minio-svc.minio-store.svc:9000/velero/backups/test-20240501061604/test-20240501061604-volumeinfo.json.gz?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=admin%2F20240501%2Fminio%2Fs3%2Faws4_request&X-Amz-Date=20240501T064135Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=a91d40b48a91dd4c35fa9ada6e3e1d7c479d5bcc1f3fbacde638aa12c509a353": dial tcp: lookup minio-svc.minio-store.svc on 8.8.8.8:53: no such host>
```

- LOG

```
ace= progress= resource=kubecontrollersconfigurations.crd.projectcalico.org
time="2024-05-01T09:59:14Z" level=info msg="Processing item" backup=velero/k8s-cluster-backup logSource="pkg/backup/backup.go:365" name=k8s-daily namespace=velero progress= resource=schedules.velero.io
time="2024-05-01T09:59:14Z" level=info msg="Backing up item" backup=velero/k8s-cluster-backup logSource="pkg/backup/item_backupper.go:179" name=k8s-daily namespace=velero resource=schedules.velero.io
time="2024-05-01T09:59:14Z" level=info msg="Backed up 929 items out of an estimated total of 934 (estimate will change throughout the backup)" backup=velero/k8s-cluster-backup logSource="pkg/backup/backup.go:405" name=k8s-daily namespace=velero progress= resource=schedules.velero.io
time="2024-05-01T09:59:14Z" level=info msg="Processing item" backup=velero/k8s-cluster-backup logSource="pkg/backup/backup.go:365" name=k8s-cluster-backup namespace=velero progress= resource=backups.velero.io
time="2024-05-01T09:59:14Z" level=info msg="Backing up item" backup=velero/k8s-cluster-backup logSource="pkg/backup/item_backupper.go:179" name=k8s-cluster-backup namespace=velero resource=backups.velero.io
time="2024-05-01T09:59:14Z" level=info msg="Backed up 930 items out of an estimated total of 934 (estimate will change throughout the backup)" backup=velero/k8s-cluster-backup logSource="pkg/backup/backup.go:405" name=k8s-cluster-backup namespace=velero progress= resource=backups.velero.io
time="2024-05-01T09:59:14Z" level=info msg="Processing item" backup=velero/k8s-cluster-backup logSource="pkg/backup/backup.go:365" name=default namespace=velero progress= resource=backupstoragelocations.velero.io
time="2024-05-01T09:59:14Z" level=info msg="Backing up item" backup=velero/k8s-cluster-backup logSource="pkg/backup/item_backupper.go:179" name=default namespace=velero resource=backupstoragelocations.velero.io
time="2024-05-01T09:59:14Z" level=info msg="Backed up 931 items out of an estimated total of 934 (estimate will change throughout the backup)" backup=velero/k8s-cluster-backup logSource="pkg/backup/backup.go:405" name=default namespace=velero progress= resource=backupstoragelocations.velero.io
time="2024-05-01T09:59:14Z" level=info msg="Processing item" backup=velero/k8s-cluster-backup logSource="pkg/backup/backup.go:365" name=aws namespace=velero progress= resource=volumesnapshotlocations.velero.io
time="2024-05-01T09:59:14Z" level=info msg="Backing up item" backup=velero/k8s-cluster-backup logSource="pkg/backup/item_backupper.go:179" name=aws namespace=velero resource=volumesnapshotlocations.velero.io
time="2024-05-01T09:59:14Z" level=info msg="Backed up 932 items out of an estimated total of 934 (estimate will change throughout the backup)" backup=velero/k8s-cluster-backup logSource="pkg/backup/backup.go:405" name=aws namespace=velero progress= resource=volumesnapshotlocations.velero.io
time="2024-05-01T09:59:14Z" level=info msg="Processing item" backup=velero/k8s-cluster-backup logSource="pkg/backup/backup.go:365" name=velero namespace=argocd progress= resource=applications.argoproj.io
time="2024-05-01T09:59:14Z" level=info msg="Backing up item" backup=velero/k8s-cluster-backup logSource="pkg/backup/item_backupper.go:179" name=velero namespace=argocd resource=applications.argoproj.io
time="2024-05-01T09:59:14Z" level=info msg="Backed up 933 items out of an estimated total of 934 (estimate will change throughout the backup)" backup=velero/k8s-cluster-backup logSource="pkg/backup/backup.go:405" name=velero namespace=argocd progress= resource=applications.argoproj.io
time="2024-05-01T09:59:14Z" level=info msg="Processing item" backup=velero/k8s-cluster-backup logSource="pkg/backup/backup.go:365" name=default namespace=argocd progress= resource=appprojects.argoproj.io
time="2024-05-01T09:59:14Z" level=info msg="Backing up item" backup=velero/k8s-cluster-backup logSource="pkg/backup/item_backupper.go:179" name=default namespace=argocd resource=appprojects.argoproj.io
time="2024-05-01T09:59:14Z" level=info msg="Backed up 934 items out of an estimated total of 934 (estimate will change throughout the backup)" backup=velero/k8s-cluster-backup logSource="pkg/backup/backup.go:405" name=default namespace=argocd progress= resource=appprojects.argoproj.io
time="2024-05-01T09:59:14Z" level=info msg="hookTracker: map[], hookAttempted: 0, hookFailed: 0" backup=velero/k8s-cluster-backup logSource="pkg/backup/backup.go:436"
time="2024-05-01T09:59:14Z" level=info msg="Summary for skipped PVs: []" backup=velero/k8s-cluster-backup logSource="pkg/backup/backup.go:445"
time="2024-05-01T09:59:14Z" level=info msg="Backed up a total of 934 items" backup=velero/k8s-cluster-backup logSource="pkg/backup/backup.go:449" progress=
time="2024-05-01T09:59:14Z" level=info msg="Setting up backup store to persist the backup" backup=velero/k8s-cluster-backup logSource="pkg/controller/backup_controller.go:729"
time="2024-05-01T09:59:14Z" level=error msg="cannot list VolumeSnapshotClass no matches for kind \"VolumeSnapshotClass\" in version \"snapshot.storage.k8s.io/v1\"" backup=velero/k8s-cluster-backup error="no matches for kind \"VolumeSnapshotClass\" in version \"snapshot.storage.k8s.io/v1\"" logSource="internal/volume/volumes_information.go:468"
time="2024-05-01T09:59:14Z" level=info msg="Initial backup processing complete, moving to Finalizing" backup=velero/k8s-cluster-backup logSource="pkg/controller/backup_controller.go:743"
time="2024-05-01T09:59:14Z" level=info msg="Updating backup's final status" backuprequest=velero/k8s-cluster-backup controller=backup logSource="pkg/controller/backup_controller.go:307"
time="2024-05-01T10:00:01Z" level=info msg="Schedule is due, going to submit backup." logSource="pkg/controller/schedule_controller.go:250" schedule=velero/k8s-daily
time="2024-05-01T10:00:01Z" level=info msg="No Schedule.template.metadata.labels set - using Schedule.labels for backup object" backup=velero/k8s-daily-20240501100001 labels="map[app.kubernetes.io/instance:velero]"
time="2024-05-01T10:00:01Z" level=info msg="Validating BackupStorageLocation" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:141"
time="2024-05-01T10:00:01Z" level=info msg="BackupStorageLocations is valid, marking as available" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:126"
time="2024-05-01T10:00:01Z" level=info msg="Setting up backup log" backup=velero/k8s-daily-20240501100001 logSource="pkg/controller/backup_controller.go:609"
time="2024-05-01T10:00:01Z" level=info msg="Setting up backup temp file" backup=velero/k8s-daily-20240501100001 logSource="pkg/controller/backup_controller.go:620"
time="2024-05-01T10:00:01Z" level=info msg="Setting up plugin manager" backup=velero/k8s-daily-20240501100001 logSource="pkg/controller/backup_controller.go:627"
time="2024-05-01T10:00:01Z" level=info msg="Getting backup item actions" backup=velero/k8s-daily-20240501100001 logSource="pkg/controller/backup_controller.go:631"
time="2024-05-01T10:00:01Z" level=info msg="Setting up backup store to check for backup existence" backup=velero/k8s-daily-20240501100001 logSource="pkg/controller/backup_controller.go:636"
time="2024-05-01T10:00:02Z" level=info msg="Writing backup version file" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/backup.go:197"
time="2024-05-01T10:00:02Z" level=info msg="Including namespaces: *" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/backup.go:203"
time="2024-05-01T10:00:02Z" level=info msg="Excluding namespaces: <none>" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/backup.go:204"
time="2024-05-01T10:00:02Z" level=info msg="Including resources: *" backup=velero/k8s-daily-20240501100001 logSource="pkg/util/collections/includes_excludes.go:506"
time="2024-05-01T10:00:02Z" level=info msg="Excluding resources: <none>" backup=velero/k8s-daily-20240501100001 logSource="pkg/util/collections/includes_excludes.go:507"
time="2024-05-01T10:00:02Z" level=info msg="Backing up all volumes using pod volume backup: true" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/backup.go:222"
time="2024-05-01T10:00:02Z" level=info msg="Getting items for group" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:105"
time="2024-05-01T10:00:02Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:196" resource=pods
time="2024-05-01T10:00:02Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=pods
time="2024-05-01T10:00:02Z" level=info msg="list for groupResource pods was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:02Z" level=info msg="Retrieved 23 items" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=pods
time="2024-05-01T10:00:02Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:196" resource=persistentvolumeclaims
time="2024-05-01T10:00:02Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=persistentvolumeclaims
time="2024-05-01T10:00:02Z" level=info msg="list for groupResource persistentvolumeclaims was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:02Z" level=info msg="Retrieved 1 items" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=persistentvolumeclaims
time="2024-05-01T10:00:02Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:196" resource=persistentvolumes
time="2024-05-01T10:00:02Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=persistentvolumes
time="2024-05-01T10:00:02Z" level=info msg="list for groupResource persistentvolumes was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:02Z" level=info msg="Retrieved 1 items" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=persistentvolumes
time="2024-05-01T10:00:02Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:196" resource=configmaps
time="2024-05-01T10:00:02Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=configmaps
time="2024-05-01T10:00:02Z" level=info msg="list for groupResource configmaps was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:02Z" level=info msg="Retrieved 24 items" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=configmaps
time="2024-05-01T10:00:02Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:196" resource=nodes
time="2024-05-01T10:00:02Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=nodes
time="2024-05-01T10:00:02Z" level=info msg="list for groupResource nodes was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:02Z" level=info msg="Retrieved 2 items" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=nodes
time="2024-05-01T10:00:02Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:196" resource=namespaces
time="2024-05-01T10:00:02Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:196" resource=replicationcontrollers
time="2024-05-01T10:00:02Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=replicationcontrollers
time="2024-05-01T10:00:02Z" level=info msg="list for groupResource replicationcontrollers was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:02Z" level=info msg="Retrieved 0 items" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=replicationcontrollers
time="2024-05-01T10:00:02Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:196" resource=secrets
time="2024-05-01T10:00:02Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=secrets
time="2024-05-01T10:00:02Z" level=info msg="list for groupResource secrets was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:02Z" level=info msg="Retrieved 6 items" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=secrets
time="2024-05-01T10:00:02Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:196" resource=events
time="2024-05-01T10:00:02Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=events
time="2024-05-01T10:00:02Z" level=info msg="list for groupResource events was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:02Z" level=info msg="Retrieved 473 items" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=events
time="2024-05-01T10:00:02Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:196" resource=serviceaccounts
time="2024-05-01T10:00:02Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=serviceaccounts
time="2024-05-01T10:00:02Z" level=info msg="list for groupResource serviceaccounts was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:02Z" level=info msg="Retrieved 54 items" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=serviceaccounts
time="2024-05-01T10:00:02Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:196" resource=podtemplates
time="2024-05-01T10:00:02Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=podtemplates
time="2024-05-01T10:00:02Z" level=info msg="list for groupResource podtemplates was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:02Z" level=info msg="Retrieved 0 items" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=podtemplates
time="2024-05-01T10:00:02Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:196" resource=resourcequotas
time="2024-05-01T10:00:02Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=resourcequotas
time="2024-05-01T10:00:02Z" level=info msg="list for groupResource resourcequotas was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:02Z" level=info msg="Retrieved 0 items" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=resourcequotas
time="2024-05-01T10:00:02Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:196" resource=services
time="2024-05-01T10:00:02Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=services
time="2024-05-01T10:00:02Z" level=info msg="list for groupResource services was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:02Z" level=info msg="Retrieved 13 items" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=services
time="2024-05-01T10:00:02Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:196" resource=limitranges
time="2024-05-01T10:00:02Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=limitranges
time="2024-05-01T10:00:02Z" level=info msg="list for groupResource limitranges was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:02Z" level=info msg="Retrieved 0 items" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=limitranges
time="2024-05-01T10:00:02Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:196" resource=endpoints
time="2024-05-01T10:00:02Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=endpoints
time="2024-05-01T10:00:02Z" level=info msg="list for groupResource endpoints was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:02Z" level=info msg="Retrieved 13 items" backup=velero/k8s-daily-20240501100001 group=v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=endpoints
time="2024-05-01T10:00:02Z" level=info msg="Getting items for group" backup=velero/k8s-daily-20240501100001 group=apiregistration.k8s.io/v1 logSource="pkg/backup/item_collector.go:105"
time="2024-05-01T10:00:02Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=apiregistration.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=apiservices
time="2024-05-01T10:00:02Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=apiregistration.k8s.io/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=apiservices
time="2024-05-01T10:00:02Z" level=info msg="list for groupResource apiservices.apiregistration.k8s.io was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:02Z" level=info msg="Retrieved 25 items" backup=velero/k8s-daily-20240501100001 group=apiregistration.k8s.io/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=apiservices
time="2024-05-01T10:00:03Z" level=info msg="Getting items for group" backup=velero/k8s-daily-20240501100001 group=apps/v1 logSource="pkg/backup/item_collector.go:105"
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=apps/v1 logSource="pkg/backup/item_collector.go:196" resource=daemonsets
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=apps/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=daemonsets
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource daemonsets.apps was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 3 items" backup=velero/k8s-daily-20240501100001 group=apps/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=daemonsets
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=apps/v1 logSource="pkg/backup/item_collector.go:196" resource=replicasets
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=apps/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=replicasets
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource replicasets.apps was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 11 items" backup=velero/k8s-daily-20240501100001 group=apps/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=replicasets
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=apps/v1 logSource="pkg/backup/item_collector.go:196" resource=statefulsets
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=apps/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=statefulsets
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource statefulsets.apps was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 2 items" backup=velero/k8s-daily-20240501100001 group=apps/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=statefulsets
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=apps/v1 logSource="pkg/backup/item_collector.go:196" resource=controllerrevisions
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=apps/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=controllerrevisions
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource controllerrevisions.apps was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 5 items" backup=velero/k8s-daily-20240501100001 group=apps/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=controllerrevisions
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=apps/v1 logSource="pkg/backup/item_collector.go:196" resource=deployments
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=apps/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=deployments
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource deployments.apps was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 10 items" backup=velero/k8s-daily-20240501100001 group=apps/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=deployments
time="2024-05-01T10:00:03Z" level=info msg="Getting items for group" backup=velero/k8s-daily-20240501100001 group=events.k8s.io/v1 logSource="pkg/backup/item_collector.go:105"
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=events.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=events
time="2024-05-01T10:00:03Z" level=info msg="Skipping resource because it cohabitates and we've already processed it" backup=velero/k8s-daily-20240501100001 cohabitatingResource1=events cohabitatingResource2=events.events.k8s.io group=events.k8s.io/v1 logSource="pkg/backup/item_collector.go:267" resource=events
time="2024-05-01T10:00:03Z" level=info msg="Getting items for group" backup=velero/k8s-daily-20240501100001 group=autoscaling/v2 logSource="pkg/backup/item_collector.go:105"
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=autoscaling/v2 logSource="pkg/backup/item_collector.go:196" resource=horizontalpodautoscalers
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=autoscaling/v2 logSource="pkg/backup/item_collector.go:323" namespace= resource=horizontalpodautoscalers
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource horizontalpodautoscalers.autoscaling was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 0 items" backup=velero/k8s-daily-20240501100001 group=autoscaling/v2 logSource="pkg/backup/item_collector.go:354" namespace= resource=horizontalpodautoscalers
time="2024-05-01T10:00:03Z" level=info msg="Getting items for group" backup=velero/k8s-daily-20240501100001 group=batch/v1 logSource="pkg/backup/item_collector.go:105"
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=batch/v1 logSource="pkg/backup/item_collector.go:196" resource=cronjobs
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=batch/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=cronjobs
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource cronjobs.batch was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 0 items" backup=velero/k8s-daily-20240501100001 group=batch/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=cronjobs
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=batch/v1 logSource="pkg/backup/item_collector.go:196" resource=jobs
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=batch/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=jobs
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource jobs.batch was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 0 items" backup=velero/k8s-daily-20240501100001 group=batch/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=jobs
time="2024-05-01T10:00:03Z" level=info msg="Getting items for group" backup=velero/k8s-daily-20240501100001 group=certificates.k8s.io/v1 logSource="pkg/backup/item_collector.go:105"
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=certificates.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=certificatesigningrequests
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=certificates.k8s.io/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=certificatesigningrequests
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource certificatesigningrequests.certificates.k8s.io was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 2 items" backup=velero/k8s-daily-20240501100001 group=certificates.k8s.io/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=certificatesigningrequests
time="2024-05-01T10:00:03Z" level=info msg="Getting items for group" backup=velero/k8s-daily-20240501100001 group=networking.k8s.io/v1 logSource="pkg/backup/item_collector.go:105"
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=networking.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=ingresses
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=networking.k8s.io/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=ingresses
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource ingresses.networking.k8s.io was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 0 items" backup=velero/k8s-daily-20240501100001 group=networking.k8s.io/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=ingresses
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=networking.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=ingressclasses
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=networking.k8s.io/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=ingressclasses
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource ingressclasses.networking.k8s.io was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 0 items" backup=velero/k8s-daily-20240501100001 group=networking.k8s.io/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=ingressclasses
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=networking.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=networkpolicies
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=networking.k8s.io/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=networkpolicies
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource networkpolicies.networking.k8s.io was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 7 items" backup=velero/k8s-daily-20240501100001 group=networking.k8s.io/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=networkpolicies
time="2024-05-01T10:00:03Z" level=info msg="Getting items for group" backup=velero/k8s-daily-20240501100001 group=policy/v1 logSource="pkg/backup/item_collector.go:105"
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=policy/v1 logSource="pkg/backup/item_collector.go:196" resource=poddisruptionbudgets
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=policy/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=poddisruptionbudgets
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource poddisruptionbudgets.policy was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 1 items" backup=velero/k8s-daily-20240501100001 group=policy/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=poddisruptionbudgets
time="2024-05-01T10:00:03Z" level=info msg="Getting items for group" backup=velero/k8s-daily-20240501100001 group=rbac.authorization.k8s.io/v1 logSource="pkg/backup/item_collector.go:105"
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=rbac.authorization.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=roles
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=rbac.authorization.k8s.io/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=roles
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource roles.rbac.authorization.k8s.io was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 17 items" backup=velero/k8s-daily-20240501100001 group=rbac.authorization.k8s.io/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=roles
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=rbac.authorization.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=clusterrolebindings
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=rbac.authorization.k8s.io/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=clusterrolebindings
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource clusterrolebindings.rbac.authorization.k8s.io was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 58 items" backup=velero/k8s-daily-20240501100001 group=rbac.authorization.k8s.io/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=clusterrolebindings
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=rbac.authorization.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=rolebindings
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=rbac.authorization.k8s.io/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=rolebindings
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource rolebindings.rbac.authorization.k8s.io was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 18 items" backup=velero/k8s-daily-20240501100001 group=rbac.authorization.k8s.io/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=rolebindings
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=rbac.authorization.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=clusterroles
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=rbac.authorization.k8s.io/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=clusterroles
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource clusterroles.rbac.authorization.k8s.io was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 71 items" backup=velero/k8s-daily-20240501100001 group=rbac.authorization.k8s.io/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=clusterroles
time="2024-05-01T10:00:03Z" level=info msg="Getting items for group" backup=velero/k8s-daily-20240501100001 group=storage.k8s.io/v1 logSource="pkg/backup/item_collector.go:105"
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=storage.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=volumeattachments
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=storage.k8s.io/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=volumeattachments
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource volumeattachments.storage.k8s.io was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 0 items" backup=velero/k8s-daily-20240501100001 group=storage.k8s.io/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=volumeattachments
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=storage.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=storageclasses
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=storage.k8s.io/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=storageclasses
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource storageclasses.storage.k8s.io was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 1 items" backup=velero/k8s-daily-20240501100001 group=storage.k8s.io/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=storageclasses
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=storage.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=csinodes
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=storage.k8s.io/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=csinodes
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource csinodes.storage.k8s.io was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 2 items" backup=velero/k8s-daily-20240501100001 group=storage.k8s.io/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=csinodes
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=storage.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=csidrivers
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=storage.k8s.io/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=csidrivers
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource csidrivers.storage.k8s.io was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 0 items" backup=velero/k8s-daily-20240501100001 group=storage.k8s.io/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=csidrivers
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=storage.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=csistoragecapacities
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=storage.k8s.io/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=csistoragecapacities
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource csistoragecapacities.storage.k8s.io was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 0 items" backup=velero/k8s-daily-20240501100001 group=storage.k8s.io/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=csistoragecapacities
time="2024-05-01T10:00:03Z" level=info msg="Getting items for group" backup=velero/k8s-daily-20240501100001 group=admissionregistration.k8s.io/v1 logSource="pkg/backup/item_collector.go:105"
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=admissionregistration.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=validatingwebhookconfigurations
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=admissionregistration.k8s.io/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=validatingwebhookconfigurations
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource validatingwebhookconfigurations.admissionregistration.k8s.io was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 0 items" backup=velero/k8s-daily-20240501100001 group=admissionregistration.k8s.io/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=validatingwebhookconfigurations
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=admissionregistration.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=mutatingwebhookconfigurations
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=admissionregistration.k8s.io/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=mutatingwebhookconfigurations
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource mutatingwebhookconfigurations.admissionregistration.k8s.io was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 0 items" backup=velero/k8s-daily-20240501100001 group=admissionregistration.k8s.io/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=mutatingwebhookconfigurations
time="2024-05-01T10:00:03Z" level=info msg="Getting items for group" backup=velero/k8s-daily-20240501100001 group=apiextensions.k8s.io/v1 logSource="pkg/backup/item_collector.go:105"
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=apiextensions.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=customresourcedefinitions
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=apiextensions.k8s.io/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=customresourcedefinitions
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource customresourcedefinitions.apiextensions.k8s.io was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 33 items" backup=velero/k8s-daily-20240501100001 group=apiextensions.k8s.io/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=customresourcedefinitions
time="2024-05-01T10:00:03Z" level=info msg="Getting items for group" backup=velero/k8s-daily-20240501100001 group=scheduling.k8s.io/v1 logSource="pkg/backup/item_collector.go:105"
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=scheduling.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=priorityclasses
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=scheduling.k8s.io/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=priorityclasses
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource priorityclasses.scheduling.k8s.io was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 2 items" backup=velero/k8s-daily-20240501100001 group=scheduling.k8s.io/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=priorityclasses
time="2024-05-01T10:00:03Z" level=info msg="Getting items for group" backup=velero/k8s-daily-20240501100001 group=coordination.k8s.io/v1 logSource="pkg/backup/item_collector.go:105"
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=coordination.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=leases
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=coordination.k8s.io/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=leases
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource leases.coordination.k8s.io was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 5 items" backup=velero/k8s-daily-20240501100001 group=coordination.k8s.io/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=leases
time="2024-05-01T10:00:03Z" level=info msg="Getting items for group" backup=velero/k8s-daily-20240501100001 group=node.k8s.io/v1 logSource="pkg/backup/item_collector.go:105"
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=node.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=runtimeclasses
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=node.k8s.io/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=runtimeclasses
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource runtimeclasses.node.k8s.io was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 0 items" backup=velero/k8s-daily-20240501100001 group=node.k8s.io/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=runtimeclasses
time="2024-05-01T10:00:03Z" level=info msg="Getting items for group" backup=velero/k8s-daily-20240501100001 group=discovery.k8s.io/v1 logSource="pkg/backup/item_collector.go:105"
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=discovery.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=endpointslices
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=discovery.k8s.io/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=endpointslices
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource endpointslices.discovery.k8s.io was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 13 items" backup=velero/k8s-daily-20240501100001 group=discovery.k8s.io/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=endpointslices
time="2024-05-01T10:00:03Z" level=info msg="Getting items for group" backup=velero/k8s-daily-20240501100001 group=flowcontrol.apiserver.k8s.io/v1 logSource="pkg/backup/item_collector.go:105"
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=flowcontrol.apiserver.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=prioritylevelconfigurations
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=flowcontrol.apiserver.k8s.io/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=prioritylevelconfigurations
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource prioritylevelconfigurations.flowcontrol.apiserver.k8s.io was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 8 items" backup=velero/k8s-daily-20240501100001 group=flowcontrol.apiserver.k8s.io/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=prioritylevelconfigurations
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=flowcontrol.apiserver.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=flowschemas
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=flowcontrol.apiserver.k8s.io/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=flowschemas
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource flowschemas.flowcontrol.apiserver.k8s.io was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 13 items" backup=velero/k8s-daily-20240501100001 group=flowcontrol.apiserver.k8s.io/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=flowschemas
time="2024-05-01T10:00:03Z" level=info msg="Getting items for group" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:105"
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:196" resource=globalnetworksets
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=globalnetworksets
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource globalnetworksets.crd.projectcalico.org was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 0 items" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=globalnetworksets
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:196" resource=felixconfigurations
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=felixconfigurations
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource felixconfigurations.crd.projectcalico.org was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 1 items" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=felixconfigurations
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:196" resource=caliconodestatuses
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=caliconodestatuses
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource caliconodestatuses.crd.projectcalico.org was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 0 items" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=caliconodestatuses
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:196" resource=ippools
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=ippools
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource ippools.crd.projectcalico.org was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 1 items" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=ippools
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:196" resource=bgpconfigurations
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=bgpconfigurations
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource bgpconfigurations.crd.projectcalico.org was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 0 items" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=bgpconfigurations
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:196" resource=clusterinformations
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=clusterinformations
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource clusterinformations.crd.projectcalico.org was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 1 items" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=clusterinformations
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:196" resource=networkpolicies
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=networkpolicies
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource networkpolicies.crd.projectcalico.org was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 0 items" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=networkpolicies
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:196" resource=ipamblocks
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=ipamblocks
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource ipamblocks.crd.projectcalico.org was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 0 items" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=ipamblocks
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:196" resource=globalnetworkpolicies
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=globalnetworkpolicies
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource globalnetworkpolicies.crd.projectcalico.org was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 0 items" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=globalnetworkpolicies
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:196" resource=networksets
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=networksets
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource networksets.crd.projectcalico.org was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 0 items" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=networksets
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:196" resource=ipamhandles
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=ipamhandles
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource ipamhandles.crd.projectcalico.org was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 0 items" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=ipamhandles
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:196" resource=kubecontrollersconfigurations
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=kubecontrollersconfigurations
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource kubecontrollersconfigurations.crd.projectcalico.org was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 1 items" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=kubecontrollersconfigurations
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:196" resource=blockaffinities
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=blockaffinities
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource blockaffinities.crd.projectcalico.org was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 0 items" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=blockaffinities
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:196" resource=bgppeers
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=bgppeers
time="2024-05-01T10:00:03Z" level=info msg="list for groupResource bgppeers.crd.projectcalico.org was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:03Z" level=info msg="Retrieved 0 items" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=bgppeers
time="2024-05-01T10:00:03Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:196" resource=ipreservations
time="2024-05-01T10:00:03Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=ipreservations
time="2024-05-01T10:00:04Z" level=info msg="list for groupResource ipreservations.crd.projectcalico.org was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:04Z" level=info msg="Retrieved 0 items" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=ipreservations
time="2024-05-01T10:00:04Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:196" resource=hostendpoints
time="2024-05-01T10:00:04Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=hostendpoints
time="2024-05-01T10:00:04Z" level=info msg="list for groupResource hostendpoints.crd.projectcalico.org was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:04Z" level=info msg="Retrieved 0 items" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=hostendpoints
time="2024-05-01T10:00:04Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:196" resource=ipamconfigs
time="2024-05-01T10:00:04Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=ipamconfigs
time="2024-05-01T10:00:04Z" level=info msg="list for groupResource ipamconfigs.crd.projectcalico.org was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:04Z" level=info msg="Retrieved 0 items" backup=velero/k8s-daily-20240501100001 group=crd.projectcalico.org/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=ipamconfigs
time="2024-05-01T10:00:04Z" level=info msg="Getting items for group" backup=velero/k8s-daily-20240501100001 group=velero.io/v1 logSource="pkg/backup/item_collector.go:105"
time="2024-05-01T10:00:04Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=velero.io/v1 logSource="pkg/backup/item_collector.go:196" resource=backups
time="2024-05-01T10:00:04Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=velero.io/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=backups
time="2024-05-01T10:00:04Z" level=info msg="list for groupResource backups.velero.io was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:04Z" level=info msg="Retrieved 1 items" backup=velero/k8s-daily-20240501100001 group=velero.io/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=backups
time="2024-05-01T10:00:04Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=velero.io/v1 logSource="pkg/backup/item_collector.go:196" resource=restores
time="2024-05-01T10:00:04Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=velero.io/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=restores
time="2024-05-01T10:00:04Z" level=info msg="list for groupResource restores.velero.io was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:04Z" level=info msg="Retrieved 0 items" backup=velero/k8s-daily-20240501100001 group=velero.io/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=restores
time="2024-05-01T10:00:04Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=velero.io/v1 logSource="pkg/backup/item_collector.go:196" resource=podvolumerestores
time="2024-05-01T10:00:04Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=velero.io/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=podvolumerestores
time="2024-05-01T10:00:04Z" level=info msg="list for groupResource podvolumerestores.velero.io was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:04Z" level=info msg="Retrieved 0 items" backup=velero/k8s-daily-20240501100001 group=velero.io/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=podvolumerestores
time="2024-05-01T10:00:04Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=velero.io/v1 logSource="pkg/backup/item_collector.go:196" resource=deletebackuprequests
time="2024-05-01T10:00:04Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=velero.io/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=deletebackuprequests
time="2024-05-01T10:00:04Z" level=info msg="list for groupResource deletebackuprequests.velero.io was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:04Z" level=info msg="Retrieved 0 items" backup=velero/k8s-daily-20240501100001 group=velero.io/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=deletebackuprequests
time="2024-05-01T10:00:04Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=velero.io/v1 logSource="pkg/backup/item_collector.go:196" resource=podvolumebackups
time="2024-05-01T10:00:04Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=velero.io/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=podvolumebackups
time="2024-05-01T10:00:04Z" level=info msg="list for groupResource podvolumebackups.velero.io was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:04Z" level=info msg="Retrieved 15 items" backup=velero/k8s-daily-20240501100001 group=velero.io/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=podvolumebackups
time="2024-05-01T10:00:04Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=velero.io/v1 logSource="pkg/backup/item_collector.go:196" resource=volumesnapshotlocations
time="2024-05-01T10:00:04Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=velero.io/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=volumesnapshotlocations
time="2024-05-01T10:00:04Z" level=info msg="list for groupResource volumesnapshotlocations.velero.io was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:04Z" level=info msg="Retrieved 1 items" backup=velero/k8s-daily-20240501100001 group=velero.io/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=volumesnapshotlocations
time="2024-05-01T10:00:04Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=velero.io/v1 logSource="pkg/backup/item_collector.go:196" resource=downloadrequests
time="2024-05-01T10:00:04Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=velero.io/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=downloadrequests
time="2024-05-01T10:00:04Z" level=info msg="list for groupResource downloadrequests.velero.io was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:04Z" level=info msg="Retrieved 3 items" backup=velero/k8s-daily-20240501100001 group=velero.io/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=downloadrequests
time="2024-05-01T10:00:04Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=velero.io/v1 logSource="pkg/backup/item_collector.go:196" resource=backuprepositories
time="2024-05-01T10:00:04Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=velero.io/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=backuprepositories
time="2024-05-01T10:00:04Z" level=info msg="list for groupResource backuprepositories.velero.io was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:04Z" level=info msg="Retrieved 3 items" backup=velero/k8s-daily-20240501100001 group=velero.io/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=backuprepositories
time="2024-05-01T10:00:04Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=velero.io/v1 logSource="pkg/backup/item_collector.go:196" resource=serverstatusrequests
time="2024-05-01T10:00:04Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=velero.io/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=serverstatusrequests
time="2024-05-01T10:00:04Z" level=info msg="list for groupResource serverstatusrequests.velero.io was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:04Z" level=info msg="Retrieved 0 items" backup=velero/k8s-daily-20240501100001 group=velero.io/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=serverstatusrequests
time="2024-05-01T10:00:04Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=velero.io/v1 logSource="pkg/backup/item_collector.go:196" resource=schedules
time="2024-05-01T10:00:04Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=velero.io/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=schedules
time="2024-05-01T10:00:04Z" level=info msg="list for groupResource schedules.velero.io was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:04Z" level=info msg="Retrieved 1 items" backup=velero/k8s-daily-20240501100001 group=velero.io/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=schedules
time="2024-05-01T10:00:04Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=velero.io/v1 logSource="pkg/backup/item_collector.go:196" resource=backupstoragelocations
time="2024-05-01T10:00:04Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=velero.io/v1 logSource="pkg/backup/item_collector.go:323" namespace= resource=backupstoragelocations
time="2024-05-01T10:00:04Z" level=info msg="list for groupResource backupstoragelocations.velero.io was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:04Z" level=info msg="Retrieved 1 items" backup=velero/k8s-daily-20240501100001 group=velero.io/v1 logSource="pkg/backup/item_collector.go:354" namespace= resource=backupstoragelocations
time="2024-05-01T10:00:04Z" level=info msg="Getting items for group" backup=velero/k8s-daily-20240501100001 group=velero.io/v2alpha1 logSource="pkg/backup/item_collector.go:105"
time="2024-05-01T10:00:04Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=velero.io/v2alpha1 logSource="pkg/backup/item_collector.go:196" resource=datauploads
time="2024-05-01T10:00:04Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=velero.io/v2alpha1 logSource="pkg/backup/item_collector.go:323" namespace= resource=datauploads
time="2024-05-01T10:00:04Z" level=info msg="list for groupResource datauploads.velero.io was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:04Z" level=info msg="Retrieved 0 items" backup=velero/k8s-daily-20240501100001 group=velero.io/v2alpha1 logSource="pkg/backup/item_collector.go:354" namespace= resource=datauploads
time="2024-05-01T10:00:04Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=velero.io/v2alpha1 logSource="pkg/backup/item_collector.go:196" resource=datadownloads
time="2024-05-01T10:00:04Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=velero.io/v2alpha1 logSource="pkg/backup/item_collector.go:323" namespace= resource=datadownloads
time="2024-05-01T10:00:04Z" level=info msg="list for groupResource datadownloads.velero.io was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:04Z" level=info msg="Retrieved 0 items" backup=velero/k8s-daily-20240501100001 group=velero.io/v2alpha1 logSource="pkg/backup/item_collector.go:354" namespace= resource=datadownloads
time="2024-05-01T10:00:04Z" level=info msg="Getting items for group" backup=velero/k8s-daily-20240501100001 group=argoproj.io/v1alpha1 logSource="pkg/backup/item_collector.go:105"
time="2024-05-01T10:00:04Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=argoproj.io/v1alpha1 logSource="pkg/backup/item_collector.go:196" resource=appprojects
time="2024-05-01T10:00:04Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=argoproj.io/v1alpha1 logSource="pkg/backup/item_collector.go:323" namespace= resource=appprojects
time="2024-05-01T10:00:04Z" level=info msg="list for groupResource appprojects.argoproj.io was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:04Z" level=info msg="Retrieved 1 items" backup=velero/k8s-daily-20240501100001 group=argoproj.io/v1alpha1 logSource="pkg/backup/item_collector.go:354" namespace= resource=appprojects
time="2024-05-01T10:00:04Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=argoproj.io/v1alpha1 logSource="pkg/backup/item_collector.go:196" resource=applications
time="2024-05-01T10:00:04Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=argoproj.io/v1alpha1 logSource="pkg/backup/item_collector.go:323" namespace= resource=applications
time="2024-05-01T10:00:04Z" level=info msg="list for groupResource applications.argoproj.io was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:04Z" level=info msg="Retrieved 1 items" backup=velero/k8s-daily-20240501100001 group=argoproj.io/v1alpha1 logSource="pkg/backup/item_collector.go:354" namespace= resource=applications
time="2024-05-01T10:00:04Z" level=info msg="Getting items for resource" backup=velero/k8s-daily-20240501100001 group=argoproj.io/v1alpha1 logSource="pkg/backup/item_collector.go:196" resource=applicationsets
time="2024-05-01T10:00:04Z" level=info msg="Listing items" backup=velero/k8s-daily-20240501100001 group=argoproj.io/v1alpha1 logSource="pkg/backup/item_collector.go:323" namespace= resource=applicationsets
time="2024-05-01T10:00:04Z" level=info msg="list for groupResource applicationsets.argoproj.io was not paginated" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_collector.go:496"
time="2024-05-01T10:00:04Z" level=info msg="Retrieved 0 items" backup=velero/k8s-daily-20240501100001 group=argoproj.io/v1alpha1 logSource="pkg/backup/item_collector.go:354" namespace= resource=applicationsets
time="2024-05-01T10:00:04Z" level=info msg="Collected 956 items matching the backup spec from the Kubernetes API (actual number of items backed up may be more or less depending on velero.io/exclude-from-backup annotation, plugins returning additional related items to back up, etc.)" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/backup.go:280" progress=
time="2024-05-01T10:00:04Z" level=warning msg="Got error trying to update backup's status.progress.totalItems" backup=velero/k8s-daily-20240501100001 error="backups.velero.io \"k8s-daily-20240501100001\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/backup/backup.go:289" error.function="github.com/vmware-tanzu/velero/pkg/backup.(*kubernetesBackupper).BackupWithResolvers" logSource="pkg/backup/backup.go:289"
time="2024-05-01T10:00:04Z" level=info msg="Processing item" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/backup.go:365" name=argocd-application-controller-0 namespace=argocd progress= resource=pods
time="2024-05-01T10:00:04Z" level=info msg="Backing up item" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_backupper.go:179" name=argocd-application-controller-0 namespace=argocd resource=pods
time="2024-05-01T10:00:04Z" level=info msg="Executing custom action" backup=velero/k8s-daily-20240501100001 logSource="pkg/backup/item_backupper.go:361" name=argocd-application-controller-0 namespace=argocd resource=pods
time="2024-05-01T10:00:04Z" level=info msg="Executing podAction" backup=velero/k8s-daily-20240501100001 cmd=/velero logSource="pkg/backup/pod_action.go:51" pluginName=velero
time="2024-05-01T10:00:04Z" level=info msg="Done executing podAction" backup=velero/k8s-daily-20240501100001 cmd=/velero logSource="pkg/backup/pod_action.go:85" pluginName=velero
time="2024-05-01T10:00:04Z" level=info msg="pod argocd/argocd-application-controller-0 has volumes to backup: [argocd-home]" backup=velero/k8s-daily-20240501100001 logSource="pkg/podvolume/backupper.go:172" name=argocd-application-controller-0 namespace=argocd resource=pods
time="2024-05-01T10:00:05Z" level=info msg="Founding existing repo" backupLocation=default logSource="pkg/repository/ensurer.go:86" repositoryType=kopia volumeNamespace=argocd
time="2024-05-01T10:01:01Z" level=info msg="Validating BackupStorageLocation" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:141"
time="2024-05-01T10:01:01Z" level=info msg="BackupStorageLocations is valid, marking as available" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:126"
I0501 10:01:06.219180       1 request.go:690] Waited for 1.023440395s due to client-side throttling, not priority and fairness, request: GET:https://10.96.0.1:443/apis/discovery.k8s.io/v1?timeout=32s
time="2024-05-01T10:02:01Z" level=info msg="Validating BackupStorageLocation" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:141"
time="2024-05-01T10:02:01Z" level=info msg="BackupStorageLocations is valid, marking as available" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:126"
time="2024-05-01T10:03:01Z" level=info msg="Validating BackupStorageLocation" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:141"
time="2024-05-01T10:03:01Z" level=info msg="BackupStorageLocations is valid, marking as available" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:126"
time="2024-05-01T10:04:01Z" level=info msg="Validating BackupStorageLocation" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:141"
time="2024-05-01T10:04:01Z" level=info msg="BackupStorageLocations is valid, marking as available" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:126"
time="2024-05-01T10:05:01Z" level=info msg="Validating BackupStorageLocation" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:141"
time="2024-05-01T10:05:01Z" level=info msg="BackupStorageLocations is valid, marking as available" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:126"
time="2024-05-01T10:06:01Z" level=info msg="Validating BackupStorageLocation" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:141"
time="2024-05-01T10:06:01Z" level=info msg="BackupStorageLocations is valid, marking as available" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:126"
I0501 10:06:07.673842       1 request.go:690] Waited for 1.030723402s due to client-side throttling, not priority and fairness, request: GET:https://10.96.0.1:443/apis/discovery.k8s.io/v1?timeout=32s
time="2024-05-01T10:07:01Z" level=info msg="Validating BackupStorageLocation" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:141"
time="2024-05-01T10:07:01Z" level=info msg="BackupStorageLocations is valid, marking as available" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:126"
time="2024-05-01T10:08:01Z" level=info msg="Validating BackupStorageLocation" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:141"
time="2024-05-01T10:08:01Z" level=info msg="BackupStorageLocations is valid, marking as available" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:126"
time="2024-05-01T10:09:01Z" level=info msg="Validating BackupStorageLocation" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:141"
time="2024-05-01T10:09:01Z" level=info msg="BackupStorageLocations is valid, marking as available" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:126"
time="2024-05-01T10:09:56Z" level=info msg="Schedule is due, going to submit backup." logSource="pkg/controller/schedule_controller.go:250" schedule=velero/k8s-daily
time="2024-05-01T10:09:56Z" level=info msg="No Schedule.template.metadata.labels set - using Schedule.labels for backup object" backup=velero/k8s-daily-20240501100956 labels="map[app.kubernetes.io/instance:velero]"
time="2024-05-01T10:10:01Z" level=info msg="Schedule is due, going to submit backup." logSource="pkg/controller/schedule_controller.go:250" schedule=velero/k8s-daily
time="2024-05-01T10:10:01Z" level=info msg="No Schedule.template.metadata.labels set - using Schedule.labels for backup object" backup=velero/k8s-daily-20240501101001 labels="map[app.kubernetes.io/instance:velero]"
time="2024-05-01T10:10:01Z" level=info msg="Validating BackupStorageLocation" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:141"
time="2024-05-01T10:10:01Z" level=info msg="BackupStorageLocations is valid, marking as available" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:126"
time="2024-05-01T10:11:01Z" level=info msg="Validating BackupStorageLocation" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:141"
time="2024-05-01T10:11:01Z" level=info msg="BackupStorageLocations is valid, marking as available" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:126"
I0501 10:11:09.125730       1 request.go:690] Waited for 1.009123535s due to client-side throttling, not priority and fairness, request: GET:https://10.96.0.1:443/apis/discovery.k8s.io/v1?timeout=32s
time="2024-05-01T10:12:01Z" level=info msg="Validating BackupStorageLocation" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:141"
time="2024-05-01T10:12:01Z" level=info msg="BackupStorageLocations is valid, marking as available" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:126"
time="2024-05-01T10:13:01Z" level=info msg="Validating BackupStorageLocation" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:141"
time="2024-05-01T10:13:01Z" level=info msg="BackupStorageLocations is valid, marking as available" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:126"
time="2024-05-01T10:14:01Z" level=info msg="Validating BackupStorageLocation" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:141"
time="2024-05-01T10:14:01Z" level=info msg="BackupStorageLocations is valid, marking as available" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:126"
time="2024-05-01T10:15:01Z" level=info msg="Schedule is due, going to submit backup." logSource="pkg/controller/schedule_controller.go:250" schedule=velero/k8s-daily
time="2024-05-01T10:15:01Z" level=info msg="No Schedule.template.metadata.labels set - using Schedule.labels for backup object" backup=velero/k8s-daily-20240501101501 labels="map[app.kubernetes.io/instance:velero]"
time="2024-05-01T10:15:01Z" level=info msg="Validating BackupStorageLocation" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:141"
time="2024-05-01T10:15:01Z" level=info msg="BackupStorageLocations is valid, marking as available" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:126"
time="2024-05-01T10:16:01Z" level=info msg="Validating BackupStorageLocation" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:141"
time="2024-05-01T10:16:01Z" level=info msg="BackupStorageLocations is valid, marking as available" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:126"
I0501 10:16:10.580779       1 request.go:690] Waited for 1.020197907s due to client-side throttling, not priority and fairness, request: GET:https://10.96.0.1:443/apis/discovery.k8s.io/v1?timeout=32s
time="2024-05-01T10:17:01Z" level=info msg="Validating BackupStorageLocation" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:141"
time="2024-05-01T10:17:01Z" level=info msg="BackupStorageLocations is valid, marking as available" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:126"
time="2024-05-01T10:18:01Z" level=info msg="Validating BackupStorageLocation" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:141"
time="2024-05-01T10:18:01Z" level=info msg="BackupStorageLocations is valid, marking as available" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:126"
time="2024-05-01T10:19:01Z" level=info msg="Validating BackupStorageLocation" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:141"
time="2024-05-01T10:19:01Z" level=info msg="BackupStorageLocations is valid, marking as available" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:126"
time="2024-05-01T10:20:01Z" level=info msg="Schedule is due, going to submit backup." logSource="pkg/controller/schedule_controller.go:250" schedule=velero/k8s-daily
time="2024-05-01T10:20:01Z" level=info msg="No Schedule.template.metadata.labels set - using Schedule.labels for backup object" backup=velero/k8s-daily-20240501102001 labels="map[app.kubernetes.io/instance:velero]"
time="2024-05-01T10:20:01Z" level=info msg="Validating BackupStorageLocation" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:141"
time="2024-05-01T10:20:01Z" level=info msg="BackupStorageLocations is valid, marking as available" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:126"
time="2024-05-01T10:21:01Z" level=info msg="Validating BackupStorageLocation" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:141"
time="2024-05-01T10:21:01Z" level=info msg="BackupStorageLocations is valid, marking as available" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:126"
I0501 10:21:12.036113       1 request.go:690] Waited for 1.005810338s due to client-side throttling, not priority and fairness, request: GET:https://10.96.0.1:443/apis/discovery.k8s.io/v1?timeout=32s
time="2024-05-01T10:22:01Z" level=info msg="Validating BackupStorageLocation" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:141"
time="2024-05-01T10:22:01Z" level=info msg="BackupStorageLocations is valid, marking as available" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:126"
time="2024-05-01T10:23:01Z" level=info msg="Validating BackupStorageLocation" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:141"
time="2024-05-01T10:23:01Z" level=info msg="BackupStorageLocations is valid, marking as available" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:126"
time="2024-05-01T10:24:01Z" level=info msg="Schedule is due, going to submit backup." logSource="pkg/controller/schedule_controller.go:250" schedule=velero/test
time="2024-05-01T10:24:01Z" level=info msg="No Schedule.template.metadata.labels set - using Schedule.labels for backup object" backup=velero/test-20240501102401 labels="map[]"
time="2024-05-01T10:24:01Z" level=info msg="Validating BackupStorageLocation" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:141"
time="2024-05-01T10:24:01Z" level=info msg="BackupStorageLocations is valid, marking as available" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:126"
time="2024-05-01T10:25:01Z" level=info msg="Schedule is due, going to submit backup." logSource="pkg/controller/schedule_controller.go:250" schedule=velero/k8s-daily
time="2024-05-01T10:25:01Z" level=info msg="No Schedule.template.metadata.labels set - using Schedule.labels for backup object" backup=velero/k8s-daily-20240501102501 labels="map[app.kubernetes.io/instance:velero]"
time="2024-05-01T10:25:01Z" level=info msg="Validating BackupStorageLocation" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:141"
time="2024-05-01T10:25:01Z" level=info msg="BackupStorageLocations is valid, marking as available" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:126"
time="2024-05-01T10:26:01Z" level=info msg="Validating BackupStorageLocation" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:141"
time="2024-05-01T10:26:01Z" level=info msg="BackupStorageLocations is valid, marking as available" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:126"
I0501 10:26:13.489001       1 request.go:690] Waited for 1.025815461s due to client-side throttling, not priority and fairness, request: GET:https://10.96.0.1:443/apis/discovery.k8s.io/v1?timeout=32s
time="2024-05-01T10:27:01Z" level=info msg="Validating BackupStorageLocation" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:141"
time="2024-05-01T10:27:01Z" level=info msg="BackupStorageLocations is valid, marking as available" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:126"
time="2024-05-01T10:28:01Z" level=info msg="Validating BackupStorageLocation" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:141"
time="2024-05-01T10:28:01Z" level=info msg="BackupStorageLocations is valid, marking as available" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:126"
time="2024-05-01T10:29:01Z" level=info msg="Validating BackupStorageLocation" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:141"
time="2024-05-01T10:29:01Z" level=info msg="BackupStorageLocations is valid, marking as available" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:126"
time="2024-05-01T10:29:25Z" level=error msg="BSL for DownloadRequest cannot be found" controller=download-request downloadRequest=velero/test-20240501102401-fb85f689-ac3f-4a9e-a20b-0253f09da935 logSource="pkg/controller/download_request_controller.go:172"
time="2024-05-01T10:29:25Z" level=error msg="BSL for DownloadRequest cannot be found" controller=download-request downloadRequest=velero/test-20240501102401-fb85f689-ac3f-4a9e-a20b-0253f09da935 logSource="pkg/controller/download_request_controller.go:172"
time="2024-05-01T10:30:01Z" level=info msg="Schedule is due, going to submit backup." logSource="pkg/controller/schedule_controller.go:250" schedule=velero/k8s-daily
time="2024-05-01T10:30:01Z" level=info msg="No Schedule.template.metadata.labels set - using Schedule.labels for backup object" backup=velero/k8s-daily-20240501103001 labels="map[app.kubernetes.io/instance:velero]"
time="2024-05-01T10:30:01Z" level=info msg="Schedule is due, going to submit backup." logSource="pkg/controller/schedule_controller.go:250" schedule=velero/test
time="2024-05-01T10:30:01Z" level=info msg="No Schedule.template.metadata.labels set - using Schedule.labels for backup object" backup=velero/test-20240501103001 labels="map[]"
time="2024-05-01T10:30:01Z" level=info msg="Validating BackupStorageLocation" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:141"
time="2024-05-01T10:30:01Z" level=info msg="BackupStorageLocations is valid, marking as available" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:126"
time="2024-05-01T10:30:07Z" level=error msg="BSL for DownloadRequest cannot be found" controller=download-request downloadRequest=velero/test-20240501102401-8a6f90bf-16f8-499b-842e-60fc49e9f0d6 logSource="pkg/controller/download_request_controller.go:172"
time="2024-05-01T10:30:07Z" level=error msg="BSL for DownloadRequest cannot be found" controller=download-request downloadRequest=velero/test-20240501102401-8a6f90bf-16f8-499b-842e-60fc49e9f0d6 logSource="pkg/controller/download_request_controller.go:172"
time="2024-05-01T10:31:01Z" level=info msg="Validating BackupStorageLocation" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:141"
time="2024-05-01T10:31:01Z" level=info msg="BackupStorageLocations is valid, marking as available" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:126"
I0501 10:31:14.940821       1 request.go:690] Waited for 1.020687549s due to client-side throttling, not priority and fairness, request: GET:https://10.96.0.1:443/apis/discovery.k8s.io/v1?timeout=32s
time="2024-05-01T10:32:01Z" level=info msg="Validating BackupStorageLocation" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:141"
time="2024-05-01T10:32:01Z" level=info msg="BackupStorageLocations is valid, marking as available" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:126"
time="2024-05-01T10:33:01Z" level=info msg="Validating BackupStorageLocation" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:141"
time="2024-05-01T10:33:01Z" level=info msg="BackupStorageLocations is valid, marking as available" backup-storage-location=velero/default controller=backup-storage-location logSource="pkg/controller/backup_storage_location_controller.go:126"
```
@danfengliu
Copy link
Contributor

danfengliu commented May 2, 2024

Is your Minio service accessible from the host you performing CLI velero describe, you can check it using CLI mc?

From backup description you provide, are you backing up the whole cluster?

BTW, no logs of backup test-20240501061604.

@cloudcafetech
Copy link
Author

| Is your Minio service accessible from the host you performing CLI velero describe, you can check it using CLI mc?
Bucket created using mc Even I can see folder in minio

image

image

| From backup description you provide, are you backing up the whole cluster?
YES

  • Providing new setup result
root@ldap-server:~/k8s-terraform/argo# velero get backup
NAME                 STATUS            ERRORS   WARNINGS   CREATED                         EXPIRES   STORAGE LOCATION   SELECTOR
k8s-cluster-backup   PartiallyFailed   10       41         2024-05-04 00:44:12 +0000 UTC   29d       default            <none>
root@ldap-server:~/k8s-terraform/argo#
root@ldap-server:~/k8s-terraform/argo# velero get schedule
NAME        STATUS    CREATED                         SCHEDULE      BACKUP TTL   LAST BACKUP   SELECTOR   PAUSED
k8s-daily   Enabled   2024-05-04 00:44:15 +0000 UTC   */5 * * * *   720h0m0s     1m ago        <none>     false
root@ldap-server:~/k8s-terraform/argo#
root@ldap-server:~/k8s-terraform/argo# velero backup logs k8s-cluster-backup
An error occurred: Get "http://minio-svc.minio-store.svc:9000/velero/backups/k8s-cluster-backup/k8s-cluster-backup-logs.gz?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=admin%2F20240504%2Fminio%2Fs3%2Faws4_request&X-Amz-Date=20240504T012218Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=c21eafa7f238c7f3f9835bcad8fcaf4426ccb3fcf85023f546c53741e6c966a3": dial tcp: lookup minio-svc.minio-store.svc on 127.0.0.53:53: no such host
root@ldap-server:~/k8s-terraform/argo#
root@ldap-server:~/k8s-terraform/argo# oc get po,svc -n minio-store
NAME          READY   STATUS    RESTARTS   AGE
pod/minio-0   1/1     Running   0          40m
pod/minio-1   1/1     Running   0          40m

NAME                TYPE        CLUSTER-IP       EXTERNAL-IP   PORT(S)                         AGE
service/minio       ClusterIP   None             <none>        9000/TCP                        40m
service/minio-svc   NodePort    192.167.53.210   <none>        9090:32174/TCP,9000:32121/TCP   40m
root@ldap-server:~/k8s-terraform/argo#
root@ldap-server:~/k8s-terraform/argo# oc get po -n velero
NAME                      READY   STATUS    RESTARTS   AGE
node-agent-44mkd          1/1     Running   0          39m
node-agent-m8wtj          1/1     Running   0          39m
node-agent-wlwpm          1/1     Running   0          39m
node-agent-zt8wq          1/1     Running   0          39m
velero-77d9c9db87-k6hfn   1/1     Running   0          39m

@danfengliu
Copy link
Contributor

What's the output of mc alias lsin the host you performing Velero CLI, is URL same as http://minio-svc.minio-store.svc:9000, the error message dial tcp: lookup minio-svc.minio-store.svc on 127.0.0.53:53: no such host indicates service name can not be resolved correctly, you should check your DNS setting, or can you try using your node IP in Velero BSL setting to verify that?

@reasonerjt reasonerjt added the Needs info Waiting for information label May 6, 2024
@danfengliu danfengliu self-assigned this May 6, 2024
@danfengliu
Copy link
Contributor

danfengliu commented May 6, 2024

Upon commands velero describe / velero logs, Velero CLI binary will access BSL directly to fetch backup data, so if service name minio-svc.minio-store.svc can not be resolved by the host you're performing this kind of velero commands, then no such host error is expected.

@cloudcafetech
Copy link
Author

cloudcafetech commented May 14, 2024

If its a DNS issue then how its performing k8s-cluster-backup and you can see in MINIO GUI screen shot.

Not sure its intermediate issue or not? Both backup I took using yaml as below not using velero CLI.

  • one time
apiVersion: velero.io/v1
kind: Backup
metadata:
  labels:
    velero.io/storage-location: default
  name: k8s-cluster-backup
  namespace: velero
  annotations:
    argocd.argoproj.io/sync-wave: "2"
spec:
  defaultVolumesToFsBackup: true
  hooks: {}
  includedNamespaces:
  - '*'
  metadata: {}
  snapshotMoveData: false
  storageLocation: default
  ttl: 720h0m0s
  volumeSnapshotLocations:
  - aws
  • Schedule
apiVersion: velero.io/v1
kind: Schedule
metadata:
  name: k8s-daily
  namespace: velero
  annotations:
    argocd.argoproj.io/sync-wave: "3"  
spec:
  schedule: '*/10 * * * *'
  template:
    csiSnapshotTimeout: 10m
    includedNamespaces:
    - '*'
    excludedNamespaces:
    #- some-namespace
    includedResources:
    - '*'
    excludedResources:
    #- storageclasses.storage.k8s.io
    includeClusterResources: true
    snapshotMoveData: false
    storageLocation: default
    volumeSnapshotLocations:
      - aws
    ttl: 720h0m0s
    defaultVolumesToFsBackup: true
  #useOwnerReferencesInBackup: false
  • Installation using helm with below value

velero:

  resources:
    requests:
      cpu: 300m
      memory: 128Mi
    limits:
      cpu: 300m
      memory: 512Mi

  initContainers:
    - name: velero-plugin-for-aws
      image: velero/velero-plugin-for-aws:v1.9.2
      imagePullPolicy: IfNotPresent
      volumeMounts:
        - mountPath: /target
          name: plugins
          
  configuration:
    #defaultVolumesToFsBackup: true
    backupStorageLocation:
    - name: default
      provider: aws
      bucket: velero
      accessMode: ReadWrite
      default: true
      config:
        region: minio
        s3ForcePathStyle: true
        s3Url: http://minio-svc.minio-store.svc:9000
        insecureSkipTLSVerify: true        
        #publicUrl: http://minio-svc.minio-store.svc.cluster.local:9000
    volumeSnapshotLocation:
    - name: aws
      provider: aws
      config:
        region: minio
        s3ForcePathStyle: true
        s3Url: http://minio-svc.minio-store.svc:9000        
        insecureSkipTLSVerify: true   
        
  credentials:
    useSecret: true
    existingSecret: velero-minio-secret
    secretContents:
    # Create secret using below content (kubectl create secret generic -n velero velero-minio-secret --from-file==cloud=<file-name>)
      #cloud: |
        #[default]
        #aws_access_key_id = admin
        #aws_secret_access_key = admin2675

  deployNodeAgent: true
  nodeAgent:
    resources:
      requests:
        cpu: 300m
        memory: 128Mi
      limits:
        cpu: 300m
        memory: 512Mi

@blackpiglet
Copy link
Contributor

The velero describe command works differently from the backup and restore process.

The backup and restore create command creates a backup or restore CR by calling the client-go library, and then the Velero controller gets the CR creation event. The backup and restore is performed in the k8s cluster, and the backup and restore result is uploaded to the MinIO.
Please notice the Velero controller interacting with the kube-apiserver and the MinIO server happens inside the k8s cluster.

The velero describe command needs to download the backup metadata file in the MinIO, but the download happens outside of the k8s cluster, it happens on the velero CLI running host.
The DNS server could be different between the k8s and the velero CLI host.
To verify whether the velero CLI running host can resolve the MinIO server address, you can run this command:
nslookup minio-svc.minio-store.svc.

@sseago
Copy link
Collaborator

sseago commented May 14, 2024

If you're in a situation where the BSL is not available at the same DNS address locally as in the cluster, you may need to run the Velero CLI from a pod in the cluster.

@cloudcafetech
Copy link
Author

Error I got when I run cli from outside of the cluster.
Seems I understand the challenges but question is how I can setup BSL with different MINIO end point when using velero cli. Because after deployment of velero using helm I just install cli and velero cli started fetching data through kubeconfig.

Another question is why schedule backup not happening?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Needs info Waiting for information
Projects
None yet
Development

No branches or pull requests

5 participants